-- Logs begin at Fri 2022-08-26 17:43:24 UTC, end at Fri 2022-08-26 18:40:49 UTC. -- Aug 26 18:09:17.033981 dv-cinder-851996-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 26 18:09:17.041625 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 26 18:09:17.043626 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 18:09:17 2022] *** Aug 26 18:09:17.043626 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 18:09:17.043626 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 18:09:17.043626 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: nodename: dv-cinder-851996-8-iscsi Aug 26 18:09:17.043626 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: machine: x86_64 Aug 26 18:09:17.043626 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: clock source: unix Aug 26 18:09:17.043626 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: pcre jit disabled Aug 26 18:09:17.044028 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: detected number of CPU cores: 4 Aug 26 18:09:17.044028 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: current working directory: / Aug 26 18:09:17.044028 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: detected binary path: /usr/bin/uwsgi-core Aug 26 18:09:17.044028 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: your processes number limit is 47680 Aug 26 18:09:17.044028 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: your memory page size is 4096 bytes Aug 26 18:09:17.044028 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: detected max file descriptor number: 2048 Aug 26 18:09:17.044028 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: lock engine: pthread robust mutexes Aug 26 18:09:17.044028 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: thunder lock: enabled Aug 26 18:09:17.044028 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 26 18:09:17.044449 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 18:09:17.083995 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: Python main interpreter initialized at 0x5644b93899c0 Aug 26 18:09:17.083995 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: python threads support enabled Aug 26 18:09:17.083995 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: your server socket listen backlog is limited to 100 connections Aug 26 18:09:17.083995 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: your mercy for graceful operations on workers is 90 seconds Aug 26 18:09:17.084419 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 18:09:17.084419 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: *** Operational MODE: preforking *** Aug 26 18:09:17.084750 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: *** uWSGI is running in multiple interpreter mode *** Aug 26 18:09:17.084750 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: spawned uWSGI master process (pid: 81527) Aug 26 18:09:17.084988 dv-cinder-851996-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 26 18:09:17.085976 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: spawned uWSGI worker 1 (pid: 81541, cores: 1) Aug 26 18:09:17.085976 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: spawned uWSGI worker 2 (pid: 81542, cores: 1) Aug 26 18:09:17.085976 dv-cinder-851996-8-iscsi devstack@keystone.service[81527]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 18:09:21.347720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 18:09:21.347720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: from cryptography.utils import int_from_bytes Aug 26 18:09:21.348582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 18:09:21.348582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: from cryptography.utils import int_from_bytes Aug 26 18:09:21.349750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 18:09:21.349750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: from cryptography.utils import int_from_bytes Aug 26 18:09:21.350276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 18:09:21.350276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: from cryptography.utils import int_from_bytes Aug 26 18:09:21.400694 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 18:09:21.400982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 18:09:21.401079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] command line args: [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 18:09:21.401372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 18:09:21.401533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ================================================================================ {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 18:09:21.401806 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] admin_token = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.402054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] config_dir = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.402216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.402428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] config_source = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.402587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] debug = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.402810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.403190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.403357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.403596 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.403846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.404080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.404241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 18:09:21.404363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] log_config_append = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.404463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 18:09:21.404573 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.404677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] command line args: [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 18:09:21.404816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] log_dir = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.404816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] log_file = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.405021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 18:09:21.405125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.405240 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ================================================================================ {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 18:09:21.405361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.405479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] admin_token = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.405592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.405714 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] config_dir = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.405714 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.405923 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.406038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] config_source = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.406155 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.406270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] debug = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.406391 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.406506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.406649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.406763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.406873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.406985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.407095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.407204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.407314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.407430 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.407549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.407661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.407779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.407891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] log_config_append = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.407891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.408106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.408224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] log_dir = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.408334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.408444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] log_file = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.408560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.408673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.408673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.408924 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.409039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.409157 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] publish_errors = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.409275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.409400 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.409531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.409531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.409760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.409760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.409975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.410098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.410210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.410320 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.410431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.410540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] standard_threads = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.410650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.410773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.410892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.411010 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.411121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.411237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.411354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.411474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] use_journal = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.411612 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.411744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] use_json = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.411744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] use_stderr = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.411961 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.412082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] use_syslog = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.412082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.412290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.412402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.412521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] publish_errors = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.412644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.412803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.412926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.413045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.413045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.413311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.413423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.413534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.413534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.413747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.413747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] standard_threads = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.413975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.414114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.414228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.414340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.414452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.414572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.414684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.414795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] use_journal = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.414795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] use_json = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.415016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.415130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] use_stderr = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.415254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.415374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] use_syslog = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.415488 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.415605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:09:21.415717 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.415827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.415947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.416059 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.416187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.416387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.416567 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.416739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.416873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.416988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.416988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.417203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.417323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.417443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.417563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.417682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.417795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.417905 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.418024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.418136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.418258 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.418371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.418481 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.418593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.418709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.418820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.419014 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.419129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.419248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.419367 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.419479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.419603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.419722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.419834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.419958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.420071 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.420192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.420313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.420313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.420524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.420634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.420773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.420886 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.421013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.421126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.421243 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.421355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.421468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.421583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.421704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.421826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.421826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.422041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.422153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.422263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.422384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.422498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.422614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.422732 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.422844 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.422954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.423076 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.423189 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.423299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.423415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.423528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.423645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.423764 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.423876 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.423993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.424105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.424222 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.424335 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.424521 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.424637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.424893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.425023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.425138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.425249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.425369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.425489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.425607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.425720 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.425831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.425944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.426062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.426175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.426286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.426396 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.426513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.426626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.426746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.426844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.426938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.427032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.427125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.427234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.427339 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.427435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.427435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.427662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.427769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.427884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.427884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.428104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.428215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.428319 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.428428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.428548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.428548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.428775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.428882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.428991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.429103 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.429226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.429340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.429464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.429586 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.429704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.429818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.429921 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.430031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.430151 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.430255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.430366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.430477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.430597 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.430709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.430834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.430945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.431058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.431169 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.431273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.431383 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.431506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.431614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.431725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.431836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.432016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.432135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.432257 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.432371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.432483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.432594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.432705 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.432838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.432963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.433085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.433199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.433316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.433429 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.433540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.433663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.433777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.433888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.434000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.434112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.434223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.434346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.434346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.434557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.434673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.434673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.434882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.435001 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.435114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.435224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.435348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.435461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.435571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.435757 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.435872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.435982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.436093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.436206 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.436326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.436448 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.436574 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.436688 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.436824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.436937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.437049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.437162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.437286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.437407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.437521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.437632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.external = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.437744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.437855 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.437976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.437976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.438188 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.438302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.438413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.438524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.438644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.password = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.438757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.438869 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.token = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.438981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.439092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.439233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.439363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.439478 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.439599 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.439713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.439809 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.439930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.440043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.440156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.440277 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.440392 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.440504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.440616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.440744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.440859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.440987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.441111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.external = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.441231 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.441346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.441462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.441462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.441683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.441804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.441918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.442031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.442143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.password = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.442255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.442379 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.token = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.442496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.442609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.442722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.442835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.442947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.443070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.443194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.443308 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.443421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.443535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.443655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.443777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.443893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.444005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.444118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.444230 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.444342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.444463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.444578 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.444690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.444847 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.444973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.445088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.445210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.445324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.445437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.445551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.445664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.445777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.445897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.446012 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.446126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.446238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.446351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.446464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.446585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.446700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.446815 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.446928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.447048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.447170 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.447291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.447405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.447518 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.447677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.447791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.447912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.448027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.448146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.448260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.448373 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.448486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.448608 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.448739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.448855 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.448967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.449166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.449285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.449480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.449598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.449711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.449711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.449925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.450038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.450160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.450276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.450389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.450502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.450615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.450727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.450849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.450849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.451062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.451175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.451287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.451404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.451526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.451641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.451754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.451867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.451989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.452103 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.452225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.452338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.452452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.452564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.452677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.452809 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.452936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.452936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.453152 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.453266 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.453378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.453378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.453598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.453713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.453826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.453940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.454053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.454053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.454273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.454387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.454500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.454621 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.454735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.454848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.454969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.455091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.455205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.455324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.455438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.455551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.455672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.455793 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.455908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.456020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.456134 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.456246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.456368 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.456490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.456610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.456792 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.456909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.457022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.457147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.457262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.457375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.457487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.457599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.457723 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.457837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.457950 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.458062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.458175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.458287 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.458407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.458520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.458633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.458745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.458860 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.458972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.459093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.459214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.459327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.459440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.459553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.459666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.459776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.459954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.460071 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.460184 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.460297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.460410 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.460531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.460645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.460781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.460898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.461011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.461123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.461244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.461365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.461478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.461590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.461702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.461702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.461923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.462081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.462197 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.462310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.462423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.462423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.462645 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.462760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.462872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.462984 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.463096 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.463231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.463354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.463354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.463567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.463679 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.463791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.463902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.464022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.464136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.464248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.464366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.464480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.464593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.464732 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.464849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.464961 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.465074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.465185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.465185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.465421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.465536 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.465649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.465760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.465873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.465986 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.466110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.466110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.466322 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.466435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.466548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.466548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.466771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.466887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.466999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.467111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.467223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.467334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.467455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.467571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.467683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.467801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.467914 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.468026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.468146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.468259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.468371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.468484 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.468596 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.468709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.468859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.468974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.469086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.469199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.469310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.469423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.469543 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.469658 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.469770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.469884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.469996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] role.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.470108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.470229 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] role.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.470343 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.470760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.470883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.470997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.471109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.471233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.471349 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.471461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.471574 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.471685 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.471876 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.471992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.472105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.472217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.472329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.472441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.472562 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.472682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.472833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.472947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.473060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.473172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.473297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.473412 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.473525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.473638 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.473750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.473863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.473984 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.473984 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] role.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.474196 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.474308 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] role.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.474421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.474533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.474654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.474769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.474882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.474997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.475109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.475221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.475342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.475456 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.475568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.475681 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.475794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.475906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.476028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.476142 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.476254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.476366 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.476478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.476590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.476711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.476846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.476959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.477072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.477185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.477297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.477422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.477536 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.477649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.477649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.477860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.477981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.478095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.478208 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.478320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.478432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] token.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.478544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.478665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.478799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.478937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.479050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.479163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.479275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.479397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.479512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.479625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.479738 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.479851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.479972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.480098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.480214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.480326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.480439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.480439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.480650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.480650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.480889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.481003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.481115 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.481231 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.481344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.481465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.481578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.481578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.481790 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.481902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.482013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.482138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] token.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.482265 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.482380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.482497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.482618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.482730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.connection = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.482842 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.482962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.483076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.483188 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.483301 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.483413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.483562 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.483683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.483798 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.483909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.484022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.484133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.484245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.484374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.484489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.484601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.484771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.484889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.485002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.485127 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.485241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.485354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.485354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.485566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.485677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.485798 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.485921 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.486046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.486160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.486272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.486384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.486497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.connection = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.486609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.486729 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.486843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.486955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.487067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 18:09:21.487180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.487180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.487180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.487180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.487180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.487180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.487180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.487889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.487889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.487889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.487889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.488305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.488416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.488559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.488837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.489077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:09:21.489248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 18:09:21.515179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.515369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.515603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.518190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.518401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.518659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.524216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.527686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.552638 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.552852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.553777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.554016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.607533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.607715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.656682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.656970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.657811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.658121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.813698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.813905 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.814130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.814350 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.814548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.814785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.815206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.815441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.815638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.815888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.816104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.816316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.837778 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.838123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.838277 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.838373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.838441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.838597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.838683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.838820 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.838912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.839039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.839119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.839262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.839346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.839541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.850761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.851088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.863721 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.863872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.864013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.864138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.864224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.864344 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.864423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.864538 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.864626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.864703 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.864883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.865010 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.865148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.865249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 18:09:21.881879 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.882098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 18:09:21.882222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.882362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 18:09:21.882442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.882626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 18:09:21.882750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.882890 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 18:09:21.882970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.883112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.883251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.883390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.883471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.883652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.883841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.884129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.893330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.893549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.893676 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.893816 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.893899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.894086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.894213 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.894352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.901140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.901660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.904058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.904347 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.904544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.904669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.904855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.904981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.905083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.905163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.905362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.905454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.905673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.905812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.905896 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.905972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.906197 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.906323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.906450 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.906540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.906744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.906867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.907127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.907395 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.929421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.930735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.930861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.931154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.932303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.932586 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.935756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.936047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.936333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.937262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.937546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.937828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.942839 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.943129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.944141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.944426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.947178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.947741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.947741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.948036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.948320 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.948509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.948847 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.949123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.949404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.949676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.949934 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.950211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.950412 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.950500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.950700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.950985 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.966547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.966828 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.967569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.967855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.971062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.972068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.974204 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.974506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.975280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.975576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.978897 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.979805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.982068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.982943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:21.985263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.985577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.985873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.986160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.986284 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.986423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.986519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.986724 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.986848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.986988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.987293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:21.987660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.002566 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.002859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.003133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.003402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.003529 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.003696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.003970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.004253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.010205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.011265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.011885 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.012783 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.013459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.013741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.014324 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.014611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.016386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.016676 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.016987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.017267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.017392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.017550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.017634 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.017936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.018221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.018504 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.028932 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.029221 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.029507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.029790 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.029915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.030074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.030203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.030294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.030593 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.030720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.030855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.031159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.031434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.031723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.046039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.047000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.049090 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.049913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.051971 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.052774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.053459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.054248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.054933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.055221 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.055506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.055847 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.056131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.056408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.062055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.062837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.063531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.064302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.066448 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.066741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.067028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.067292 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.067418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.067575 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.067859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.068155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.075259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.075550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.075833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.075957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.076183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.076464 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.082735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.083019 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.083302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.083426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 18:09:22.083590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.083716 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.083813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.083900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.084114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.084241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.084356 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.084445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.084658 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.084826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.084922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.085000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.085218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.085346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.085467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.085558 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.085750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.085889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.085975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.086052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.086264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.086391 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.086560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.086827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 18:09:22.120547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5644b93899c0 pid: 81541 (default app) Aug 26 18:09:22.120953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5644b93899c0 pid: 81542 (default app) Aug 26 18:09:22.124086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e323b-87e0-4731-83e0-319b81eb359a None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:22.124343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e323b-87e0-4731-83e0-319b81eb359a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:22.124615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e323b-87e0-4731-83e0-319b81eb359a None None] PATH_INFO: `/v3` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:22.128853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Fri Aug 26 18:09:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:28.683275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ee3a9-1925-4dfc-bd26-f286277dce95 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:28.683821 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ee3a9-1925-4dfc-bd26-f286277dce95 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:28.683821 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ee3a9-1925-4dfc-bd26-f286277dce95 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:28.688160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:28.694015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc1dd2-b9c5-463d-8a53-f54ca7da0948 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:28.694486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc1dd2-b9c5-463d-8a53-f54ca7da0948 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:28.694621 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc1dd2-b9c5-463d-8a53-f54ca7da0948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:28.765509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: INFO dbcounter [None req-04cc1dd2-b9c5-463d-8a53-f54ca7da0948 None None] Registered counter for database keystone Aug 26 18:09:28.785326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG oslo_db.sqlalchemy.engines [None req-04cc1dd2-b9c5-463d-8a53-f54ca7da0948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:09:28.792848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writer thread running {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:09:28.975206 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG passlib.handlers.bcrypt [None req-04cc1dd2-b9c5-463d-8a53-f54ca7da0948 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81541) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 18:09:28.975634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG passlib.handlers.bcrypt [None req-04cc1dd2-b9c5-463d-8a53-f54ca7da0948 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81541) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 18:09:29.030210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-04cc1dd2-b9c5-463d-8a53-f54ca7da0948 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:29.031853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-04cc1dd2-b9c5-463d-8a53-f54ca7da0948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:29.170065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 26 18:09:29.650993 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ee3a9-1925-4dfc-bd26-f286277dce95 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:29.721381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: INFO dbcounter [None req-984ee3a9-1925-4dfc-bd26-f286277dce95 None None] Registered counter for database keystone Aug 26 18:09:29.743158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG oslo_db.sqlalchemy.engines [None req-984ee3a9-1925-4dfc-bd26-f286277dce95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:09:29.750702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writer thread running {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:09:29.869557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ee3a9-1925-4dfc-bd26-f286277dce95 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:29.874378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa066a7-4729-4bd2-929a-3f05c4c44c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:29.875017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa066a7-4729-4bd2-929a-3f05c4c44c98 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:29.875281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa066a7-4729-4bd2-929a-3f05c4c44c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:29.875553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa066a7-4729-4bd2-929a-3f05c4c44c98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:29.884233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa066a7-4729-4bd2-929a-3f05c4c44c98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:29.935299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7aa066a7-4729-4bd2-929a-3f05c4c44c98 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 18:09:29.935639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa066a7-4729-4bd2-929a-3f05c4c44c98 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:29.946238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Fri Aug 26 18:09:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:09:29.953035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc1dd2-b9c5-463d-8a53-f54ca7da0948 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:29.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc1dd2-b9c5-463d-8a53-f54ca7da0948 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:29.974413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d55ca1-50f7-4bd2-bbbf-74687a4bd12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:29.975610 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d55ca1-50f7-4bd2-bbbf-74687a4bd12f admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:29.975893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d55ca1-50f7-4bd2-bbbf-74687a4bd12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:29.976169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d55ca1-50f7-4bd2-bbbf-74687a4bd12f admin admin] PATH_INFO: `/v3/projects/8a44db81f3af4ce4ac409fec8e68c2cd` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:29.977921 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d55ca1-50f7-4bd2-bbbf-74687a4bd12f admin admin] RBAC: Authorizing `identity:get_project(project_id=8a44db81f3af4ce4ac409fec8e68c2cd)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:30.030405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: WARNING keystone.common.rbac_enforcer.enforcer [None req-11d55ca1-50f7-4bd2-bbbf-74687a4bd12f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 18:09:30.030755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d55ca1-50f7-4bd2-bbbf-74687a4bd12f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:30.035511 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Fri Aug 26 18:09:29 2022] GET /identity/v3/projects/8a44db81f3af4ce4ac409fec8e68c2cd => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:31.909690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b8875-7f0e-400b-a3e3-53286cee8193 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:31.910269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b8875-7f0e-400b-a3e3-53286cee8193 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:31.910269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b8875-7f0e-400b-a3e3-53286cee8193 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:31.914308 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:31.920480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088b588-d8fc-4499-bbf7-bf67c1461be5 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:31.921000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088b588-d8fc-4499-bbf7-bf67c1461be5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:31.921000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088b588-d8fc-4499-bbf7-bf67c1461be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:31.942252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c088b588-d8fc-4499-bbf7-bf67c1461be5 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:31.943825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c088b588-d8fc-4499-bbf7-bf67c1461be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:31.952430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 26 18:09:32.216936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b8875-7f0e-400b-a3e3-53286cee8193 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:32.230385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b8875-7f0e-400b-a3e3-53286cee8193 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:32.235190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6e15-efda-4d39-8f9f-943423aea887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:32.235793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6e15-efda-4d39-8f9f-943423aea887 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:32.236074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6e15-efda-4d39-8f9f-943423aea887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:32.236350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6e15-efda-4d39-8f9f-943423aea887 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:32.244479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6e15-efda-4d39-8f9f-943423aea887 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:32.246398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6e15-efda-4d39-8f9f-943423aea887 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:32.255392 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Fri Aug 26 18:09:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:09:32.261348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088b588-d8fc-4499-bbf7-bf67c1461be5 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:32.271046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088b588-d8fc-4499-bbf7-bf67c1461be5 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:32.276841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7eff2-c22d-4e33-8d6e-c9dcc0073630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:32.277471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7eff2-c22d-4e33-8d6e-c9dcc0073630 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:32.277750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7eff2-c22d-4e33-8d6e-c9dcc0073630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:32.278025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7eff2-c22d-4e33-8d6e-c9dcc0073630 admin admin] PATH_INFO: `/v3/users/5d269ce658414d469f0da1f990d74895` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:32.279505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7eff2-c22d-4e33-8d6e-c9dcc0073630 admin admin] RBAC: Authorizing `identity:get_user(user_id=5d269ce658414d469f0da1f990d74895)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:32.281418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7eff2-c22d-4e33-8d6e-c9dcc0073630 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:32.282979 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Fri Aug 26 18:09:32 2022] GET /identity/v3/users/5d269ce658414d469f0da1f990d74895 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:34.232969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d38f4-03cc-457b-a586-7f8c308d74a4 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:34.233513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d38f4-03cc-457b-a586-7f8c308d74a4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:34.233513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d38f4-03cc-457b-a586-7f8c308d74a4 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:34.234864 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:34.240292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a1556-9c0e-42b3-90eb-3000a19889d1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:34.240777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a1556-9c0e-42b3-90eb-3000a19889d1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:34.240877 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a1556-9c0e-42b3-90eb-3000a19889d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:34.259827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2a9a1556-9c0e-42b3-90eb-3000a19889d1 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:34.261507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2a9a1556-9c0e-42b3-90eb-3000a19889d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:34.274978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71083f-d996-463c-8684-81cfa913886f None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:34.275264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71083f-d996-463c-8684-81cfa913886f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:34.275542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71083f-d996-463c-8684-81cfa913886f None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:34.276926 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:34.282279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb9d9b-3e6d-4f60-be77-df7e9db34596 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:34.282516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb9d9b-3e6d-4f60-be77-df7e9db34596 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:34.282821 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb9d9b-3e6d-4f60-be77-df7e9db34596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:34.325543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG passlib.handlers.bcrypt [None req-d4fb9d9b-3e6d-4f60-be77-df7e9db34596 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81542) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 18:09:34.325956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG passlib.handlers.bcrypt [None req-d4fb9d9b-3e6d-4f60-be77-df7e9db34596 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81542) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 18:09:34.344987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:34.371558 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d4fb9d9b-3e6d-4f60-be77-df7e9db34596 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:34.373204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d4fb9d9b-3e6d-4f60-be77-df7e9db34596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:34.477794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:34.609125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a1556-9c0e-42b3-90eb-3000a19889d1 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:34.636627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:34.720075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a1556-9c0e-42b3-90eb-3000a19889d1 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:34.737921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb9d9b-3e6d-4f60-be77-df7e9db34596 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:34.757430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d42aa-5a85-49ab-b926-a2b7e41597ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:34.758083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d42aa-5a85-49ab-b926-a2b7e41597ce None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:34.758364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d42aa-5a85-49ab-b926-a2b7e41597ce None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:34.758642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d42aa-5a85-49ab-b926-a2b7e41597ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:34.770343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d42aa-5a85-49ab-b926-a2b7e41597ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e14d42aa-5a85-49ab-b926-a2b7e41597ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:34.779214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:34.780227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:09:34.781115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:09:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:09:34.786230 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d42aa-5a85-49ab-b926-a2b7e41597ce None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:34.836726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb9d9b-3e6d-4f60-be77-df7e9db34596 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:34.839085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:34.868963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:34.878110 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59661a7-4a99-4316-95bf-5cf00799f22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:34.878992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59661a7-4a99-4316-95bf-5cf00799f22d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:34.879267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59661a7-4a99-4316-95bf-5cf00799f22d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:34.879562 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59661a7-4a99-4316-95bf-5cf00799f22d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:34.888096 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d42aa-5a85-49ab-b926-a2b7e41597ce None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:34.921855 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127f62d-44fe-44bc-9f14-72a084375cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:34.922462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127f62d-44fe-44bc-9f14-72a084375cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:34.922746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127f62d-44fe-44bc-9f14-72a084375cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:34.923020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127f62d-44fe-44bc-9f14-72a084375cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:34.923691 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127f62d-44fe-44bc-9f14-72a084375cb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:34.923994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127f62d-44fe-44bc-9f14-72a084375cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:34.925449 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127f62d-44fe-44bc-9f14-72a084375cb2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:34.937371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:09:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:34.943079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127f62d-44fe-44bc-9f14-72a084375cb2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:34.948442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59661a7-4a99-4316-95bf-5cf00799f22d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:34.950024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59661a7-4a99-4316-95bf-5cf00799f22d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:35.042638 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127f62d-44fe-44bc-9f14-72a084375cb2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:35.048810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:09:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 18:09:35.054535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59661a7-4a99-4316-95bf-5cf00799f22d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:35.057485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:35.076992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116299e6-5c0c-4506-b670-cfa0ae9f0553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:35.077916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116299e6-5c0c-4506-b670-cfa0ae9f0553 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:35.078200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116299e6-5c0c-4506-b670-cfa0ae9f0553 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:35.078478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116299e6-5c0c-4506-b670-cfa0ae9f0553 None admin] PATH_INFO: `/v3/users/5d269ce658414d469f0da1f990d74895` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:35.079644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116299e6-5c0c-4506-b670-cfa0ae9f0553 None admin] RBAC: Authorizing `identity:get_user(user_id=5d269ce658414d469f0da1f990d74895)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:35.081160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116299e6-5c0c-4506-b670-cfa0ae9f0553 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:35.082748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:34 2022] GET /identity/v3/users/5d269ce658414d469f0da1f990d74895 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:09:35.089201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116299e6-5c0c-4506-b670-cfa0ae9f0553 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:35.104190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:35.154517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59661a7-4a99-4316-95bf-5cf00799f22d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:35.188472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cb969-75bc-4f1c-9dd0-09949fd84f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:35.189358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cb969-75bc-4f1c-9dd0-09949fd84f91 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:35.189637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cb969-75bc-4f1c-9dd0-09949fd84f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:35.189907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cb969-75bc-4f1c-9dd0-09949fd84f91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:35.190948 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116299e6-5c0c-4506-b670-cfa0ae9f0553 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:35.208482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cb969-75bc-4f1c-9dd0-09949fd84f91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:35.210008 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cb969-75bc-4f1c-9dd0-09949fd84f91 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:35.225883 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f169731-aa7a-49a1-ac3e-ca76ed97f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:35.226520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169731-aa7a-49a1-ac3e-ca76ed97f896 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:35.226795 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169731-aa7a-49a1-ac3e-ca76ed97f896 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:35.227063 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169731-aa7a-49a1-ac3e-ca76ed97f896 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:35.228200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f169731-aa7a-49a1-ac3e-ca76ed97f896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-279cb969-75bc-4f1c-9dd0-09949fd84f91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:09:35.228302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:35.229594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:09:35.230452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:09:35.230452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:09:35.230452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:09:35.230617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f169731-aa7a-49a1-ac3e-ca76ed97f896 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:35.230683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:09:35.231366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:09:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:09:35.236758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f169731-aa7a-49a1-ac3e-ca76ed97f896 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:35.236868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cb969-75bc-4f1c-9dd0-09949fd84f91 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:35.295454 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:35.321937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:35.341537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f169731-aa7a-49a1-ac3e-ca76ed97f896 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:35.341702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cb969-75bc-4f1c-9dd0-09949fd84f91 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:35.375738 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7bd08-5768-4dfa-8d3d-133f229359da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:35.376290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb030a-4e96-4f91-8450-18c564cb39f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:35.376397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7bd08-5768-4dfa-8d3d-133f229359da None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:35.376611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7bd08-5768-4dfa-8d3d-133f229359da None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:35.376912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7bd08-5768-4dfa-8d3d-133f229359da None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:35.376999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb030a-4e96-4f91-8450-18c564cb39f0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:35.377200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb030a-4e96-4f91-8450-18c564cb39f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:35.377471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb030a-4e96-4f91-8450-18c564cb39f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:35.377553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7bd08-5768-4dfa-8d3d-133f229359da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:35.377847 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7bd08-5768-4dfa-8d3d-133f229359da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:35.378195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb030a-4e96-4f91-8450-18c564cb39f0 None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.domain.id=default, user.id=5d269ce658414d469f0da1f990d74895) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:35.378501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb030a-4e96-4f91-8450-18c564cb39f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:35.379234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7bd08-5768-4dfa-8d3d-133f229359da None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:35.379928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb030a-4e96-4f91-8450-18c564cb39f0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:35.387460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 11/20] 10.222.0.45 () {56 vars in 1322 bytes} [Fri Aug 26 18:09:35 2022] GET /identity/v3/role_assignments?user.id=5d269ce658414d469f0da1f990d74895&scope.domain.id=default&role.id=db572ad3d504403cbb227c2155c93eda => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:09:35.397451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 10/21] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:37.571736 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c96d1-3304-41f6-b7f5-cd503e8086f2 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:37.572248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c96d1-3304-41f6-b7f5-cd503e8086f2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:37.572649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c96d1-3304-41f6-b7f5-cd503e8086f2 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:37.575434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 12/22] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:37.584235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433a20-74e9-47a9-9900-cbb85bc3beb3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:37.585602 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433a20-74e9-47a9-9900-cbb85bc3beb3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:37.586335 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433a20-74e9-47a9-9900-cbb85bc3beb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:37.622197 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f5433a20-74e9-47a9-9900-cbb85bc3beb3 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:37.623415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f5433a20-74e9-47a9-9900-cbb85bc3beb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:37.711036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 11/23] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:37.851968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df9331-e484-48b0-812c-21d9c8627fe3 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:37.852993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df9331-e484-48b0-812c-21d9c8627fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:37.853740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df9331-e484-48b0-812c-21d9c8627fe3 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:37.856405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:37.862102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c34c41-0509-44fe-93d6-0729acb21590 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:37.862382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c34c41-0509-44fe-93d6-0729acb21590 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:37.862838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c34c41-0509-44fe-93d6-0729acb21590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:37.890070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-59c34c41-0509-44fe-93d6-0729acb21590 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:37.891747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-59c34c41-0509-44fe-93d6-0729acb21590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:37.948221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:37.983037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 12/25] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:38.292136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62f598-17fa-4821-ba46-e1efe9929644 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:38.292430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62f598-17fa-4821-ba46-e1efe9929644 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:38.292680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62f598-17fa-4821-ba46-e1efe9929644 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:38.294377 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 14/26] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:09:38.302254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e087a3-5439-468c-b01b-47603cb86c43 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:38.302540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e087a3-5439-468c-b01b-47603cb86c43 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:38.302816 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e087a3-5439-468c-b01b-47603cb86c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:38.315838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62f598-17fa-4821-ba46-e1efe9929644 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:38.347164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a4e087a3-5439-468c-b01b-47603cb86c43 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:38.348366 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a4e087a3-5439-468c-b01b-47603cb86c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:38.487868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62f598-17fa-4821-ba46-e1efe9929644 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:38.510871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 13/27] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:38.512607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d98817-9090-4189-bd11-bf397ddeb25f None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:38.513135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d98817-9090-4189-bd11-bf397ddeb25f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:38.513622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d98817-9090-4189-bd11-bf397ddeb25f None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:38.515431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 14/28] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:38.516389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d98817-9090-4189-bd11-bf397ddeb25f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:38.535605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d4f20-9dc7-43b4-a7eb-7d3a97b9d647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:38.536253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d4f20-9dc7-43b4-a7eb-7d3a97b9d647 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:38.536530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d4f20-9dc7-43b4-a7eb-7d3a97b9d647 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:38.536878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d4f20-9dc7-43b4-a7eb-7d3a97b9d647 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:38.555870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d4f20-9dc7-43b4-a7eb-7d3a97b9d647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-5d2d4f20-9dc7-43b4-a7eb-7d3a97b9d647 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:38.566207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:38.567092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:38.567837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:38.567837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:38.567837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:38.567837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:38.567837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:38.567837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:38.567837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:38.567837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:38.567837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:38.567837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:38.567837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:09:38.567837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:09:38.574998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 15/29] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:09:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:09:38.576321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cc0d6-91b9-4842-9c2e-b3a3d0c6a55d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:38.576603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cc0d6-91b9-4842-9c2e-b3a3d0c6a55d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:38.576900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cc0d6-91b9-4842-9c2e-b3a3d0c6a55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:38.596807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:38.616809 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f43cc0d6-91b9-4842-9c2e-b3a3d0c6a55d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:38.618287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f43cc0d6-91b9-4842-9c2e-b3a3d0c6a55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:38.736913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d98817-9090-4189-bd11-bf397ddeb25f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:38.750232 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:38.756773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 16/30] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:38.758410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cc0d6-91b9-4842-9c2e-b3a3d0c6a55d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:38.803803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bae8e-5d7b-4457-bcfd-b7392a5d0e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:38.804749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bae8e-5d7b-4457-bcfd-b7392a5d0e6f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:38.805047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bae8e-5d7b-4457-bcfd-b7392a5d0e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:38.805328 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bae8e-5d7b-4457-bcfd-b7392a5d0e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:38.817635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bae8e-5d7b-4457-bcfd-b7392a5d0e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:38.819240 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bae8e-5d7b-4457-bcfd-b7392a5d0e6f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-c60bae8e-5d7b-4457-bcfd-b7392a5d0e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:09:38.836038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:38.836966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:09:38.837768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:09:38.837768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:09:38.837768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:09:38.837768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 15/31] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:09:38.838462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bae8e-5d7b-4457-bcfd-b7392a5d0e6f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:38.933241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cc0d6-91b9-4842-9c2e-b3a3d0c6a55d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:38.970424 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d4cd7-e447-411e-8cf9-9a558751f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:38.971606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4cd7-e447-411e-8cf9-9a558751f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:38.972043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4cd7-e447-411e-8cf9-9a558751f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:38.972446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4cd7-e447-411e-8cf9-9a558751f1e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:38.973273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d4cd7-e447-411e-8cf9-9a558751f1e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:38.973702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d4cd7-e447-411e-8cf9-9a558751f1e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:38.975238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d4cd7-e447-411e-8cf9-9a558751f1e2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:38.976815 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:38.985552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 17/32] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:38.986782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d4cd7-e447-411e-8cf9-9a558751f1e2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:39.022437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bae8e-5d7b-4457-bcfd-b7392a5d0e6f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:39.059445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69711801-75fc-4266-a829-5f5d2b845529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:39.060336 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711801-75fc-4266-a829-5f5d2b845529 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:39.060855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711801-75fc-4266-a829-5f5d2b845529 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:39.061309 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711801-75fc-4266-a829-5f5d2b845529 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:39.062190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69711801-75fc-4266-a829-5f5d2b845529 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:39.063783 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69711801-75fc-4266-a829-5f5d2b845529 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:39.111310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d4cd7-e447-411e-8cf9-9a558751f1e2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:39.145972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7ece7-9631-430a-87cf-c9cbe6370d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:39.146819 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7ece7-9631-430a-87cf-c9cbe6370d2f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:39.147241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7ece7-9631-430a-87cf-c9cbe6370d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:39.147650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7ece7-9631-430a-87cf-c9cbe6370d2f None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:39.148493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7ece7-9631-430a-87cf-c9cbe6370d2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:39.148994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7ece7-9631-430a-87cf-c9cbe6370d2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:39.150526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7ece7-9631-430a-87cf-c9cbe6370d2f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:39.169561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 18/33] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:39.170708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7ece7-9631-430a-87cf-c9cbe6370d2f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:39.199156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 16/34] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Aug 26 18:09:38 2022] POST /identity/v3/roles => generated 219 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:09:39.201103 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b93505-198b-45fc-aa6f-647eab3f3f18 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:39.201502 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b93505-198b-45fc-aa6f-647eab3f3f18 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:39.201848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b93505-198b-45fc-aa6f-647eab3f3f18 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:39.203214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 17/35] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:39.204103 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b93505-198b-45fc-aa6f-647eab3f3f18 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:39.228427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:39.248352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:39.312990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7ece7-9631-430a-87cf-c9cbe6370d2f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:39.330565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b93505-198b-45fc-aa6f-647eab3f3f18 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:39.363191 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d124094-9a48-452c-8a2b-49e0d82fbcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:39.364058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d124094-9a48-452c-8a2b-49e0d82fbcc0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:39.364336 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d124094-9a48-452c-8a2b-49e0d82fbcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:39.364606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d124094-9a48-452c-8a2b-49e0d82fbcc0 None admin] PATH_INFO: `/v3/users/5d269ce658414d469f0da1f990d74895` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:39.365826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d124094-9a48-452c-8a2b-49e0d82fbcc0 None admin] RBAC: Authorizing `identity:get_user(user_id=5d269ce658414d469f0da1f990d74895)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:39.367342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d124094-9a48-452c-8a2b-49e0d82fbcc0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:39.368981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 19/36] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:39 2022] GET /identity/v3/users/5d269ce658414d469f0da1f990d74895 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:39.370023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d124094-9a48-452c-8a2b-49e0d82fbcc0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:39.372020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec077f0-1b4a-4078-8b31-703f41ddd375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:39.372702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec077f0-1b4a-4078-8b31-703f41ddd375 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:39.373031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec077f0-1b4a-4078-8b31-703f41ddd375 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:39.373299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec077f0-1b4a-4078-8b31-703f41ddd375 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:39.374240 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec077f0-1b4a-4078-8b31-703f41ddd375 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:39.375543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec077f0-1b4a-4078-8b31-703f41ddd375 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:39.394740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Aug 26 18:09:39 2022] POST /identity/v3/roles => generated 225 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:09:39.396134 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c44f9-58fd-4ea2-88a4-6e499e8e531f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:39.396429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c44f9-58fd-4ea2-88a4-6e499e8e531f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:39.397387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c44f9-58fd-4ea2-88a4-6e499e8e531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:39.420946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-543c44f9-58fd-4ea2-88a4-6e499e8e531f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:39.422973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-543c44f9-58fd-4ea2-88a4-6e499e8e531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:39.498721 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d124094-9a48-452c-8a2b-49e0d82fbcc0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:39.527728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 19/38] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:39.527728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917daeee-af1c-4ad4-b491-a3f26e2711c2 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:39.527728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917daeee-af1c-4ad4-b491-a3f26e2711c2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:39.527728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917daeee-af1c-4ad4-b491-a3f26e2711c2 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:39.527728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 20/39] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:39.527728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917daeee-af1c-4ad4-b491-a3f26e2711c2 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:39.529954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:39.542434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:39.544798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08938704-0463-4962-b2cd-755383a609f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:39.545466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08938704-0463-4962-b2cd-755383a609f8 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:39.545754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08938704-0463-4962-b2cd-755383a609f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:39.546029 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08938704-0463-4962-b2cd-755383a609f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:39.546794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08938704-0463-4962-b2cd-755383a609f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:39.548687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08938704-0463-4962-b2cd-755383a609f8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:39.659564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917daeee-af1c-4ad4-b491-a3f26e2711c2 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:39.696846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f5703-d587-437d-b5b2-1c1e859f378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:39.697526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5703-d587-437d-b5b2-1c1e859f378d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:39.697817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5703-d587-437d-b5b2-1c1e859f378d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:39.698181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5703-d587-437d-b5b2-1c1e859f378d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:39.699632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f5703-d587-437d-b5b2-1c1e859f378d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:39.701169 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f5703-d587-437d-b5b2-1c1e859f378d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:39.707807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 21/40] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:09:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:39.707807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90e0cf-8c92-4e19-b5dc-a73bfc3adb6d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:39.707807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90e0cf-8c92-4e19-b5dc-a73bfc3adb6d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:39.707807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90e0cf-8c92-4e19-b5dc-a73bfc3adb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:39.725085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9f90e0cf-8c92-4e19-b5dc-a73bfc3adb6d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:39.726307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9f90e0cf-8c92-4e19-b5dc-a73bfc3adb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:39.798865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 22/41] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:39.803175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90e0cf-8c92-4e19-b5dc-a73bfc3adb6d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:39.808734 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 20/42] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:09:39 2022] POST /identity/v3/projects => generated 301 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:09:39.809729 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08938704-0463-4962-b2cd-755383a609f8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:39.813841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:39.927056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08938704-0463-4962-b2cd-755383a609f8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:39.946300 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90e0cf-8c92-4e19-b5dc-a73bfc3adb6d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:39.967252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7dcad-e183-44cf-be62-e6d15bfeafa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:39.967890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7dcad-e183-44cf-be62-e6d15bfeafa9 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:39.968169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7dcad-e183-44cf-be62-e6d15bfeafa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:39.968444 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7dcad-e183-44cf-be62-e6d15bfeafa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:39.969164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7dcad-e183-44cf-be62-e6d15bfeafa9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:39.970708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7dcad-e183-44cf-be62-e6d15bfeafa9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:39.988418 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3a370-5e68-4f50-8c44-310616dc90f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:39.989390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3a370-5e68-4f50-8c44-310616dc90f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:39.989492 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 21/43] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Aug 26 18:09:39 2022] POST /identity/v3/roles => generated 223 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:09:39.989565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3a370-5e68-4f50-8c44-310616dc90f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:39.989739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3a370-5e68-4f50-8c44-310616dc90f5 None admin] PATH_INFO: `/v3/domains/default/users/5d269ce658414d469f0da1f990d74895/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:39.992046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3a370-5e68-4f50-8c44-310616dc90f5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5d269ce658414d469f0da1f990d74895, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:39.995223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3a370-5e68-4f50-8c44-310616dc90f5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:40.020988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 23/44] 10.222.0.45 () {58 vars in 1361 bytes} [Fri Aug 26 18:09:39 2022] PUT /identity/v3/domains/default/users/5d269ce658414d469f0da1f990d74895/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:09:40.085549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7dcad-e183-44cf-be62-e6d15bfeafa9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:40.129719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:40.207637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7dcad-e183-44cf-be62-e6d15bfeafa9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:40.246457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ccb687-12fc-4fda-a95a-2a1fed617b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:40.247111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccb687-12fc-4fda-a95a-2a1fed617b28 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:40.247393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccb687-12fc-4fda-a95a-2a1fed617b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:40.247666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccb687-12fc-4fda-a95a-2a1fed617b28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:40.248922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ccb687-12fc-4fda-a95a-2a1fed617b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:40.250397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ccb687-12fc-4fda-a95a-2a1fed617b28 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:40.251953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 22/45] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:09:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:40.257809 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3a370-5e68-4f50-8c44-310616dc90f5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:40.327718 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:40.366381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3a370-5e68-4f50-8c44-310616dc90f5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:40.401876 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6e38c-a7b0-4ef7-924b-c429ac114be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:40.402499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6e38c-a7b0-4ef7-924b-c429ac114be1 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:40.402784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6e38c-a7b0-4ef7-924b-c429ac114be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:40.403065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6e38c-a7b0-4ef7-924b-c429ac114be1 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:40.403730 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6e38c-a7b0-4ef7-924b-c429ac114be1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:40.405245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6e38c-a7b0-4ef7-924b-c429ac114be1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:40.444751 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:09:40 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:09:41.934589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2a863-1535-4c7c-b793-03d8c19b9ac1 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:41.935125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2a863-1535-4c7c-b793-03d8c19b9ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:41.935125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2a863-1535-4c7c-b793-03d8c19b9ac1 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:41.936496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 23/47] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:41.942264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9239fd-f793-4b30-b0fb-40b91847b60b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:41.942700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9239fd-f793-4b30-b0fb-40b91847b60b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:41.942778 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9239fd-f793-4b30-b0fb-40b91847b60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:41.963096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ef9239fd-f793-4b30-b0fb-40b91847b60b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:41.964349 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ef9239fd-f793-4b30-b0fb-40b91847b60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:42.142006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 25/48] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:42.336932 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578ec55-ae38-4d93-b3ac-46c49d4f0783 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:42.337140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578ec55-ae38-4d93-b3ac-46c49d4f0783 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:42.337420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578ec55-ae38-4d93-b3ac-46c49d4f0783 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:42.338884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 24/49] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:42.344218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a5fc8-2a6e-4374-96f1-f46ccfcce5cd None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:42.344503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a5fc8-2a6e-4374-96f1-f46ccfcce5cd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:42.344807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a5fc8-2a6e-4374-96f1-f46ccfcce5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:42.364280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-574a5fc8-2a6e-4374-96f1-f46ccfcce5cd None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:42.365502 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-574a5fc8-2a6e-4374-96f1-f46ccfcce5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:42.407628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578ec55-ae38-4d93-b3ac-46c49d4f0783 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:42.409268 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:42.433253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 26/50] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:42.517735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578ec55-ae38-4d93-b3ac-46c49d4f0783 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:42.521098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:42.556016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d954f2d-af14-4b69-b8e8-161d8f011b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:42.556653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d954f2d-af14-4b69-b8e8-161d8f011b69 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:42.556971 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d954f2d-af14-4b69-b8e8-161d8f011b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:42.557219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d954f2d-af14-4b69-b8e8-161d8f011b69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:42.567275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d954f2d-af14-4b69-b8e8-161d8f011b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-7d954f2d-af14-4b69-b8e8-161d8f011b69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:42.572067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:42.573138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:09:42.574085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 25/51] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:09:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:09:42.581076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a5fc8-2a6e-4374-96f1-f46ccfcce5cd None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:42.684335 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a5fc8-2a6e-4374-96f1-f46ccfcce5cd None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:42.696151 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d954f2d-af14-4b69-b8e8-161d8f011b69 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:42.720634 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23c99-48cd-4dc3-b4b6-3aaffeb7fc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:42.721304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23c99-48cd-4dc3-b4b6-3aaffeb7fc6a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:42.721887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23c99-48cd-4dc3-b4b6-3aaffeb7fc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:42.722165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23c99-48cd-4dc3-b4b6-3aaffeb7fc6a None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:42.722851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d23c99-48cd-4dc3-b4b6-3aaffeb7fc6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:42.723431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d23c99-48cd-4dc3-b4b6-3aaffeb7fc6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:42.724555 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d23c99-48cd-4dc3-b4b6-3aaffeb7fc6a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:42.736936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 27/52] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:09:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:09:42.742766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23c99-48cd-4dc3-b4b6-3aaffeb7fc6a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:42.783907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:42.801078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d954f2d-af14-4b69-b8e8-161d8f011b69 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:42.835306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff8601-abc3-4f77-bd53-6acc7bf46774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:42.835969 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff8601-abc3-4f77-bd53-6acc7bf46774 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:42.836247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff8601-abc3-4f77-bd53-6acc7bf46774 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:42.836528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff8601-abc3-4f77-bd53-6acc7bf46774 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:42.837695 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff8601-abc3-4f77-bd53-6acc7bf46774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:42.839242 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff8601-abc3-4f77-bd53-6acc7bf46774 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:42.841021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:09:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:42.844619 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23c99-48cd-4dc3-b4b6-3aaffeb7fc6a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:42.847197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff8601-abc3-4f77-bd53-6acc7bf46774 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:42.877947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:42.879279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc2b5a-3cf6-4c7e-a6d6-b0c835d74595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:42.879927 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc2b5a-3cf6-4c7e-a6d6-b0c835d74595 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:42.880256 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc2b5a-3cf6-4c7e-a6d6-b0c835d74595 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:42.880486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc2b5a-3cf6-4c7e-a6d6-b0c835d74595 None admin] PATH_INFO: `/v3/users/5d269ce658414d469f0da1f990d74895` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:42.881689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc2b5a-3cf6-4c7e-a6d6-b0c835d74595 None admin] RBAC: Authorizing `identity:get_user(user_id=5d269ce658414d469f0da1f990d74895)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:42.883209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc2b5a-3cf6-4c7e-a6d6-b0c835d74595 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:42.884818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 28/54] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:42 2022] GET /identity/v3/users/5d269ce658414d469f0da1f990d74895 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:42.890360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc2b5a-3cf6-4c7e-a6d6-b0c835d74595 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:42.948527 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff8601-abc3-4f77-bd53-6acc7bf46774 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:42.981982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518e34f-fd78-47c6-8650-e4b2e94533d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:42.982611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518e34f-fd78-47c6-8650-e4b2e94533d7 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:42.982899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518e34f-fd78-47c6-8650-e4b2e94533d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:42.983178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518e34f-fd78-47c6-8650-e4b2e94533d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:42.983840 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518e34f-fd78-47c6-8650-e4b2e94533d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:42.985408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518e34f-fd78-47c6-8650-e4b2e94533d7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:42.990927 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc2b5a-3cf6-4c7e-a6d6-b0c835d74595 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:43.000086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:43.016238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 27/55] 10.222.0.45 () {60 vars in 1140 bytes} [Fri Aug 26 18:09:42 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:09:43.030323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db4594-8f5b-4aa0-bcb7-025ba0370e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:43.031001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db4594-8f5b-4aa0-bcb7-025ba0370e57 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:43.031280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db4594-8f5b-4aa0-bcb7-025ba0370e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:43.031552 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db4594-8f5b-4aa0-bcb7-025ba0370e57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:43.032903 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db4594-8f5b-4aa0-bcb7-025ba0370e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:43.034417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db4594-8f5b-4aa0-bcb7-025ba0370e57 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:43.036100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 29/56] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:09:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:43.042536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518e34f-fd78-47c6-8650-e4b2e94533d7 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:43.135642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:43.152490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518e34f-fd78-47c6-8650-e4b2e94533d7 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:43.187187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5e9d1-3713-4377-b7b7-dccb93b059dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:43.187813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e9d1-3713-4377-b7b7-dccb93b059dd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:43.188104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e9d1-3713-4377-b7b7-dccb93b059dd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:43.188379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e9d1-3713-4377-b7b7-dccb93b059dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:43.189154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5e9d1-3713-4377-b7b7-dccb93b059dd None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.domain.id=default, user.id=5d269ce658414d469f0da1f990d74895) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:43.189464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5e9d1-3713-4377-b7b7-dccb93b059dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:43.190944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5e9d1-3713-4377-b7b7-dccb93b059dd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:43.197523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1322 bytes} [Fri Aug 26 18:09:43 2022] GET /identity/v3/role_assignments?user.id=5d269ce658414d469f0da1f990d74895&scope.domain.id=default&role.id=db572ad3d504403cbb227c2155c93eda => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:44.921830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da04040-6ae5-4a08-900d-bfa6b84b233b None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:44.922352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da04040-6ae5-4a08-900d-bfa6b84b233b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:44.922352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da04040-6ae5-4a08-900d-bfa6b84b233b None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:44.923735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 30/58] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:44.929035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0fcc1-f640-4436-a894-388413f57a67 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:44.929460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0fcc1-f640-4436-a894-388413f57a67 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:44.929589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0fcc1-f640-4436-a894-388413f57a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:44.948980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-85d0fcc1-f640-4436-a894-388413f57a67 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:44.950535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-85d0fcc1-f640-4436-a894-388413f57a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:45.020823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 29/59] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:45.287672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da04040-6ae5-4a08-900d-bfa6b84b233b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:45.394235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da04040-6ae5-4a08-900d-bfa6b84b233b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:45.430018 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b97a4-fef2-4c8a-b1d0-8e2bcc5099cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:45.430652 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b97a4-fef2-4c8a-b1d0-8e2bcc5099cd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:45.430935 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b97a4-fef2-4c8a-b1d0-8e2bcc5099cd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:45.431210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b97a4-fef2-4c8a-b1d0-8e2bcc5099cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:45.432390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b97a4-fef2-4c8a-b1d0-8e2bcc5099cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:45.433927 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b97a4-fef2-4c8a-b1d0-8e2bcc5099cd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:45.435517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 31/60] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:09:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:45.441359 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0fcc1-f640-4436-a894-388413f57a67 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:45.524917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:45.546716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0fcc1-f640-4436-a894-388413f57a67 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:45.584523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299dca4-97ee-4cd3-a50a-16f38d7a2162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:45.585170 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299dca4-97ee-4cd3-a50a-16f38d7a2162 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:45.585508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299dca4-97ee-4cd3-a50a-16f38d7a2162 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:45.585773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299dca4-97ee-4cd3-a50a-16f38d7a2162 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:45.586512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299dca4-97ee-4cd3-a50a-16f38d7a2162 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:45.588187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299dca4-97ee-4cd3-a50a-16f38d7a2162 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:45.616078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 30/61] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:09:45 2022] POST /identity/v3/users => generated 275 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:09:48.400920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55327217-fab0-485c-ba05-dc8650eef637 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:48.401991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55327217-fab0-485c-ba05-dc8650eef637 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:48.402472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55327217-fab0-485c-ba05-dc8650eef637 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:48.404036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 32/62] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:48.409798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be2ebd-535e-4ff3-9a80-163c82f24058 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:48.410708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be2ebd-535e-4ff3-9a80-163c82f24058 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:48.411181 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be2ebd-535e-4ff3-9a80-163c82f24058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:48.437794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b8be2ebd-535e-4ff3-9a80-163c82f24058 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:48.439403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b8be2ebd-535e-4ff3-9a80-163c82f24058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:48.536992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 31/63] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:48.656343 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5f9f7-94e3-4ff3-b112-4f634d78c981 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:48.656542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5f9f7-94e3-4ff3-b112-4f634d78c981 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:48.657152 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5f9f7-94e3-4ff3-b112-4f634d78c981 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:48.659033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 33/64] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:48.664133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ff589-7e65-4612-98b4-ccb9a46281d6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:48.664428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ff589-7e65-4612-98b4-ccb9a46281d6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:48.664709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ff589-7e65-4612-98b4-ccb9a46281d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:48.683392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-006ff589-7e65-4612-98b4-ccb9a46281d6 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:48.684610 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-006ff589-7e65-4612-98b4-ccb9a46281d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:48.753110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:48.755267 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 32/65] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:48.864708 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5f9f7-94e3-4ff3-b112-4f634d78c981 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:48.928850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:49.006547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5f9f7-94e3-4ff3-b112-4f634d78c981 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:49.050942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11986d32-f919-4bfe-84b2-fb5cd322f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:49.052455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11986d32-f919-4bfe-84b2-fb5cd322f263 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.052764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11986d32-f919-4bfe-84b2-fb5cd322f263 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.053045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11986d32-f919-4bfe-84b2-fb5cd322f263 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.057861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ff589-7e65-4612-98b4-ccb9a46281d6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:49.081545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11986d32-f919-4bfe-84b2-fb5cd322f263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-11986d32-f919-4bfe-84b2-fb5cd322f263 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:49.087967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:49.089078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:49.089825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:49.089825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:49.089825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:49.089825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:49.089825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:49.089825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:49.089825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:49.089825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:49.089825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:49.089825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:49.089825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:09:49.089825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:09:49.092953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 34/66] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:09:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:09:49.104271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11986d32-f919-4bfe-84b2-fb5cd322f263 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:49.191282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ff589-7e65-4612-98b4-ccb9a46281d6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:49.227195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1e8ba-a1d7-4263-8022-22d25571518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:49.227848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1e8ba-a1d7-4263-8022-22d25571518c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.228130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1e8ba-a1d7-4263-8022-22d25571518c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.228406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1e8ba-a1d7-4263-8022-22d25571518c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.232112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11986d32-f919-4bfe-84b2-fb5cd322f263 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:49.234572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:49.245719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1e8ba-a1d7-4263-8022-22d25571518c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-b6a1e8ba-a1d7-4263-8022-22d25571518c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:49.250553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:49.251401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:09:49.252167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 33/67] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:09:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:09:49.258380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9d8a7-30e9-48ce-a4b2-b98cb6c3fb07 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.258668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9d8a7-30e9-48ce-a4b2-b98cb6c3fb07 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.258962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9d8a7-30e9-48ce-a4b2-b98cb6c3fb07 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.260509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 34/68] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:49.261395 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49e2ca-a2b8-40c4-ae65-a66a8232d3f1 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.261697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49e2ca-a2b8-40c4-ae65-a66a8232d3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.261942 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49e2ca-a2b8-40c4-ae65-a66a8232d3f1 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.267513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 35/69] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:49.267513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49e2ca-a2b8-40c4-ae65-a66a8232d3f1 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:49.278728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d965f39-1524-40cb-b750-2d7f6b50c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:49.279370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965f39-1524-40cb-b750-2d7f6b50c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.279769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965f39-1524-40cb-b750-2d7f6b50c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.280048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965f39-1524-40cb-b750-2d7f6b50c8d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.280841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d965f39-1524-40cb-b750-2d7f6b50c8d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:49.281157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d965f39-1524-40cb-b750-2d7f6b50c8d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:49.282584 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d965f39-1524-40cb-b750-2d7f6b50c8d1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:49.291198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 35/70] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:09:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:49.292682 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf5836-233f-4d8e-9fde-0e2cd583c13d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.293026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf5836-233f-4d8e-9fde-0e2cd583c13d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.293305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf5836-233f-4d8e-9fde-0e2cd583c13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.314339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d5cf5836-233f-4d8e-9fde-0e2cd583c13d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:49.315572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d5cf5836-233f-4d8e-9fde-0e2cd583c13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:49.334745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:49.390872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49e2ca-a2b8-40c4-ae65-a66a8232d3f1 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:49.404748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 36/71] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:49.404748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f229c1-6174-49b5-b8e4-3503b2f7cd01 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.404748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f229c1-6174-49b5-b8e4-3503b2f7cd01 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.404748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f229c1-6174-49b5-b8e4-3503b2f7cd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.424677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-98f229c1-6174-49b5-b8e4-3503b2f7cd01 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:49.426176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-98f229c1-6174-49b5-b8e4-3503b2f7cd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:49.434878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774eae5-e7dd-4f07-b06d-cd43f795a22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:49.435588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774eae5-e7dd-4f07-b06d-cd43f795a22d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.435878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774eae5-e7dd-4f07-b06d-cd43f795a22d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.436157 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774eae5-e7dd-4f07-b06d-cd43f795a22d None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.436890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774eae5-e7dd-4f07-b06d-cd43f795a22d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:49.437312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774eae5-e7dd-4f07-b06d-cd43f795a22d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:49.438776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774eae5-e7dd-4f07-b06d-cd43f795a22d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:49.449013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 36/72] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:09:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:49.449882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774eae5-e7dd-4f07-b06d-cd43f795a22d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:49.510848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 37/73] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:49.511835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f229c1-6174-49b5-b8e4-3503b2f7cd01 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:49.546969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:49.610924 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774eae5-e7dd-4f07-b06d-cd43f795a22d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:49.627893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f229c1-6174-49b5-b8e4-3503b2f7cd01 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:49.628592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:49.647516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ab91a-7c6b-4239-83dd-f93cfc428c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:49.648371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ab91a-7c6b-4239-83dd-f93cfc428c38 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.648812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ab91a-7c6b-4239-83dd-f93cfc428c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.649244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ab91a-7c6b-4239-83dd-f93cfc428c38 None admin] PATH_INFO: `/v3/users/d399c8932dea4a31a881e6ab6d908c9f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.663678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ab91a-7c6b-4239-83dd-f93cfc428c38 None admin] RBAC: Authorizing `identity:get_user(user_id=d399c8932dea4a31a881e6ab6d908c9f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:49.665414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ab91a-7c6b-4239-83dd-f93cfc428c38 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:49.667447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e84491-3d11-4f5f-a851-2ea7e34b4c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:49.668070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 37/74] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:49 2022] GET /identity/v3/users/d399c8932dea4a31a881e6ab6d908c9f => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:49.668213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e84491-3d11-4f5f-a851-2ea7e34b4c8e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.668381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e84491-3d11-4f5f-a851-2ea7e34b4c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.668662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e84491-3d11-4f5f-a851-2ea7e34b4c8e None admin] PATH_INFO: `/v3/users/5d269ce658414d469f0da1f990d74895` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.669907 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972a384-109b-45d4-863e-d4f1e3c69740 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.670324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972a384-109b-45d4-863e-d4f1e3c69740 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.670749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972a384-109b-45d4-863e-d4f1e3c69740 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.672169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 38/75] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:49.678688 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e84491-3d11-4f5f-a851-2ea7e34b4c8e None admin] RBAC: Authorizing `identity:get_user(user_id=5d269ce658414d469f0da1f990d74895)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:49.678688 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e84491-3d11-4f5f-a851-2ea7e34b4c8e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:49.678874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972a384-109b-45d4-863e-d4f1e3c69740 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:49.678962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 38/76] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:49 2022] GET /identity/v3/users/5d269ce658414d469f0da1f990d74895 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:49.678962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52182c69-93df-4dd7-a640-e466304cebe3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.679209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52182c69-93df-4dd7-a640-e466304cebe3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.680285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52182c69-93df-4dd7-a640-e466304cebe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.706322 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-52182c69-93df-4dd7-a640-e466304cebe3 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:49.707775 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-52182c69-93df-4dd7-a640-e466304cebe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:49.783235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 39/77] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:49.784104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52182c69-93df-4dd7-a640-e466304cebe3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:49.803127 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972a384-109b-45d4-863e-d4f1e3c69740 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:49.819906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:49.842593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4fbf-1c51-4807-baf8-2d57e0d97370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:49.843390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4fbf-1c51-4807-baf8-2d57e0d97370 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.843620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4fbf-1c51-4807-baf8-2d57e0d97370 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.843895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4fbf-1c51-4807-baf8-2d57e0d97370 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:49.891073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:49.900519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52182c69-93df-4dd7-a640-e466304cebe3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:49.918875 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e4fbf-1c51-4807-baf8-2d57e0d97370 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:49.920362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e4fbf-1c51-4807-baf8-2d57e0d97370 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:49.937859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6cd93-9787-4fdd-a860-2014a326c7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:49.938491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6cd93-9787-4fdd-a860-2014a326c7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:49.938770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6cd93-9787-4fdd-a860-2014a326c7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:49.939050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6cd93-9787-4fdd-a860-2014a326c7a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:50.008370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6cd93-9787-4fdd-a860-2014a326c7a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:50.009885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6cd93-9787-4fdd-a860-2014a326c7a2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:50.023873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 39/78] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:09:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:09:50.028957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4fbf-1c51-4807-baf8-2d57e0d97370 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:50.039997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:50.102933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:50.117374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 40/79] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:09:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:09:50.118237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6cd93-9787-4fdd-a860-2014a326c7a2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:50.134230 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4fbf-1c51-4807-baf8-2d57e0d97370 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:50.168607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d843e-1ff6-40bb-bf26-2792e5b45335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:50.169682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d843e-1ff6-40bb-bf26-2792e5b45335 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:50.169983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d843e-1ff6-40bb-bf26-2792e5b45335 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:50.170264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d843e-1ff6-40bb-bf26-2792e5b45335 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:50.180389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d843e-1ff6-40bb-bf26-2792e5b45335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-035d843e-1ff6-40bb-bf26-2792e5b45335 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:50.185682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:50.186674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:09:50.187422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 40/80] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:09:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:09:50.188046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d843e-1ff6-40bb-bf26-2792e5b45335 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:50.220317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6cd93-9787-4fdd-a860-2014a326c7a2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:50.246831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:50.257850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b40cf-732e-46cc-a034-fd3c20d10da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:50.258545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b40cf-732e-46cc-a034-fd3c20d10da7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:50.258775 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b40cf-732e-46cc-a034-fd3c20d10da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:50.259048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b40cf-732e-46cc-a034-fd3c20d10da7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:50.269159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b40cf-732e-46cc-a034-fd3c20d10da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-de6b40cf-732e-46cc-a034-fd3c20d10da7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:50.273958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:50.274825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:09:50.275600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 41/81] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:09:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:09:50.276374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b40cf-732e-46cc-a034-fd3c20d10da7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:50.292007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d843e-1ff6-40bb-bf26-2792e5b45335 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:50.327315 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa721f0a-f4df-48c6-ae48-82d5c61c49e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:50.328150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721f0a-f4df-48c6-ae48-82d5c61c49e9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:50.328552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721f0a-f4df-48c6-ae48-82d5c61c49e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:50.328993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721f0a-f4df-48c6-ae48-82d5c61c49e9 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:50.330278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa721f0a-f4df-48c6-ae48-82d5c61c49e9 None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:50.331915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa721f0a-f4df-48c6-ae48-82d5c61c49e9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:50.333753 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 41/82] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:09:50 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:50.335088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa721f0a-f4df-48c6-ae48-82d5c61c49e9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:50.339156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:50.398511 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b40cf-732e-46cc-a034-fd3c20d10da7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:50.448238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720dc18-3e80-40e3-baf3-8d79e80e76e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:50.448924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720dc18-3e80-40e3-baf3-8d79e80e76e0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:50.449213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720dc18-3e80-40e3-baf3-8d79e80e76e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:50.449480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720dc18-3e80-40e3-baf3-8d79e80e76e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:50.450777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720dc18-3e80-40e3-baf3-8d79e80e76e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:50.452304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720dc18-3e80-40e3-baf3-8d79e80e76e0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:50.453915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 42/83] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:09:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:50.454786 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720dc18-3e80-40e3-baf3-8d79e80e76e0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:50.474449 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa721f0a-f4df-48c6-ae48-82d5c61c49e9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:50.509420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:50.512241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227fa8a-0de5-499f-a3df-1a6f63e5dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:50.512920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227fa8a-0de5-499f-a3df-1a6f63e5dc01 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:50.513200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227fa8a-0de5-499f-a3df-1a6f63e5dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:50.513471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227fa8a-0de5-499f-a3df-1a6f63e5dc01 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:50.514643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227fa8a-0de5-499f-a3df-1a6f63e5dc01 None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:50.516114 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227fa8a-0de5-499f-a3df-1a6f63e5dc01 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:50.517801 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 42/84] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:09:50 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:50.518572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227fa8a-0de5-499f-a3df-1a6f63e5dc01 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:50.564919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720dc18-3e80-40e3-baf3-8d79e80e76e0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:50.586803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:50.603400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64c14-6321-4276-a2a3-eef9b9aece22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:50.604024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64c14-6321-4276-a2a3-eef9b9aece22 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:50.604308 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64c14-6321-4276-a2a3-eef9b9aece22 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:50.604613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64c14-6321-4276-a2a3-eef9b9aece22 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:50.605338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e64c14-6321-4276-a2a3-eef9b9aece22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:50.605642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e64c14-6321-4276-a2a3-eef9b9aece22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:50.607039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e64c14-6321-4276-a2a3-eef9b9aece22 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:50.615082 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 43/85] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:09:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:50.615934 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64c14-6321-4276-a2a3-eef9b9aece22 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:50.618098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227fa8a-0de5-499f-a3df-1a6f63e5dc01 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:50.654203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1635d-5a6f-4a55-91c3-3431d7583f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:50.654829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1635d-5a6f-4a55-91c3-3431d7583f65 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:50.655109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1635d-5a6f-4a55-91c3-3431d7583f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:50.655379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1635d-5a6f-4a55-91c3-3431d7583f65 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:50.656043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1635d-5a6f-4a55-91c3-3431d7583f65 None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:50.656349 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1635d-5a6f-4a55-91c3-3431d7583f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:50.657770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1635d-5a6f-4a55-91c3-3431d7583f65 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:50.666022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 43/86] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:09:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:50.666728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1635d-5a6f-4a55-91c3-3431d7583f65 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:50.722271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64c14-6321-4276-a2a3-eef9b9aece22 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:50.736805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:50.758131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e36c0-a1e6-4145-abda-e7ea12ec9507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:50.758742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e36c0-a1e6-4145-abda-e7ea12ec9507 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:50.759021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e36c0-a1e6-4145-abda-e7ea12ec9507 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:50.759292 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e36c0-a1e6-4145-abda-e7ea12ec9507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:50.760070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e36c0-a1e6-4145-abda-e7ea12ec9507 None admin] RBAC: Adding query filter params (role.id=b7d5979aed50487cbf98896a6fa6f162, scope.project.id=0565423b088f492581b9dc3e0ad10362, user.id=d399c8932dea4a31a881e6ab6d908c9f) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:50.760686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e36c0-a1e6-4145-abda-e7ea12ec9507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:50.762090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e36c0-a1e6-4145-abda-e7ea12ec9507 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:50.769153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1635d-5a6f-4a55-91c3-3431d7583f65 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:50.769885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 44/87] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:09:50 2022] GET /identity/v3/role_assignments?user.id=d399c8932dea4a31a881e6ab6d908c9f&scope.project.id=0565423b088f492581b9dc3e0ad10362&role.id=b7d5979aed50487cbf98896a6fa6f162 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:50.770495 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e36c0-a1e6-4145-abda-e7ea12ec9507 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:50.815856 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:50.821829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90e019-b7d2-4617-a606-07bb9d762e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:50.823091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90e019-b7d2-4617-a606-07bb9d762e5e None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:50.823091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90e019-b7d2-4617-a606-07bb9d762e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:50.823279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90e019-b7d2-4617-a606-07bb9d762e5e None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:50.823896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90e019-b7d2-4617-a606-07bb9d762e5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:50.826003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90e019-b7d2-4617-a606-07bb9d762e5e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:50.864749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 44/88] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:09:50 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:09:50.864749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90e019-b7d2-4617-a606-07bb9d762e5e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:50.915559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e36c0-a1e6-4145-abda-e7ea12ec9507 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:50.960954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f2da8-3688-4078-82e2-6f30e5ffc102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:50.962013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f2da8-3688-4078-82e2-6f30e5ffc102 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:50.962455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f2da8-3688-4078-82e2-6f30e5ffc102 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:50.962848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f2da8-3688-4078-82e2-6f30e5ffc102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:50.963611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f2da8-3688-4078-82e2-6f30e5ffc102 None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=0565423b088f492581b9dc3e0ad10362, user.id=5d269ce658414d469f0da1f990d74895) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:50.963955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f2da8-3688-4078-82e2-6f30e5ffc102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:50.966368 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f2da8-3688-4078-82e2-6f30e5ffc102 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:50.974512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 45/89] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:09:50 2022] GET /identity/v3/role_assignments?user.id=5d269ce658414d469f0da1f990d74895&scope.project.id=0565423b088f492581b9dc3e0ad10362&role.id=db572ad3d504403cbb227c2155c93eda => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:50.975355 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f2da8-3688-4078-82e2-6f30e5ffc102 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:51.005709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90e019-b7d2-4617-a606-07bb9d762e5e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:51.031944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:51.079121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38f15b-28ba-4372-b411-a8bee12d2261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:51.080342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38f15b-28ba-4372-b411-a8bee12d2261 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:51.080890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38f15b-28ba-4372-b411-a8bee12d2261 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:51.081358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38f15b-28ba-4372-b411-a8bee12d2261 None admin] PATH_INFO: `/v3/users/d399c8932dea4a31a881e6ab6d908c9f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:51.082864 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38f15b-28ba-4372-b411-a8bee12d2261 None admin] RBAC: Authorizing `identity:get_user(user_id=d399c8932dea4a31a881e6ab6d908c9f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:51.084873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38f15b-28ba-4372-b411-a8bee12d2261 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:51.087321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 45/90] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:50 2022] GET /identity/v3/users/d399c8932dea4a31a881e6ab6d908c9f => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:51.093199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38f15b-28ba-4372-b411-a8bee12d2261 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:51.113429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f2da8-3688-4078-82e2-6f30e5ffc102 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:51.152291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fd5fb-d17c-4b2c-94da-94b2e5060d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:51.153090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fd5fb-d17c-4b2c-94da-94b2e5060d62 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:51.153379 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fd5fb-d17c-4b2c-94da-94b2e5060d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:51.153660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fd5fb-d17c-4b2c-94da-94b2e5060d62 None admin] PATH_INFO: `/v3/users/d399c8932dea4a31a881e6ab6d908c9f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:51.154957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fd5fb-d17c-4b2c-94da-94b2e5060d62 None admin] RBAC: Authorizing `identity:get_user(user_id=d399c8932dea4a31a881e6ab6d908c9f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:51.156432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fd5fb-d17c-4b2c-94da-94b2e5060d62 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:51.158496 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 46/91] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:50 2022] GET /identity/v3/users/d399c8932dea4a31a881e6ab6d908c9f => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:51.163669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:51.165252 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fd5fb-d17c-4b2c-94da-94b2e5060d62 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:51.227212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38f15b-28ba-4372-b411-a8bee12d2261 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:51.274314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcfc0d-e642-48a2-9267-cfe38a8de2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:51.275583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcfc0d-e642-48a2-9267-cfe38a8de2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:51.276246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcfc0d-e642-48a2-9267-cfe38a8de2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:51.276738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcfc0d-e642-48a2-9267-cfe38a8de2b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:51.286368 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fd5fb-d17c-4b2c-94da-94b2e5060d62 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:51.299010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:51.327950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f70e41-2d9d-4d16-9667-7f73ddace6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:51.328829 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f70e41-2d9d-4d16-9667-7f73ddace6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:51.330196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f70e41-2d9d-4d16-9667-7f73ddace6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:51.330855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f70e41-2d9d-4d16-9667-7f73ddace6e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:51.369448 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcfc0d-e642-48a2-9267-cfe38a8de2b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:51.371364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcfc0d-e642-48a2-9267-cfe38a8de2b2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:51.423546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f70e41-2d9d-4d16-9667-7f73ddace6e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:51.425853 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f70e41-2d9d-4d16-9667-7f73ddace6e4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:51.439927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:51.490153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 46/92] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:09:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:09:51.495994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcfc0d-e642-48a2-9267-cfe38a8de2b2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:51.539545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 47/93] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:09:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:09:51.545657 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f70e41-2d9d-4d16-9667-7f73ddace6e4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:51.557927 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:51.608994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcfc0d-e642-48a2-9267-cfe38a8de2b2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:51.644745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba309e9-167d-4abd-843f-02926126ea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:51.645428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba309e9-167d-4abd-843f-02926126ea89 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:51.645712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba309e9-167d-4abd-843f-02926126ea89 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:51.645989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba309e9-167d-4abd-843f-02926126ea89 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:51.647207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba309e9-167d-4abd-843f-02926126ea89 None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:51.649056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba309e9-167d-4abd-843f-02926126ea89 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:51.650587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 47/94] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:09:51 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:09:51.656861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba309e9-167d-4abd-843f-02926126ea89 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:51.663595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f70e41-2d9d-4d16-9667-7f73ddace6e4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:51.692744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:51.737478 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de719e-b25f-4db3-a6e5-1457191a4a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:51.738548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de719e-b25f-4db3-a6e5-1457191a4a35 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:51.739040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de719e-b25f-4db3-a6e5-1457191a4a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:51.739512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de719e-b25f-4db3-a6e5-1457191a4a35 None admin] PATH_INFO: `/v3/projects/e901e6cdae814ddc83f31c92808732d8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:51.745602 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de719e-b25f-4db3-a6e5-1457191a4a35 None admin] RBAC: Authorizing `identity:get_project(project_id=e901e6cdae814ddc83f31c92808732d8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:51.747356 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de719e-b25f-4db3-a6e5-1457191a4a35 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:51.749331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 48/95] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:09:51 2022] GET /identity/v3/projects/e901e6cdae814ddc83f31c92808732d8 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:51.755258 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de719e-b25f-4db3-a6e5-1457191a4a35 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:51.765242 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba309e9-167d-4abd-843f-02926126ea89 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:51.809918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042d218-fe9c-430d-99b0-d8e620c9946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:51.810469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042d218-fe9c-430d-99b0-d8e620c9946a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:51.810773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042d218-fe9c-430d-99b0-d8e620c9946a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:51.811032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042d218-fe9c-430d-99b0-d8e620c9946a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:51.811776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042d218-fe9c-430d-99b0-d8e620c9946a None admin] RBAC: Adding query filter params (role.id=db4150b658a14804af1bf240ea2e31f9, scope.project.id=0565423b088f492581b9dc3e0ad10362, user.id=d399c8932dea4a31a881e6ab6d908c9f) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:51.812088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042d218-fe9c-430d-99b0-d8e620c9946a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:51.813992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042d218-fe9c-430d-99b0-d8e620c9946a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:51.820512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 48/96] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:09:51 2022] GET /identity/v3/role_assignments?user.id=d399c8932dea4a31a881e6ab6d908c9f&scope.project.id=0565423b088f492581b9dc3e0ad10362&role.id=db4150b658a14804af1bf240ea2e31f9 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:09:51.936538 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:51.966036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de719e-b25f-4db3-a6e5-1457191a4a35 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:52.018982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acf519-df54-451c-bee5-6fc817ffa149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:52.020070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf519-df54-451c-bee5-6fc817ffa149 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:52.020551 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf519-df54-451c-bee5-6fc817ffa149 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:52.021026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf519-df54-451c-bee5-6fc817ffa149 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:52.021949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf519-df54-451c-bee5-6fc817ffa149 None admin] RBAC: Adding query filter params (role.id=b7d5979aed50487cbf98896a6fa6f162, scope.project.id=e901e6cdae814ddc83f31c92808732d8, user.id=d399c8932dea4a31a881e6ab6d908c9f) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:52.022446 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf519-df54-451c-bee5-6fc817ffa149 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:52.024111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf519-df54-451c-bee5-6fc817ffa149 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:52.033544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 49/97] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:09:51 2022] GET /identity/v3/role_assignments?user.id=d399c8932dea4a31a881e6ab6d908c9f&scope.project.id=e901e6cdae814ddc83f31c92808732d8&role.id=b7d5979aed50487cbf98896a6fa6f162 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:53.196321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea24e0-4e06-48f9-8fc5-55f301c00010 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:53.196851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea24e0-4e06-48f9-8fc5-55f301c00010 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:53.196954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea24e0-4e06-48f9-8fc5-55f301c00010 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:53.198590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 49/98] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:53.203749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871ba13-346b-4182-bf5d-b14d95b14aca None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:53.204589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871ba13-346b-4182-bf5d-b14d95b14aca None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:53.205073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871ba13-346b-4182-bf5d-b14d95b14aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:53.233772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9871ba13-346b-4182-bf5d-b14d95b14aca None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:53.235410 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9871ba13-346b-4182-bf5d-b14d95b14aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:53.320537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 50/99] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:53.735072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44912d5a-8a6f-4b59-b35d-1ed2830562e8 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:53.735474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44912d5a-8a6f-4b59-b35d-1ed2830562e8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:53.735658 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44912d5a-8a6f-4b59-b35d-1ed2830562e8 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:53.737038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 50/100] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:53.742401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dae47e-0e37-4312-9720-4ded9609d7de None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:53.742908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dae47e-0e37-4312-9720-4ded9609d7de None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:53.743376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dae47e-0e37-4312-9720-4ded9609d7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:53.764637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-09dae47e-0e37-4312-9720-4ded9609d7de None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:53.766185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-09dae47e-0e37-4312-9720-4ded9609d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:53.854029 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 51/101] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:53.862301 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44912d5a-8a6f-4b59-b35d-1ed2830562e8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:53.980173 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:53.987647 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da465-8d36-4ce2-ba47-aa3582a364fa None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:53.988242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da465-8d36-4ce2-ba47-aa3582a364fa None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:53.988752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da465-8d36-4ce2-ba47-aa3582a364fa None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:53.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 52/102] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:09:53.995939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc062-906c-4cd1-954e-558e7ce2ec6f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:53.996649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc062-906c-4cd1-954e-558e7ce2ec6f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:53.997192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc062-906c-4cd1-954e-558e7ce2ec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:53.997721 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44912d5a-8a6f-4b59-b35d-1ed2830562e8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:54.009594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:54.031018 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b23dc062-906c-4cd1-954e-558e7ce2ec6f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:54.032221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b23dc062-906c-4cd1-954e-558e7ce2ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:54.055390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b80fac-69f3-4082-a273-d09a992362c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:54.056044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b80fac-69f3-4082-a273-d09a992362c1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:54.056323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b80fac-69f3-4082-a273-d09a992362c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:54.056597 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b80fac-69f3-4082-a273-d09a992362c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:54.078037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b80fac-69f3-4082-a273-d09a992362c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-d2b80fac-69f3-4082-a273-d09a992362c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:54.082814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:54.083653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:09:54.084487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 51/103] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:09:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:09:54.094570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b80fac-69f3-4082-a273-d09a992362c1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:54.211357 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 53/104] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:09:54.250022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc062-906c-4cd1-954e-558e7ce2ec6f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:54.321571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b80fac-69f3-4082-a273-d09a992362c1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:54.389102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a39a4f-93b3-4c63-b2b7-acd949c165c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:54.389968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a39a4f-93b3-4c63-b2b7-acd949c165c6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:54.390391 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a39a4f-93b3-4c63-b2b7-acd949c165c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:54.392223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a39a4f-93b3-4c63-b2b7-acd949c165c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:54.393065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a39a4f-93b3-4c63-b2b7-acd949c165c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:54.393509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a39a4f-93b3-4c63-b2b7-acd949c165c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:54.395066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a39a4f-93b3-4c63-b2b7-acd949c165c6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:54.412236 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 52/105] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:09:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:54.417235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a39a4f-93b3-4c63-b2b7-acd949c165c6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:54.432227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc062-906c-4cd1-954e-558e7ce2ec6f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:54.440681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:54.489161 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:54.497234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53eb09-7c36-44b4-9c69-f537a7e0e322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:54.497898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53eb09-7c36-44b4-9c69-f537a7e0e322 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:54.498185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53eb09-7c36-44b4-9c69-f537a7e0e322 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:54.498461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53eb09-7c36-44b4-9c69-f537a7e0e322 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:54.518137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53eb09-7c36-44b4-9c69-f537a7e0e322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-7b53eb09-7c36-44b4-9c69-f537a7e0e322 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:54.524745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:54.525609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:09:54.526374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 54/106] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:09:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:09:54.533860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53eb09-7c36-44b4-9c69-f537a7e0e322 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:54.600933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a39a4f-93b3-4c63-b2b7-acd949c165c6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:54.650039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcaba2-c3a8-41c8-884c-e49a04491337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:54.650794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcaba2-c3a8-41c8-884c-e49a04491337 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:54.651239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcaba2-c3a8-41c8-884c-e49a04491337 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:54.651803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcaba2-c3a8-41c8-884c-e49a04491337 None admin] PATH_INFO: `/v3/users/d399c8932dea4a31a881e6ab6d908c9f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:54.653983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcaba2-c3a8-41c8-884c-e49a04491337 None admin] RBAC: Authorizing `identity:get_user(user_id=d399c8932dea4a31a881e6ab6d908c9f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:54.655647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcaba2-c3a8-41c8-884c-e49a04491337 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:54.658064 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 53/107] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:54 2022] GET /identity/v3/users/d399c8932dea4a31a881e6ab6d908c9f => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:09:54.663277 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcaba2-c3a8-41c8-884c-e49a04491337 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:54.693259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53eb09-7c36-44b4-9c69-f537a7e0e322 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:54.731224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecccf0b-20eb-4b6e-b988-66244ee825c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:54.731870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecccf0b-20eb-4b6e-b988-66244ee825c4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:54.732204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecccf0b-20eb-4b6e-b988-66244ee825c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:54.732418 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecccf0b-20eb-4b6e-b988-66244ee825c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:54.743286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecccf0b-20eb-4b6e-b988-66244ee825c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-5ecccf0b-20eb-4b6e-b988-66244ee825c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:54.748039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:54.748938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:09:54.749872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 55/108] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:09:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:09:54.752872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:54.753994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb2b86-f14e-4ed6-a281-48f1fcdc0fc3 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:54.754283 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb2b86-f14e-4ed6-a281-48f1fcdc0fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:54.754572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb2b86-f14e-4ed6-a281-48f1fcdc0fc3 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:54.756537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 56/109] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:54.761468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb2b86-f14e-4ed6-a281-48f1fcdc0fc3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:54.778730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcaba2-c3a8-41c8-884c-e49a04491337 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:54.815046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0f213-a4eb-4d76-9118-76c2a36461bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:54.815945 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0f213-a4eb-4d76-9118-76c2a36461bb None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:54.815945 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0f213-a4eb-4d76-9118-76c2a36461bb None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:54.816217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0f213-a4eb-4d76-9118-76c2a36461bb None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:54.816895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0f213-a4eb-4d76-9118-76c2a36461bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:54.817238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0f213-a4eb-4d76-9118-76c2a36461bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:54.818637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0f213-a4eb-4d76-9118-76c2a36461bb None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:54.823189 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:54.832330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 54/110] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:09:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:54.832330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153612c-cb5d-4b91-9286-b878667f34c9 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:54.832330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153612c-cb5d-4b91-9286-b878667f34c9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:54.832330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153612c-cb5d-4b91-9286-b878667f34c9 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:54.832330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 55/111] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:54.832330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153612c-cb5d-4b91-9286-b878667f34c9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:54.881487 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb2b86-f14e-4ed6-a281-48f1fcdc0fc3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:54.916059 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6749f-5c39-4e53-b695-71b4345dfb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:54.916703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6749f-5c39-4e53-b695-71b4345dfb53 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:54.917018 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6749f-5c39-4e53-b695-71b4345dfb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:54.917323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6749f-5c39-4e53-b695-71b4345dfb53 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:54.918477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6749f-5c39-4e53-b695-71b4345dfb53 None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:54.919942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6749f-5c39-4e53-b695-71b4345dfb53 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:54.921612 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 57/112] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:09:54 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:54.922728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401c8a2-d1a3-4d5d-a6a1-d4cd4da634cf None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:54.923009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401c8a2-d1a3-4d5d-a6a1-d4cd4da634cf None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:54.923279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401c8a2-d1a3-4d5d-a6a1-d4cd4da634cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:54.941137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8401c8a2-d1a3-4d5d-a6a1-d4cd4da634cf None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:54.942329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8401c8a2-d1a3-4d5d-a6a1-d4cd4da634cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:54.950272 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153612c-cb5d-4b91-9286-b878667f34c9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:54.987306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95787f9e-f7e7-4c27-ae84-f380d9430361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:54.988399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95787f9e-f7e7-4c27-ae84-f380d9430361 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:54.988925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95787f9e-f7e7-4c27-ae84-f380d9430361 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:54.989397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95787f9e-f7e7-4c27-ae84-f380d9430361 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:54.990363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95787f9e-f7e7-4c27-ae84-f380d9430361 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:54.990884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95787f9e-f7e7-4c27-ae84-f380d9430361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:54.992524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95787f9e-f7e7-4c27-ae84-f380d9430361 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:55.001984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 56/113] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:09:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:55.003207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95787f9e-f7e7-4c27-ae84-f380d9430361 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:55.006459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:55.013255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 58/114] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:55.015011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cfa1e-412e-468e-ab19-dee20f21d3fe None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:55.015372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cfa1e-412e-468e-ab19-dee20f21d3fe None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:55.015715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cfa1e-412e-468e-ab19-dee20f21d3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:55.039245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c41cfa1e-412e-468e-ab19-dee20f21d3fe None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:55.040591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c41cfa1e-412e-468e-ab19-dee20f21d3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:55.087948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:55.110053 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 59/115] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:55.112902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cfa1e-412e-468e-ab19-dee20f21d3fe None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:55.128559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95787f9e-f7e7-4c27-ae84-f380d9430361 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:55.174685 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e736c5-1671-4942-a2d6-7685a1cd03de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:55.176299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e736c5-1671-4942-a2d6-7685a1cd03de None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:55.176785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e736c5-1671-4942-a2d6-7685a1cd03de None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:55.177499 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e736c5-1671-4942-a2d6-7685a1cd03de None admin] PATH_INFO: `/v3/users/5d269ce658414d469f0da1f990d74895` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:55.179072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e736c5-1671-4942-a2d6-7685a1cd03de None admin] RBAC: Authorizing `identity:get_user(user_id=5d269ce658414d469f0da1f990d74895)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:55.181377 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e736c5-1671-4942-a2d6-7685a1cd03de None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:55.183518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 57/116] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:55 2022] GET /identity/v3/users/5d269ce658414d469f0da1f990d74895 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:55.184452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e736c5-1671-4942-a2d6-7685a1cd03de None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:55.227718 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cfa1e-412e-468e-ab19-dee20f21d3fe None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:55.266504 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bddf80-1965-4f17-922c-b33fb4b0e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:55.267276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddf80-1965-4f17-922c-b33fb4b0e7fe None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:55.267683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddf80-1965-4f17-922c-b33fb4b0e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:55.268033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddf80-1965-4f17-922c-b33fb4b0e7fe None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362/users/d399c8932dea4a31a881e6ab6d908c9f/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:55.270309 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddf80-1965-4f17-922c-b33fb4b0e7fe None admin] RBAC: Authorizing `identity:create_grant(project_id=0565423b088f492581b9dc3e0ad10362, user_id=d399c8932dea4a31a881e6ab6d908c9f, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:55.272054 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddf80-1965-4f17-922c-b33fb4b0e7fe None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:55.283854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:55.289106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 60/117] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:09:55 2022] PUT /identity/v3/projects/0565423b088f492581b9dc3e0ad10362/users/d399c8932dea4a31a881e6ab6d908c9f/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:09:55.290311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c070d9-8bbb-4c95-a899-6bf472d583a1 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:55.290618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c070d9-8bbb-4c95-a899-6bf472d583a1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:55.290887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c070d9-8bbb-4c95-a899-6bf472d583a1 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:55.296879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 61/118] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:55.296879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c070d9-8bbb-4c95-a899-6bf472d583a1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:55.345447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e736c5-1671-4942-a2d6-7685a1cd03de None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:55.348001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:55.405471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cab0cf-6699-4aa9-be73-a6a03538dfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:55.406691 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cab0cf-6699-4aa9-be73-a6a03538dfd9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:55.407146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cab0cf-6699-4aa9-be73-a6a03538dfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:55.407418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cab0cf-6699-4aa9-be73-a6a03538dfd9 None admin] PATH_INFO: `/v3/users/75b122b5019b44c384e9446585fcdd26` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:55.423911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cab0cf-6699-4aa9-be73-a6a03538dfd9 None admin] RBAC: Authorizing `identity:get_user(user_id=75b122b5019b44c384e9446585fcdd26)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:55.424898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c070d9-8bbb-4c95-a899-6bf472d583a1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:55.425491 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cab0cf-6699-4aa9-be73-a6a03538dfd9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:55.428870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 58/119] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:55 2022] GET /identity/v3/users/75b122b5019b44c384e9446585fcdd26 => generated 289 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:55.428870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cab0cf-6699-4aa9-be73-a6a03538dfd9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:55.465316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e8822-761e-4366-887c-29c4480408f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:55.465974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e8822-761e-4366-887c-29c4480408f9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:55.466260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e8822-761e-4366-887c-29c4480408f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:55.466539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e8822-761e-4366-887c-29c4480408f9 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:55.467712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e8822-761e-4366-887c-29c4480408f9 None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:55.469223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e8822-761e-4366-887c-29c4480408f9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:55.471048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 62/120] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:09:55 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:55.474008 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b1ef3-0d0c-4a33-9884-2432a2cd55ca None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:55.474296 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b1ef3-0d0c-4a33-9884-2432a2cd55ca None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:55.474581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b1ef3-0d0c-4a33-9884-2432a2cd55ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:55.496200 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-048b1ef3-0d0c-4a33-9884-2432a2cd55ca None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:55.497771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-048b1ef3-0d0c-4a33-9884-2432a2cd55ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:55.546829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cab0cf-6699-4aa9-be73-a6a03538dfd9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:55.576622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:55.592742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 63/121] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:55.592742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b1ef3-0d0c-4a33-9884-2432a2cd55ca None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:55.595312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf4cf4-7416-470c-b96d-35f370f8fc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:55.596051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf4cf4-7416-470c-b96d-35f370f8fc05 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:55.596399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf4cf4-7416-470c-b96d-35f370f8fc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:55.596755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf4cf4-7416-470c-b96d-35f370f8fc05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:55.609766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf4cf4-7416-470c-b96d-35f370f8fc05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-22cf4cf4-7416-470c-b96d-35f370f8fc05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:55.615279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:55.616401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:09:55.617233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 59/122] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:09:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:09:55.617881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf4cf4-7416-470c-b96d-35f370f8fc05 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:55.643480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:55.721377 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b1ef3-0d0c-4a33-9884-2432a2cd55ca None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:55.738182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf4cf4-7416-470c-b96d-35f370f8fc05 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:55.760332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ec009-a805-49a0-9e56-9b621b13457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:55.761113 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ec009-a805-49a0-9e56-9b621b13457a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:55.761403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ec009-a805-49a0-9e56-9b621b13457a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:55.761680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ec009-a805-49a0-9e56-9b621b13457a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:55.762868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ec009-a805-49a0-9e56-9b621b13457a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:55.764549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ec009-a805-49a0-9e56-9b621b13457a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:55.766201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 64/123] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:09:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:55.766201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ec009-a805-49a0-9e56-9b621b13457a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:55.780428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7929c-5ec7-437a-8d18-98c21f011991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:55.781323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7929c-5ec7-437a-8d18-98c21f011991 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:55.781770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7929c-5ec7-437a-8d18-98c21f011991 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:55.782227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7929c-5ec7-437a-8d18-98c21f011991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:55.839088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:55.853400 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7929c-5ec7-437a-8d18-98c21f011991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:55.855282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7929c-5ec7-437a-8d18-98c21f011991 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:55.875509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ec009-a805-49a0-9e56-9b621b13457a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:55.883373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:55.913659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bbad7-47be-43ff-a436-f1a16d322f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:55.914342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bbad7-47be-43ff-a436-f1a16d322f2d None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:55.914741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bbad7-47be-43ff-a436-f1a16d322f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:55.915024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bbad7-47be-43ff-a436-f1a16d322f2d None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362/users/5d269ce658414d469f0da1f990d74895/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:55.917202 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bbad7-47be-43ff-a436-f1a16d322f2d None admin] RBAC: Authorizing `identity:create_grant(project_id=0565423b088f492581b9dc3e0ad10362, user_id=5d269ce658414d469f0da1f990d74895, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:55.918894 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bbad7-47be-43ff-a436-f1a16d322f2d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:55.936777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 65/124] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:09:55 2022] PUT /identity/v3/projects/0565423b088f492581b9dc3e0ad10362/users/5d269ce658414d469f0da1f990d74895/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:09:55.936777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bbad7-47be-43ff-a436-f1a16d322f2d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:55.970774 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 60/125] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:09:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:09:55.977011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7929c-5ec7-437a-8d18-98c21f011991 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:56.086349 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:56.092098 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bbad7-47be-43ff-a436-f1a16d322f2d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:56.108730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7929c-5ec7-437a-8d18-98c21f011991 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:56.131995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4a99c-b49a-43fb-8cdb-116c32a04d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:56.134421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4a99c-b49a-43fb-8cdb-116c32a04d69 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:56.134421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4a99c-b49a-43fb-8cdb-116c32a04d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:56.134421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4a99c-b49a-43fb-8cdb-116c32a04d69 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:56.134421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4a99c-b49a-43fb-8cdb-116c32a04d69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:56.135065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4a99c-b49a-43fb-8cdb-116c32a04d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:56.137568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4a99c-b49a-43fb-8cdb-116c32a04d69 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:56.147080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b921ad-7edd-4a0d-a2c8-37d72b82bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:56.147813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 66/126] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:09:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:56.147933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b921ad-7edd-4a0d-a2c8-37d72b82bfd4 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:56.148007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b921ad-7edd-4a0d-a2c8-37d72b82bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:56.148445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b921ad-7edd-4a0d-a2c8-37d72b82bfd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:56.148741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4a99c-b49a-43fb-8cdb-116c32a04d69 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:56.149237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b921ad-7edd-4a0d-a2c8-37d72b82bfd4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:56.150653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b921ad-7edd-4a0d-a2c8-37d72b82bfd4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:56.183277 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:56.193186 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 61/127] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:09:55 2022] POST /identity/v3/projects => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:09:56.197378 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b921ad-7edd-4a0d-a2c8-37d72b82bfd4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:56.304266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4a99c-b49a-43fb-8cdb-116c32a04d69 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:56.369188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e44a93-9375-4343-89d2-3318b8771168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:56.369973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e44a93-9375-4343-89d2-3318b8771168 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:56.370277 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e44a93-9375-4343-89d2-3318b8771168 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:56.370580 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e44a93-9375-4343-89d2-3318b8771168 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:56.386861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e44a93-9375-4343-89d2-3318b8771168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-45e44a93-9375-4343-89d2-3318b8771168 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:56.392818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:56.393715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:09:56.394505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 67/128] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:09:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:09:56.395146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e44a93-9375-4343-89d2-3318b8771168 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:56.403409 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b921ad-7edd-4a0d-a2c8-37d72b82bfd4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:56.450030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e735e7b-639c-4ff4-a7bf-4aaaf5ad3794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:56.450715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e735e7b-639c-4ff4-a7bf-4aaaf5ad3794 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:56.450997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e735e7b-639c-4ff4-a7bf-4aaaf5ad3794 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:56.451273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e735e7b-639c-4ff4-a7bf-4aaaf5ad3794 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:56.452535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e735e7b-639c-4ff4-a7bf-4aaaf5ad3794 None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:56.454152 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e735e7b-639c-4ff4-a7bf-4aaaf5ad3794 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:56.456148 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 62/129] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:09:56 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:56.456954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e735e7b-639c-4ff4-a7bf-4aaaf5ad3794 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:56.474132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:56.539680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:56.556435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e44a93-9375-4343-89d2-3318b8771168 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:56.594858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e735e7b-639c-4ff4-a7bf-4aaaf5ad3794 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:56.635062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b0256-2589-4cd0-aa70-18dc7541f828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:56.635617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b0256-2589-4cd0-aa70-18dc7541f828 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:56.635974 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b0256-2589-4cd0-aa70-18dc7541f828 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:56.636254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b0256-2589-4cd0-aa70-18dc7541f828 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:56.636967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b0256-2589-4cd0-aa70-18dc7541f828 None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:56.637276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b0256-2589-4cd0-aa70-18dc7541f828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:56.639203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b0256-2589-4cd0-aa70-18dc7541f828 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:56.648586 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 63/130] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:09:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:56.653757 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b0256-2589-4cd0-aa70-18dc7541f828 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:56.671763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33199c-b80f-4daa-a200-227ed3460a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:56.672425 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33199c-b80f-4daa-a200-227ed3460a71 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:56.672705 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33199c-b80f-4daa-a200-227ed3460a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:56.672999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33199c-b80f-4daa-a200-227ed3460a71 None admin] PATH_INFO: `/v3/users/d399c8932dea4a31a881e6ab6d908c9f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:56.674318 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33199c-b80f-4daa-a200-227ed3460a71 None admin] RBAC: Authorizing `identity:get_user(user_id=d399c8932dea4a31a881e6ab6d908c9f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:56.675787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33199c-b80f-4daa-a200-227ed3460a71 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:56.689604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 68/131] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:56 2022] GET /identity/v3/users/d399c8932dea4a31a881e6ab6d908c9f => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:56.690498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33199c-b80f-4daa-a200-227ed3460a71 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:56.731447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:56.767087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b0256-2589-4cd0-aa70-18dc7541f828 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:56.805231 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469df2-8d4b-4186-8c14-44ab65d4162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:56.805855 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469df2-8d4b-4186-8c14-44ab65d4162b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:56.806194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469df2-8d4b-4186-8c14-44ab65d4162b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:56.806471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469df2-8d4b-4186-8c14-44ab65d4162b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:56.807203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30469df2-8d4b-4186-8c14-44ab65d4162b None admin] RBAC: Adding query filter params (role.id=f95d8b8d42f2490c8085f32706af9823, scope.project.id=0565423b088f492581b9dc3e0ad10362, user.id=75b122b5019b44c384e9446585fcdd26) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:56.807559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30469df2-8d4b-4186-8c14-44ab65d4162b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:56.809333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30469df2-8d4b-4186-8c14-44ab65d4162b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:56.816509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 64/132] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:09:56 2022] GET /identity/v3/role_assignments?user.id=75b122b5019b44c384e9446585fcdd26&scope.project.id=0565423b088f492581b9dc3e0ad10362&role.id=f95d8b8d42f2490c8085f32706af9823 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:56.817623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469df2-8d4b-4186-8c14-44ab65d4162b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:56.941209 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469df2-8d4b-4186-8c14-44ab65d4162b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:56.975109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33199c-b80f-4daa-a200-227ed3460a71 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:56.991739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968842f-e722-4916-8963-8d3b671a2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:56.992465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968842f-e722-4916-8963-8d3b671a2fbb None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:56.992762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968842f-e722-4916-8963-8d3b671a2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:56.993037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968842f-e722-4916-8963-8d3b671a2fbb None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:56.997018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968842f-e722-4916-8963-8d3b671a2fbb None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:56.998588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968842f-e722-4916-8963-8d3b671a2fbb None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:57.000331 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 65/133] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:09:56 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:57.006912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968842f-e722-4916-8963-8d3b671a2fbb None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:57.012752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:57.044659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f29d6-9233-43d8-bace-61c3c613b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:57.045790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f29d6-9233-43d8-bace-61c3c613b6af None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:57.046273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f29d6-9233-43d8-bace-61c3c613b6af None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:57.046745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f29d6-9233-43d8-bace-61c3c613b6af None admin] PATH_INFO: `/v3/users/d399c8932dea4a31a881e6ab6d908c9f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:57.049557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f29d6-9233-43d8-bace-61c3c613b6af None admin] RBAC: Authorizing `identity:get_user(user_id=d399c8932dea4a31a881e6ab6d908c9f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:57.051491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f29d6-9233-43d8-bace-61c3c613b6af None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:57.053406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 69/134] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:56 2022] GET /identity/v3/users/d399c8932dea4a31a881e6ab6d908c9f => generated 275 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:57.074351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f29d6-9233-43d8-bace-61c3c613b6af None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:57.126585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:57.137267 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968842f-e722-4916-8963-8d3b671a2fbb None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:57.180654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36dbd-f1e1-41ac-95a5-6e06e0f425d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:57.181401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36dbd-f1e1-41ac-95a5-6e06e0f425d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:57.181680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36dbd-f1e1-41ac-95a5-6e06e0f425d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:57.181948 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36dbd-f1e1-41ac-95a5-6e06e0f425d2 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362/users/d399c8932dea4a31a881e6ab6d908c9f/roles/db4150b658a14804af1bf240ea2e31f9` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:57.184675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36dbd-f1e1-41ac-95a5-6e06e0f425d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0565423b088f492581b9dc3e0ad10362, user_id=d399c8932dea4a31a881e6ab6d908c9f, role_id=db4150b658a14804af1bf240ea2e31f9)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:57.186237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36dbd-f1e1-41ac-95a5-6e06e0f425d2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:57.208812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 66/135] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:09:57 2022] PUT /identity/v3/projects/0565423b088f492581b9dc3e0ad10362/users/d399c8932dea4a31a881e6ab6d908c9f/roles/db4150b658a14804af1bf240ea2e31f9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:09:57.274924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f29d6-9233-43d8-bace-61c3c613b6af None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:57.323079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6a39d-34ac-415e-9734-f429aac5f2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:57.324664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6a39d-34ac-415e-9734-f429aac5f2cd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:57.325233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6a39d-34ac-415e-9734-f429aac5f2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:57.325709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6a39d-34ac-415e-9734-f429aac5f2cd None admin] PATH_INFO: `/v3/projects/e901e6cdae814ddc83f31c92808732d8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:57.328656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6a39d-34ac-415e-9734-f429aac5f2cd None admin] RBAC: Authorizing `identity:get_project(project_id=e901e6cdae814ddc83f31c92808732d8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:57.330611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6a39d-34ac-415e-9734-f429aac5f2cd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:57.332617 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 70/136] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:09:57 2022] GET /identity/v3/projects/e901e6cdae814ddc83f31c92808732d8 => generated 312 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:09:57.338606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36dbd-f1e1-41ac-95a5-6e06e0f425d2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:57.449974 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:57.463303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58111123-72c3-4da8-9d4a-a934d8930833 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:57.463603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58111123-72c3-4da8-9d4a-a934d8930833 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:57.463785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58111123-72c3-4da8-9d4a-a934d8930833 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:57.465882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 71/137] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:57.482246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716105d-48e6-4a1a-a6c6-00d227ff65d2 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:57.482551 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716105d-48e6-4a1a-a6c6-00d227ff65d2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:57.482811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716105d-48e6-4a1a-a6c6-00d227ff65d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:57.499253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36dbd-f1e1-41ac-95a5-6e06e0f425d2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:57.520745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a716105d-48e6-4a1a-a6c6-00d227ff65d2 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:57.520745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a716105d-48e6-4a1a-a6c6-00d227ff65d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:57.573289 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1f49b-8d5b-41fe-9fa1-6112ceded782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:57.574105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1f49b-8d5b-41fe-9fa1-6112ceded782 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:57.574393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1f49b-8d5b-41fe-9fa1-6112ceded782 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:57.574722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1f49b-8d5b-41fe-9fa1-6112ceded782 None admin] PATH_INFO: `/v3/projects/e901e6cdae814ddc83f31c92808732d8/users/d399c8932dea4a31a881e6ab6d908c9f/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:57.579534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1f49b-8d5b-41fe-9fa1-6112ceded782 None admin] RBAC: Authorizing `identity:create_grant(project_id=e901e6cdae814ddc83f31c92808732d8, user_id=d399c8932dea4a31a881e6ab6d908c9f, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:57.581127 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1f49b-8d5b-41fe-9fa1-6112ceded782 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:57.606332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 72/138] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:57.608890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 67/139] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:09:57 2022] PUT /identity/v3/projects/e901e6cdae814ddc83f31c92808732d8/users/d399c8932dea4a31a881e6ab6d908c9f/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:09:57.936589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716105d-48e6-4a1a-a6c6-00d227ff65d2 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:57.965865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:58.064006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716105d-48e6-4a1a-a6c6-00d227ff65d2 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:58.103869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120700f-9a6d-40bb-98d4-0821d6f949fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:58.104766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120700f-9a6d-40bb-98d4-0821d6f949fd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:58.105051 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120700f-9a6d-40bb-98d4-0821d6f949fd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:58.105325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120700f-9a6d-40bb-98d4-0821d6f949fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:58.116375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120700f-9a6d-40bb-98d4-0821d6f949fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-7120700f-9a6d-40bb-98d4-0821d6f949fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:58.121627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:58.122457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:09:58.123595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 73/140] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:09:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:09:58.128515 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1f49b-8d5b-41fe-9fa1-6112ceded782 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:58.261023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1f49b-8d5b-41fe-9fa1-6112ceded782 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:58.295847 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:58.310833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7045071-a8e6-4dae-aded-71917f0c5efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:58.311828 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7045071-a8e6-4dae-aded-71917f0c5efe None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:58.312333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7045071-a8e6-4dae-aded-71917f0c5efe None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:58.312995 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7045071-a8e6-4dae-aded-71917f0c5efe None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:58.313686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7045071-a8e6-4dae-aded-71917f0c5efe None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:58.313999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7045071-a8e6-4dae-aded-71917f0c5efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:58.315421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7045071-a8e6-4dae-aded-71917f0c5efe None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:58.328945 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 68/141] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:09:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:58.334488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120700f-9a6d-40bb-98d4-0821d6f949fd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:58.461892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:58.495065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120700f-9a6d-40bb-98d4-0821d6f949fd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:58.498310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c2b96-c9fe-4718-838f-1a22e67fafbc None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:58.498771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c2b96-c9fe-4718-838f-1a22e67fafbc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:58.498843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c2b96-c9fe-4718-838f-1a22e67fafbc None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:58.500955 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 69/142] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:58.512861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4cf7a-f761-490c-8cfe-4c6850145392 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:58.512861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4cf7a-f761-490c-8cfe-4c6850145392 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:58.512861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4cf7a-f761-490c-8cfe-4c6850145392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:58.541606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-09f4cf7a-f761-490c-8cfe-4c6850145392 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:58.546226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-09f4cf7a-f761-490c-8cfe-4c6850145392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:58.574125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae611ba9-2f4c-49e5-afe4-65939c09bec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:58.574788 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae611ba9-2f4c-49e5-afe4-65939c09bec8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:58.575071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae611ba9-2f4c-49e5-afe4-65939c09bec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:58.575348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae611ba9-2f4c-49e5-afe4-65939c09bec8 None admin] PATH_INFO: `/v3/users/d399c8932dea4a31a881e6ab6d908c9f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:58.577213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae611ba9-2f4c-49e5-afe4-65939c09bec8 None admin] RBAC: Authorizing `identity:get_user(user_id=d399c8932dea4a31a881e6ab6d908c9f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:58.578683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae611ba9-2f4c-49e5-afe4-65939c09bec8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:58.580510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 74/143] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:58 2022] GET /identity/v3/users/d399c8932dea4a31a881e6ab6d908c9f => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:58.588334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae611ba9-2f4c-49e5-afe4-65939c09bec8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:58.696649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 70/144] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:58.786371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae611ba9-2f4c-49e5-afe4-65939c09bec8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:58.829360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04663c8a-7c2a-45cc-823f-d8d6587660fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:58.830025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04663c8a-7c2a-45cc-823f-d8d6587660fe None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:58.830305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04663c8a-7c2a-45cc-823f-d8d6587660fe None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:58.830576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04663c8a-7c2a-45cc-823f-d8d6587660fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:58.857247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:58.916039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04663c8a-7c2a-45cc-823f-d8d6587660fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:58.918017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04663c8a-7c2a-45cc-823f-d8d6587660fe None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:59.034271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 75/145] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:09:59.039966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4cf7a-f761-490c-8cfe-4c6850145392 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:59.115125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04663c8a-7c2a-45cc-823f-d8d6587660fe None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:59.148929 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4cf7a-f761-490c-8cfe-4c6850145392 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:59.177086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:59.201938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefbec0-f3ea-4017-81b1-f6fab9291de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:59.202711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefbec0-f3ea-4017-81b1-f6fab9291de8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:59.203000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefbec0-f3ea-4017-81b1-f6fab9291de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:59.203273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefbec0-f3ea-4017-81b1-f6fab9291de8 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:59.204552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefbec0-f3ea-4017-81b1-f6fab9291de8 None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:59.206225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefbec0-f3ea-4017-81b1-f6fab9291de8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:59.208182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 71/146] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:09:59 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:59.209441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda9fe-f40d-42b9-84c8-6d02674dc1b6 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:59.209725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda9fe-f40d-42b9-84c8-6d02674dc1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:59.210002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda9fe-f40d-42b9-84c8-6d02674dc1b6 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:59.211343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 72/147] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:59.217274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda9fe-f40d-42b9-84c8-6d02674dc1b6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:59.229247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:59.331308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda9fe-f40d-42b9-84c8-6d02674dc1b6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:59.370258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5cf47-ba6c-4b89-af7a-e209ac332ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:59.371030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5cf47-ba6c-4b89-af7a-e209ac332ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:59.371306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5cf47-ba6c-4b89-af7a-e209ac332ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:59.371577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5cf47-ba6c-4b89-af7a-e209ac332ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:59.372334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5cf47-ba6c-4b89-af7a-e209ac332ef2 None admin] RBAC: Adding query filter params (role.id=b7d5979aed50487cbf98896a6fa6f162, scope.project.id=0565423b088f492581b9dc3e0ad10362, user.id=d399c8932dea4a31a881e6ab6d908c9f) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:59.372643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5cf47-ba6c-4b89-af7a-e209ac332ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:59.375147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04663c8a-7c2a-45cc-823f-d8d6587660fe None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:59.378571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5cf47-ba6c-4b89-af7a-e209ac332ef2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:59.396595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 73/148] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:09:59 2022] GET /identity/v3/role_assignments?user.id=d399c8932dea4a31a881e6ab6d908c9f&scope.project.id=0565423b088f492581b9dc3e0ad10362&role.id=b7d5979aed50487cbf98896a6fa6f162 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:09:59.397892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62099b0-7ca3-485e-bb12-bc6817b1f5ad None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:59.398178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62099b0-7ca3-485e-bb12-bc6817b1f5ad None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:59.398447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62099b0-7ca3-485e-bb12-bc6817b1f5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:59.434530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972bf03-35b5-4377-bc88-d55a40edbdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:59.435201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972bf03-35b5-4377-bc88-d55a40edbdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:59.435484 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972bf03-35b5-4377-bc88-d55a40edbdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:59.435760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972bf03-35b5-4377-bc88-d55a40edbdd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:59.438914 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f62099b0-7ca3-485e-bb12-bc6817b1f5ad None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:09:59.440157 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f62099b0-7ca3-485e-bb12-bc6817b1f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:09:59.457985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972bf03-35b5-4377-bc88-d55a40edbdd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-d972bf03-35b5-4377-bc88-d55a40edbdd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:09:59.462830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:09:59.463678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:09:59.464771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 76/149] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:09:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:09:59.473506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972bf03-35b5-4377-bc88-d55a40edbdd0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:59.537299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:59.590204 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 74/150] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:09:59.654773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972bf03-35b5-4377-bc88-d55a40edbdd0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:59.673328 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:09:59.701040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab6f16-8984-4708-afda-1e8d46093e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:59.701668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab6f16-8984-4708-afda-1e8d46093e0e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:59.701949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab6f16-8984-4708-afda-1e8d46093e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:59.702223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab6f16-8984-4708-afda-1e8d46093e0e None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:59.702905 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab6f16-8984-4708-afda-1e8d46093e0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:09:59.703213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab6f16-8984-4708-afda-1e8d46093e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:59.704611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab6f16-8984-4708-afda-1e8d46093e0e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:59.721131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 77/151] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:09:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:59.722158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62099b0-7ca3-485e-bb12-bc6817b1f5ad None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:59.849877 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62099b0-7ca3-485e-bb12-bc6817b1f5ad None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:09:59.900916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d568541-f2bb-40d1-9fde-2faeeeacdbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:09:59.901981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d568541-f2bb-40d1-9fde-2faeeeacdbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:59.902457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d568541-f2bb-40d1-9fde-2faeeeacdbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:59.902926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d568541-f2bb-40d1-9fde-2faeeeacdbb4 None admin] PATH_INFO: `/v3/users/5d269ce658414d469f0da1f990d74895` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:59.905393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d568541-f2bb-40d1-9fde-2faeeeacdbb4 None admin] RBAC: Authorizing `identity:get_user(user_id=5d269ce658414d469f0da1f990d74895)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:09:59.907074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d568541-f2bb-40d1-9fde-2faeeeacdbb4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:09:59.909215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 75/152] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:09:59 2022] GET /identity/v3/users/5d269ce658414d469f0da1f990d74895 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:09:59.918046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab6f16-8984-4708-afda-1e8d46093e0e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:09:59.977522 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea92668-13c2-4ac0-8530-7211ce8a1eb0 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:59.978273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea92668-13c2-4ac0-8530-7211ce8a1eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:59.978766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea92668-13c2-4ac0-8530-7211ce8a1eb0 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:09:59.980879 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 76/153] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:09:59.988410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b4eda-08de-4595-a5c5-f1d042610970 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:09:59.988711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b4eda-08de-4595-a5c5-f1d042610970 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:09:59.988992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b4eda-08de-4595-a5c5-f1d042610970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:00.014824 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6b2b4eda-08de-4595-a5c5-f1d042610970 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:00.017406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6b2b4eda-08de-4595-a5c5-f1d042610970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:00.074481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:00.075547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab6f16-8984-4708-afda-1e8d46093e0e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:00.112885 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 77/154] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:00.114471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b4eda-08de-4595-a5c5-f1d042610970 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:00.129746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1f20b-e8cc-4a57-b047-6a4dc58b1e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:00.130617 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1f20b-e8cc-4a57-b047-6a4dc58b1e21 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:00.131039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1f20b-e8cc-4a57-b047-6a4dc58b1e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:00.131452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1f20b-e8cc-4a57-b047-6a4dc58b1e21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:00.249103 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:00.319834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1f20b-e8cc-4a57-b047-6a4dc58b1e21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:00.321380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1f20b-e8cc-4a57-b047-6a4dc58b1e21 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:00.351898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b4eda-08de-4595-a5c5-f1d042610970 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:00.394354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b018e-2ebd-4c14-b0d4-e90c30a65826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:00.394903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b018e-2ebd-4c14-b0d4-e90c30a65826 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:00.395179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b018e-2ebd-4c14-b0d4-e90c30a65826 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:00.395605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b018e-2ebd-4c14-b0d4-e90c30a65826 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:00.397092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b018e-2ebd-4c14-b0d4-e90c30a65826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:00.399000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b018e-2ebd-4c14-b0d4-e90c30a65826 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:00.401268 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 78/155] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:00.402518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc45005-92ff-40be-90f8-c400d70cc529 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:00.402797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc45005-92ff-40be-90f8-c400d70cc529 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:00.403077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc45005-92ff-40be-90f8-c400d70cc529 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:00.404615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 79/156] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:00.409641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc45005-92ff-40be-90f8-c400d70cc529 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:00.446550 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 78/157] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:09:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:00.448554 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6254917-7ded-46f9-952c-e59170798bd9 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:00.449074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6254917-7ded-46f9-952c-e59170798bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:00.449549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6254917-7ded-46f9-952c-e59170798bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:00.459636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:00.468098 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f6254917-7ded-46f9-952c-e59170798bd9 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:00.469325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f6254917-7ded-46f9-952c-e59170798bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:00.524218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc45005-92ff-40be-90f8-c400d70cc529 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:00.542171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 79/158] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:00.543113 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6254917-7ded-46f9-952c-e59170798bd9 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:00.545358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:00.559083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b49082-40c7-4d87-8378-ea57fe7ab4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:00.559700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b49082-40c7-4d87-8378-ea57fe7ab4ea None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:00.559976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b49082-40c7-4d87-8378-ea57fe7ab4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:00.560244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b49082-40c7-4d87-8378-ea57fe7ab4ea None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:00.560922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b49082-40c7-4d87-8378-ea57fe7ab4ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:00.562369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b49082-40c7-4d87-8378-ea57fe7ab4ea None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:00.588878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 80/159] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:10:00 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:10:00.589863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b49082-40c7-4d87-8378-ea57fe7ab4ea None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:00.705479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6254917-7ded-46f9-952c-e59170798bd9 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:00.720850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b49082-40c7-4d87-8378-ea57fe7ab4ea None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:00.720850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:00.765091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15357f-537d-4722-9593-e0656196299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:00.765781 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15357f-537d-4722-9593-e0656196299a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:00.766068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15357f-537d-4722-9593-e0656196299a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:00.766323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15357f-537d-4722-9593-e0656196299a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:00.768217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e5a23-5348-48d3-9427-50f76a63aa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:00.769645 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e5a23-5348-48d3-9427-50f76a63aa3b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:00.769645 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e5a23-5348-48d3-9427-50f76a63aa3b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:00.769645 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e5a23-5348-48d3-9427-50f76a63aa3b None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:00.770647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e5a23-5348-48d3-9427-50f76a63aa3b None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:00.774961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e5a23-5348-48d3-9427-50f76a63aa3b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:00.774961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 81/160] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:00 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:00.775174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a914-ce86-4e3b-997f-42245c0551fe None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:00.775352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a914-ce86-4e3b-997f-42245c0551fe None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:00.775621 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a914-ce86-4e3b-997f-42245c0551fe None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:00.777751 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 82/161] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:00.780889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a914-ce86-4e3b-997f-42245c0551fe None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:00.788129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15357f-537d-4722-9593-e0656196299a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-4d15357f-537d-4722-9593-e0656196299a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:00.794298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:00.795159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:00.795955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 80/162] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:00.796670 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c6a76-c961-469e-9941-93f8ad4d2099 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:00.797328 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c6a76-c961-469e-9941-93f8ad4d2099 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:00.797328 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c6a76-c961-469e-9941-93f8ad4d2099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:00.815772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-821c6a76-c961-469e-9941-93f8ad4d2099 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:00.816983 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-821c6a76-c961-469e-9941-93f8ad4d2099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:00.881437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:00.893348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 81/163] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:00.894212 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c6a76-c961-469e-9941-93f8ad4d2099 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:00.915349 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a914-ce86-4e3b-997f-42245c0551fe None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:00.955594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94e931-8694-496d-9dda-2485e83d0b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:00.956531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94e931-8694-496d-9dda-2485e83d0b8b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:00.957024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94e931-8694-496d-9dda-2485e83d0b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:00.957294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94e931-8694-496d-9dda-2485e83d0b8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:00.958452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94e931-8694-496d-9dda-2485e83d0b8b None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=0565423b088f492581b9dc3e0ad10362, user.id=5d269ce658414d469f0da1f990d74895) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:00.958452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94e931-8694-496d-9dda-2485e83d0b8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:00.959786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94e931-8694-496d-9dda-2485e83d0b8b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:00.970561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 83/164] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:00 2022] GET /identity/v3/role_assignments?user.id=5d269ce658414d469f0da1f990d74895&scope.project.id=0565423b088f492581b9dc3e0ad10362&role.id=db572ad3d504403cbb227c2155c93eda => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:00.971400 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94e931-8694-496d-9dda-2485e83d0b8b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:01.017008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:01.068169 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c6a76-c961-469e-9941-93f8ad4d2099 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:01.106018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94e931-8694-496d-9dda-2485e83d0b8b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:01.147715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88410564-b0d6-4fc0-bd93-99e719ccb1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:01.149065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88410564-b0d6-4fc0-bd93-99e719ccb1dc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:01.149558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88410564-b0d6-4fc0-bd93-99e719ccb1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:01.150017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88410564-b0d6-4fc0-bd93-99e719ccb1dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:01.154325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79864c12-e49b-4300-96e1-e726f1927d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:01.154965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79864c12-e49b-4300-96e1-e726f1927d66 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:01.155246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79864c12-e49b-4300-96e1-e726f1927d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:01.155519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79864c12-e49b-4300-96e1-e726f1927d66 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:01.156206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79864c12-e49b-4300-96e1-e726f1927d66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:01.156510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79864c12-e49b-4300-96e1-e726f1927d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:01.157942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79864c12-e49b-4300-96e1-e726f1927d66 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:01.164160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88410564-b0d6-4fc0-bd93-99e719ccb1dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-88410564-b0d6-4fc0-bd93-99e719ccb1dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:01.171369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:01.172263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:01.173324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:01.173324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:01.173324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:01.173324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:01.173324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:01.173324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:01.173324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:01.173324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:01.173324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:01.173324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:01.173324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:01.173324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:01.175897 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 84/165] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:01.179887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 82/166] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:01.184456 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88410564-b0d6-4fc0-bd93-99e719ccb1dc None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:01.186461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79864c12-e49b-4300-96e1-e726f1927d66 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:01.267795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:01.310205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:01.318136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79864c12-e49b-4300-96e1-e726f1927d66 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:01.322058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88410564-b0d6-4fc0-bd93-99e719ccb1dc None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:01.364488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc098-4617-4e02-a15e-fe7262f5bc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:01.365424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc098-4617-4e02-a15e-fe7262f5bc5f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:01.365697 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc098-4617-4e02-a15e-fe7262f5bc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:01.365973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc098-4617-4e02-a15e-fe7262f5bc5f None admin] PATH_INFO: `/v3/users/75b122b5019b44c384e9446585fcdd26` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:01.367127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cc098-4617-4e02-a15e-fe7262f5bc5f None admin] RBAC: Authorizing `identity:get_user(user_id=75b122b5019b44c384e9446585fcdd26)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:01.368584 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cc098-4617-4e02-a15e-fe7262f5bc5f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:01.370689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ea348-21e4-4068-937b-ffd905b45bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:01.371326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ea348-21e4-4068-937b-ffd905b45bef None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:01.371607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ea348-21e4-4068-937b-ffd905b45bef None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:01.371882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ea348-21e4-4068-937b-ffd905b45bef None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:01.372561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ea348-21e4-4068-937b-ffd905b45bef None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:01.372917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ea348-21e4-4068-937b-ffd905b45bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:01.374341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ea348-21e4-4068-937b-ffd905b45bef None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:01.374889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 83/167] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:01 2022] GET /identity/v3/users/75b122b5019b44c384e9446585fcdd26 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:01.375890 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc098-4617-4e02-a15e-fe7262f5bc5f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:01.385468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 85/168] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:01.386382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ea348-21e4-4068-937b-ffd905b45bef None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:01.521970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc098-4617-4e02-a15e-fe7262f5bc5f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:01.535195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ea348-21e4-4068-937b-ffd905b45bef None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:01.552242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:01.568307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73820d1-34c3-435e-bd85-30ab568a6a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:01.569588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73820d1-34c3-435e-bd85-30ab568a6a41 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:01.570072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73820d1-34c3-435e-bd85-30ab568a6a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:01.570742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73820d1-34c3-435e-bd85-30ab568a6a41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:01.576460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041173-469d-41d3-ad85-1af07517395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:01.577222 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041173-469d-41d3-ad85-1af07517395a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:01.577572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041173-469d-41d3-ad85-1af07517395a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:01.577916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041173-469d-41d3-ad85-1af07517395a None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:01.579172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041173-469d-41d3-ad85-1af07517395a None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:01.580740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041173-469d-41d3-ad85-1af07517395a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:01.582494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 86/169] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:01 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:01.583336 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041173-469d-41d3-ad85-1af07517395a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:01.585685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73820d1-34c3-435e-bd85-30ab568a6a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-e73820d1-34c3-435e-bd85-30ab568a6a41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:01.592448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:01.593384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:01.594155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:01.594155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:01.594155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:01.594155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:01.594155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:01.594155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:01.594155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:01.594155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:01.594155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:01.594155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:01.594155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:01.594155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:01.596533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 84/170] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:10:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:01.597843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73820d1-34c3-435e-bd85-30ab568a6a41 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:01.614028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:01.711306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73820d1-34c3-435e-bd85-30ab568a6a41 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:01.751599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb48bb0-efe6-4795-99a2-54e9daad5741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:01.752625 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb48bb0-efe6-4795-99a2-54e9daad5741 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:01.753122 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb48bb0-efe6-4795-99a2-54e9daad5741 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:01.753585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb48bb0-efe6-4795-99a2-54e9daad5741 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362/users/75b122b5019b44c384e9446585fcdd26/roles/f95d8b8d42f2490c8085f32706af9823` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:01.756193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb48bb0-efe6-4795-99a2-54e9daad5741 None admin] RBAC: Authorizing `identity:create_grant(project_id=0565423b088f492581b9dc3e0ad10362, user_id=75b122b5019b44c384e9446585fcdd26, role_id=f95d8b8d42f2490c8085f32706af9823)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:01.758003 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb48bb0-efe6-4795-99a2-54e9daad5741 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:01.784558 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 85/171] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:10:01 2022] PUT /identity/v3/projects/0565423b088f492581b9dc3e0ad10362/users/75b122b5019b44c384e9446585fcdd26/roles/f95d8b8d42f2490c8085f32706af9823 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:01.785543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb48bb0-efe6-4795-99a2-54e9daad5741 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:01.812846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041173-469d-41d3-ad85-1af07517395a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:01.889249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:01.897918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92999f-4a3b-452c-9ef9-ede7a0e1344b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:01.898583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92999f-4a3b-452c-9ef9-ede7a0e1344b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:01.898862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92999f-4a3b-452c-9ef9-ede7a0e1344b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:01.899133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92999f-4a3b-452c-9ef9-ede7a0e1344b None admin] PATH_INFO: `/v3/users/d399c8932dea4a31a881e6ab6d908c9f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:01.902127 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92999f-4a3b-452c-9ef9-ede7a0e1344b None admin] RBAC: Authorizing `identity:get_user(user_id=d399c8932dea4a31a881e6ab6d908c9f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:01.903981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92999f-4a3b-452c-9ef9-ede7a0e1344b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:01.911932 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 87/172] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:01 2022] GET /identity/v3/users/d399c8932dea4a31a881e6ab6d908c9f => generated 275 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:01.913011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92999f-4a3b-452c-9ef9-ede7a0e1344b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:02.013083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb48bb0-efe6-4795-99a2-54e9daad5741 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:02.045450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:02.064130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92999f-4a3b-452c-9ef9-ede7a0e1344b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:02.084969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb25238-f09c-4f4c-945d-95a77fd29f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:02.085605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb25238-f09c-4f4c-945d-95a77fd29f2c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:02.085885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb25238-f09c-4f4c-945d-95a77fd29f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:02.086159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb25238-f09c-4f4c-945d-95a77fd29f2c None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:02.086840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb25238-f09c-4f4c-945d-95a77fd29f2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:02.087147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb25238-f09c-4f4c-945d-95a77fd29f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:02.088743 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb25238-f09c-4f4c-945d-95a77fd29f2c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:02.103062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855790cd-56e5-4f1b-b22f-5cf7143b3ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:02.103740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 86/173] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:02.104014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855790cd-56e5-4f1b-b22f-5cf7143b3ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:02.104306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855790cd-56e5-4f1b-b22f-5cf7143b3ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:02.104661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855790cd-56e5-4f1b-b22f-5cf7143b3ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:02.110219 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb25238-f09c-4f4c-945d-95a77fd29f2c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:02.187610 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855790cd-56e5-4f1b-b22f-5cf7143b3ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:02.189201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855790cd-56e5-4f1b-b22f-5cf7143b3ff8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:02.289432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:02.307794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 88/174] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:02.309960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb25238-f09c-4f4c-945d-95a77fd29f2c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:02.313423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855790cd-56e5-4f1b-b22f-5cf7143b3ff8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:02.316461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:02.384589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234bd48-66ca-43d8-ae3a-6b0b9b6c7ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:02.385629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234bd48-66ca-43d8-ae3a-6b0b9b6c7ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:02.386083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234bd48-66ca-43d8-ae3a-6b0b9b6c7ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:02.386664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234bd48-66ca-43d8-ae3a-6b0b9b6c7ca8 None admin] PATH_INFO: `/v3/users/d399c8932dea4a31a881e6ab6d908c9f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:02.390472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234bd48-66ca-43d8-ae3a-6b0b9b6c7ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=d399c8932dea4a31a881e6ab6d908c9f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:02.392233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234bd48-66ca-43d8-ae3a-6b0b9b6c7ca8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:02.394258 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 87/175] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:02 2022] GET /identity/v3/users/d399c8932dea4a31a881e6ab6d908c9f => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:02.400013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234bd48-66ca-43d8-ae3a-6b0b9b6c7ca8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:02.427839 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855790cd-56e5-4f1b-b22f-5cf7143b3ff8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:02.467457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ffac1-6551-4f00-b05a-424e3b8f7d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:02.468253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ffac1-6551-4f00-b05a-424e3b8f7d58 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:02.468617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ffac1-6551-4f00-b05a-424e3b8f7d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:02.469292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ffac1-6551-4f00-b05a-424e3b8f7d58 None admin] PATH_INFO: `/v3/projects/e901e6cdae814ddc83f31c92808732d8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:02.470641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ffac1-6551-4f00-b05a-424e3b8f7d58 None admin] RBAC: Authorizing `identity:get_project(project_id=e901e6cdae814ddc83f31c92808732d8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:02.472324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ffac1-6551-4f00-b05a-424e3b8f7d58 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:02.474933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 89/176] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:02 2022] GET /identity/v3/projects/e901e6cdae814ddc83f31c92808732d8 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:02.480427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ffac1-6551-4f00-b05a-424e3b8f7d58 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:02.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:02.591218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ffac1-6551-4f00-b05a-424e3b8f7d58 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:02.628212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6738ff-c5f7-4292-b6d4-2d66f7d47782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:02.628870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6738ff-c5f7-4292-b6d4-2d66f7d47782 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:02.629189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6738ff-c5f7-4292-b6d4-2d66f7d47782 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:02.629469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6738ff-c5f7-4292-b6d4-2d66f7d47782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:02.630301 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6738ff-c5f7-4292-b6d4-2d66f7d47782 None admin] RBAC: Adding query filter params (role.id=b7d5979aed50487cbf98896a6fa6f162, scope.project.id=e901e6cdae814ddc83f31c92808732d8, user.id=d399c8932dea4a31a881e6ab6d908c9f) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:02.630621 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6738ff-c5f7-4292-b6d4-2d66f7d47782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:02.632089 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6738ff-c5f7-4292-b6d4-2d66f7d47782 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:02.639215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 90/177] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:02 2022] GET /identity/v3/role_assignments?user.id=d399c8932dea4a31a881e6ab6d908c9f&scope.project.id=e901e6cdae814ddc83f31c92808732d8&role.id=b7d5979aed50487cbf98896a6fa6f162 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:02.659249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234bd48-66ca-43d8-ae3a-6b0b9b6c7ca8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:02.718413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59089d61-326c-40dc-b6f8-136184a235b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:02.719448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59089d61-326c-40dc-b6f8-136184a235b2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:02.719944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59089d61-326c-40dc-b6f8-136184a235b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:02.720421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59089d61-326c-40dc-b6f8-136184a235b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:02.797755 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:02.871569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59089d61-326c-40dc-b6f8-136184a235b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:02.873450 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59089d61-326c-40dc-b6f8-136184a235b2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:02.985138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 88/178] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 18:10:02.991185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6738ff-c5f7-4292-b6d4-2d66f7d47782 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:03.103379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6738ff-c5f7-4292-b6d4-2d66f7d47782 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:03.126505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:03.148202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370a009-9349-4f0b-9375-1e97cae3b7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:03.149352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370a009-9349-4f0b-9375-1e97cae3b7ff None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:03.149872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370a009-9349-4f0b-9375-1e97cae3b7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:03.150351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370a009-9349-4f0b-9375-1e97cae3b7ff None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:03.151870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370a009-9349-4f0b-9375-1e97cae3b7ff None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:03.153602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370a009-9349-4f0b-9375-1e97cae3b7ff None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:03.155775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 91/179] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:02 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:03.162123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59089d61-326c-40dc-b6f8-136184a235b2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:03.242158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:03.278457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59089d61-326c-40dc-b6f8-136184a235b2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:03.321831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b188-6d14-4b03-8152-596cfa7c212f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:03.322862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b188-6d14-4b03-8152-596cfa7c212f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:03.323351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b188-6d14-4b03-8152-596cfa7c212f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:03.323917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b188-6d14-4b03-8152-596cfa7c212f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:03.324917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b188-6d14-4b03-8152-596cfa7c212f None admin] RBAC: Adding query filter params (role.id=db4150b658a14804af1bf240ea2e31f9, scope.project.id=0565423b088f492581b9dc3e0ad10362, user.id=d399c8932dea4a31a881e6ab6d908c9f) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:03.325442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b188-6d14-4b03-8152-596cfa7c212f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:03.327101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b188-6d14-4b03-8152-596cfa7c212f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:03.334354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 89/180] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:03 2022] GET /identity/v3/role_assignments?user.id=d399c8932dea4a31a881e6ab6d908c9f&scope.project.id=0565423b088f492581b9dc3e0ad10362&role.id=db4150b658a14804af1bf240ea2e31f9 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:03.377970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa0d17-f54a-4b6d-9dbc-9b1545fd3fb2 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:03.378595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa0d17-f54a-4b6d-9dbc-9b1545fd3fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:03.379088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa0d17-f54a-4b6d-9dbc-9b1545fd3fb2 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:03.380676 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 92/181] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:03.386496 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc5785-b64d-4409-b6bf-33d20f03e5f7 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:03.387096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc5785-b64d-4409-b6bf-33d20f03e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:03.387565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc5785-b64d-4409-b6bf-33d20f03e5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:03.411982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cbcc5785-b64d-4409-b6bf-33d20f03e5f7 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:03.413601 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cbcc5785-b64d-4409-b6bf-33d20f03e5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:03.500926 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 90/182] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:03.638928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc0948-01d3-4267-aeba-1c9262bc14d8 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:03.639452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc0948-01d3-4267-aeba-1c9262bc14d8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:03.639642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc0948-01d3-4267-aeba-1c9262bc14d8 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:03.641267 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 93/183] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:03.646900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09566226-7b0d-41b2-bedb-f98fcc42f71c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:03.647185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09566226-7b0d-41b2-bedb-f98fcc42f71c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:03.647460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09566226-7b0d-41b2-bedb-f98fcc42f71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:03.668636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-09566226-7b0d-41b2-bedb-f98fcc42f71c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:03.669868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-09566226-7b0d-41b2-bedb-f98fcc42f71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:03.732032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:03.741494 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 91/184] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:03.817892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc0948-01d3-4267-aeba-1c9262bc14d8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:03.925490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc0948-01d3-4267-aeba-1c9262bc14d8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:03.967826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68509c-57dc-467d-88f0-132f8cf4a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:03.968705 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68509c-57dc-467d-88f0-132f8cf4a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:03.969160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68509c-57dc-467d-88f0-132f8cf4a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:03.969584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68509c-57dc-467d-88f0-132f8cf4a7d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:03.981054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68509c-57dc-467d-88f0-132f8cf4a7d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-db68509c-57dc-467d-88f0-132f8cf4a7d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:03.985863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:03.986788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:03.987601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 94/185] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:10:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:10:03.994102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09566226-7b0d-41b2-bedb-f98fcc42f71c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:04.061609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68509c-57dc-467d-88f0-132f8cf4a7d4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:04.113086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:04.113549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09566226-7b0d-41b2-bedb-f98fcc42f71c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:04.158133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75bdc3-9960-4adb-93e2-d241e52398c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:04.159369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75bdc3-9960-4adb-93e2-d241e52398c5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:04.159659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75bdc3-9960-4adb-93e2-d241e52398c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:04.159933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75bdc3-9960-4adb-93e2-d241e52398c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:04.160613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75bdc3-9960-4adb-93e2-d241e52398c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:04.160940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75bdc3-9960-4adb-93e2-d241e52398c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:04.163052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75bdc3-9960-4adb-93e2-d241e52398c5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:04.171643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68509c-57dc-467d-88f0-132f8cf4a7d4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:04.174295 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 92/186] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:04.179820 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75bdc3-9960-4adb-93e2-d241e52398c5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:04.213284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62f58c-6896-49b8-a2cf-efea034904a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:04.214521 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f58c-6896-49b8-a2cf-efea034904a0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:04.215321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f58c-6896-49b8-a2cf-efea034904a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:04.215794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f58c-6896-49b8-a2cf-efea034904a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:04.228209 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62f58c-6896-49b8-a2cf-efea034904a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-ee62f58c-6896-49b8-a2cf-efea034904a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:04.234730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:04.235668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:04.236443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:04.236443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:04.236443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:04.236443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:04.236443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:04.236443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:04.236443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:04.236443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:04.236443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:04.236443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:04.236443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:10:04.236443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:04.244061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:04.244401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 95/187] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:10:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:10:04.245590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62f58c-6896-49b8-a2cf-efea034904a0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:04.283712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75bdc3-9960-4adb-93e2-d241e52398c5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:04.319445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63efabe-24b9-47e6-9cc1-c807b6e018da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:04.320088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63efabe-24b9-47e6-9cc1-c807b6e018da None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:04.320365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63efabe-24b9-47e6-9cc1-c807b6e018da None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:04.320636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63efabe-24b9-47e6-9cc1-c807b6e018da None admin] PATH_INFO: `/v3/users/270cc73d880844eeaeb8b1428d37bb11` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:04.340343 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63efabe-24b9-47e6-9cc1-c807b6e018da None admin] RBAC: Authorizing `identity:get_user(user_id=270cc73d880844eeaeb8b1428d37bb11)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:04.341995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63efabe-24b9-47e6-9cc1-c807b6e018da None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:04.343721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 93/188] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:04 2022] GET /identity/v3/users/270cc73d880844eeaeb8b1428d37bb11 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:04.344950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb425-0f09-4dc2-875c-6d72f7e359ce None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:04.345236 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb425-0f09-4dc2-875c-6d72f7e359ce None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:04.345512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb425-0f09-4dc2-875c-6d72f7e359ce None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:04.346871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 94/189] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:04.351989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb425-0f09-4dc2-875c-6d72f7e359ce None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:04.359635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62f58c-6896-49b8-a2cf-efea034904a0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:04.369718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:04.397766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adef19e-9837-425e-bd00-0d7e88939f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:04.398389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adef19e-9837-425e-bd00-0d7e88939f10 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:04.398668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adef19e-9837-425e-bd00-0d7e88939f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:04.398940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adef19e-9837-425e-bd00-0d7e88939f10 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:04.399603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adef19e-9837-425e-bd00-0d7e88939f10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:04.399909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adef19e-9837-425e-bd00-0d7e88939f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:04.401362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adef19e-9837-425e-bd00-0d7e88939f10 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:04.412759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 96/190] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:04.412759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4386a-752f-408a-a972-a4e913133d3c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:04.412759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4386a-752f-408a-a972-a4e913133d3c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:04.412759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4386a-752f-408a-a972-a4e913133d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:04.430995 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9aa4386a-752f-408a-a972-a4e913133d3c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:04.432119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9aa4386a-752f-408a-a972-a4e913133d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:04.469744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb425-0f09-4dc2-875c-6d72f7e359ce None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:04.486305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:04.500760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 97/191] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:04.501624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4386a-752f-408a-a972-a4e913133d3c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:04.507782 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edb534-2945-43c1-a180-62ced243068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:04.508398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb534-2945-43c1-a180-62ced243068f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:04.508678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb534-2945-43c1-a180-62ced243068f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:04.508978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb534-2945-43c1-a180-62ced243068f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:04.583605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edb534-2945-43c1-a180-62ced243068f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:04.585385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edb534-2945-43c1-a180-62ced243068f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:04.603089 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:04.606477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4386a-752f-408a-a972-a4e913133d3c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:04.643069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5ec19-e10b-4777-b5ed-10143444c36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:04.644429 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5ec19-e10b-4777-b5ed-10143444c36f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:04.644703 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5ec19-e10b-4777-b5ed-10143444c36f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:04.645003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5ec19-e10b-4777-b5ed-10143444c36f None admin] PATH_INFO: `/v3/users/270cc73d880844eeaeb8b1428d37bb11` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:04.646155 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5ec19-e10b-4777-b5ed-10143444c36f None admin] RBAC: Authorizing `identity:get_user(user_id=270cc73d880844eeaeb8b1428d37bb11)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:04.647614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5ec19-e10b-4777-b5ed-10143444c36f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:04.649410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 98/192] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:04 2022] GET /identity/v3/users/270cc73d880844eeaeb8b1428d37bb11 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:04.650656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545db4-6ff9-493f-9fa4-35fc8458992a None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:04.650933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545db4-6ff9-493f-9fa4-35fc8458992a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:04.651210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545db4-6ff9-493f-9fa4-35fc8458992a None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:04.653008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 99/193] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:04.659755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545db4-6ff9-493f-9fa4-35fc8458992a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:04.700801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 95/194] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:04.700801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c73bf0-26ed-4b52-8416-8d7000e10f4f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:04.700801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c73bf0-26ed-4b52-8416-8d7000e10f4f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:04.700801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c73bf0-26ed-4b52-8416-8d7000e10f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:04.716141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-67c73bf0-26ed-4b52-8416-8d7000e10f4f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:04.717361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-67c73bf0-26ed-4b52-8416-8d7000e10f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:04.728635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:04.775171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545db4-6ff9-493f-9fa4-35fc8458992a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:04.788443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 96/195] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:04.789354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c73bf0-26ed-4b52-8416-8d7000e10f4f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:04.809907 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54eeb8a-1e15-4ada-9107-c0c162a80062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:04.810647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54eeb8a-1e15-4ada-9107-c0c162a80062 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:04.810935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54eeb8a-1e15-4ada-9107-c0c162a80062 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:04.811214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54eeb8a-1e15-4ada-9107-c0c162a80062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:04.851022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:04.887324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54eeb8a-1e15-4ada-9107-c0c162a80062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:04.888842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54eeb8a-1e15-4ada-9107-c0c162a80062 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:04.908433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c73bf0-26ed-4b52-8416-8d7000e10f4f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:04.945301 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e77d4-f353-45bd-85cc-8f460d77de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:04.945929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e77d4-f353-45bd-85cc-8f460d77de63 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:04.946209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e77d4-f353-45bd-85cc-8f460d77de63 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:04.946482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e77d4-f353-45bd-85cc-8f460d77de63 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:04.947599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e77d4-f353-45bd-85cc-8f460d77de63 None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:04.949182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e77d4-f353-45bd-85cc-8f460d77de63 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:04.955846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 97/196] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:04 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:04.955846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e77d4-f353-45bd-85cc-8f460d77de63 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:04.971379 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:04.998380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 100/197] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:04.999062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54eeb8a-1e15-4ada-9107-c0c162a80062 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:05.068065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:05.072384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e77d4-f353-45bd-85cc-8f460d77de63 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:05.106347 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54eeb8a-1e15-4ada-9107-c0c162a80062 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:05.113178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b776c3f-ae01-4bdc-8b16-b5f0fd298722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:05.113849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b776c3f-ae01-4bdc-8b16-b5f0fd298722 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:05.114171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b776c3f-ae01-4bdc-8b16-b5f0fd298722 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:05.114441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b776c3f-ae01-4bdc-8b16-b5f0fd298722 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:05.115618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b776c3f-ae01-4bdc-8b16-b5f0fd298722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:05.117130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b776c3f-ae01-4bdc-8b16-b5f0fd298722 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:05.119598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 98/198] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:05.120847 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b776c3f-ae01-4bdc-8b16-b5f0fd298722 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:05.147431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a77f3-551f-42c9-9726-2213c9dc3f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:05.148059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a77f3-551f-42c9-9726-2213c9dc3f84 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:05.148343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a77f3-551f-42c9-9726-2213c9dc3f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:05.148622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a77f3-551f-42c9-9726-2213c9dc3f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:05.149408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a77f3-551f-42c9-9726-2213c9dc3f84 None admin] RBAC: Adding query filter params (role.id=db4150b658a14804af1bf240ea2e31f9, scope.project.id=7d94df893fa24cea85162a87d72139e8, user.id=270cc73d880844eeaeb8b1428d37bb11) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:05.149737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a77f3-551f-42c9-9726-2213c9dc3f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:05.151224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a77f3-551f-42c9-9726-2213c9dc3f84 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:05.157279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 101/199] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:04 2022] GET /identity/v3/role_assignments?user.id=270cc73d880844eeaeb8b1428d37bb11&scope.project.id=7d94df893fa24cea85162a87d72139e8&role.id=db4150b658a14804af1bf240ea2e31f9 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:05.158100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a77f3-551f-42c9-9726-2213c9dc3f84 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:05.238320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:05.269928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b776c3f-ae01-4bdc-8b16-b5f0fd298722 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:05.316131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a77f3-551f-42c9-9726-2213c9dc3f84 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:05.322435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32186606-d09e-4ece-8854-53d65d89a491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:05.323418 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32186606-d09e-4ece-8854-53d65d89a491 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:05.323418 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32186606-d09e-4ece-8854-53d65d89a491 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:05.323735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32186606-d09e-4ece-8854-53d65d89a491 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:05.325656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32186606-d09e-4ece-8854-53d65d89a491 None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:05.327811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32186606-d09e-4ece-8854-53d65d89a491 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:05.330491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 99/200] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:05 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:05.333659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32186606-d09e-4ece-8854-53d65d89a491 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:05.361018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:05.367089 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bad57-9b6a-449b-92cb-c2d18fea893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:05.367739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bad57-9b6a-449b-92cb-c2d18fea893a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:05.368019 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bad57-9b6a-449b-92cb-c2d18fea893a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:05.368292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bad57-9b6a-449b-92cb-c2d18fea893a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:05.381297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bad57-9b6a-449b-92cb-c2d18fea893a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-dd1bad57-9b6a-449b-92cb-c2d18fea893a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:05.387627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:05.388508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 102/201] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:05.393274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bad57-9b6a-449b-92cb-c2d18fea893a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:05.462576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32186606-d09e-4ece-8854-53d65d89a491 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:05.502369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73807049-28fb-41f3-9a06-e97bda146a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:05.503524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807049-28fb-41f3-9a06-e97bda146a9e None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:05.504103 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807049-28fb-41f3-9a06-e97bda146a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:05.506174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807049-28fb-41f3-9a06-e97bda146a9e None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:05.507001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73807049-28fb-41f3-9a06-e97bda146a9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:05.509010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73807049-28fb-41f3-9a06-e97bda146a9e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:05.538954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bad57-9b6a-449b-92cb-c2d18fea893a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:05.541476 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 100/202] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:10:05 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:10:05.542347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73807049-28fb-41f3-9a06-e97bda146a9e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:05.553136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:05.599074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab80b4-88f1-40d1-acd1-15e5f0de1fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:05.599788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab80b4-88f1-40d1-acd1-15e5f0de1fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:05.600116 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab80b4-88f1-40d1-acd1-15e5f0de1fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:05.600406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab80b4-88f1-40d1-acd1-15e5f0de1fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:05.601264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab80b4-88f1-40d1-acd1-15e5f0de1fc4 None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=7d94df893fa24cea85162a87d72139e8, user.id=270cc73d880844eeaeb8b1428d37bb11) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:05.601582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab80b4-88f1-40d1-acd1-15e5f0de1fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:05.603268 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab80b4-88f1-40d1-acd1-15e5f0de1fc4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:05.610094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 103/203] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:05 2022] GET /identity/v3/role_assignments?user.id=270cc73d880844eeaeb8b1428d37bb11&scope.project.id=7d94df893fa24cea85162a87d72139e8&role.id=db572ad3d504403cbb227c2155c93eda => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:05.685219 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73807049-28fb-41f3-9a06-e97bda146a9e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:05.729082 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107a2cf-0375-4903-bc4d-cd7a330b4db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:05.729717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107a2cf-0375-4903-bc4d-cd7a330b4db0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:05.730102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107a2cf-0375-4903-bc4d-cd7a330b4db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:05.730381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107a2cf-0375-4903-bc4d-cd7a330b4db0 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:05.731081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107a2cf-0375-4903-bc4d-cd7a330b4db0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:05.731387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107a2cf-0375-4903-bc4d-cd7a330b4db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:05.732870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107a2cf-0375-4903-bc4d-cd7a330b4db0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:05.742836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 101/204] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:05.752644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab80b4-88f1-40d1-acd1-15e5f0de1fc4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:05.843827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:05.896112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab80b4-88f1-40d1-acd1-15e5f0de1fc4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:05.937552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab094ca-66c4-4aa3-a8ab-4c6fb5b44e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:05.938504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab094ca-66c4-4aa3-a8ab-4c6fb5b44e17 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:05.938981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab094ca-66c4-4aa3-a8ab-4c6fb5b44e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:05.939421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab094ca-66c4-4aa3-a8ab-4c6fb5b44e17 None admin] PATH_INFO: `/v3/users/75b122b5019b44c384e9446585fcdd26` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:05.941737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab094ca-66c4-4aa3-a8ab-4c6fb5b44e17 None admin] RBAC: Authorizing `identity:get_user(user_id=75b122b5019b44c384e9446585fcdd26)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:05.943387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab094ca-66c4-4aa3-a8ab-4c6fb5b44e17 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:05.945394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 104/205] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:05 2022] GET /identity/v3/users/75b122b5019b44c384e9446585fcdd26 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:05.951441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107a2cf-0375-4903-bc4d-cd7a330b4db0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:06.033480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:06.072681 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107a2cf-0375-4903-bc4d-cd7a330b4db0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:06.109252 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557ed69-6970-44e9-a700-6a5120b86725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:06.110119 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557ed69-6970-44e9-a700-6a5120b86725 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:06.110565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557ed69-6970-44e9-a700-6a5120b86725 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:06.110978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557ed69-6970-44e9-a700-6a5120b86725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:06.184875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557ed69-6970-44e9-a700-6a5120b86725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:06.186613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557ed69-6970-44e9-a700-6a5120b86725 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:06.254738 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:06.293137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 102/206] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 18:10:06.298927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab094ca-66c4-4aa3-a8ab-4c6fb5b44e17 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:06.418719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab094ca-66c4-4aa3-a8ab-4c6fb5b44e17 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:06.446299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:06.458530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6b1b2-f2a4-40c5-8c8b-dddd0f141ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:06.459399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6b1b2-f2a4-40c5-8c8b-dddd0f141ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:06.459843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6b1b2-f2a4-40c5-8c8b-dddd0f141ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:06.460250 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6b1b2-f2a4-40c5-8c8b-dddd0f141ea4 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:06.461577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6b1b2-f2a4-40c5-8c8b-dddd0f141ea4 None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:06.463239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6b1b2-f2a4-40c5-8c8b-dddd0f141ea4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:06.465101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 105/207] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:06 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:06.471144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557ed69-6970-44e9-a700-6a5120b86725 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:06.587857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557ed69-6970-44e9-a700-6a5120b86725 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:06.644854 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eaddd-5f7d-4cfb-80f6-14cb33fb1b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:06.646253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eaddd-5f7d-4cfb-80f6-14cb33fb1b70 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:06.646982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eaddd-5f7d-4cfb-80f6-14cb33fb1b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:06.647692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eaddd-5f7d-4cfb-80f6-14cb33fb1b70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:06.649254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eaddd-5f7d-4cfb-80f6-14cb33fb1b70 None admin] RBAC: Adding query filter params (role.id=f95d8b8d42f2490c8085f32706af9823, scope.project.id=0565423b088f492581b9dc3e0ad10362, user.id=75b122b5019b44c384e9446585fcdd26) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:06.650010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eaddd-5f7d-4cfb-80f6-14cb33fb1b70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:06.652695 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eaddd-5f7d-4cfb-80f6-14cb33fb1b70 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:06.663501 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 103/208] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:06 2022] GET /identity/v3/role_assignments?user.id=75b122b5019b44c384e9446585fcdd26&scope.project.id=0565423b088f492581b9dc3e0ad10362&role.id=f95d8b8d42f2490c8085f32706af9823 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:07.188018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ad0af-96ab-4a5e-a0b3-57e193149808 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:07.188535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ad0af-96ab-4a5e-a0b3-57e193149808 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:07.188535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ad0af-96ab-4a5e-a0b3-57e193149808 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:07.189955 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 106/209] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:07.195507 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a141be-a792-46d0-a608-2ed6828b24c2 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:07.196302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a141be-a792-46d0-a608-2ed6828b24c2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:07.196581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a141be-a792-46d0-a608-2ed6828b24c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:07.223915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-34a141be-a792-46d0-a608-2ed6828b24c2 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:07.225385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-34a141be-a792-46d0-a608-2ed6828b24c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:07.259337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:07.303115 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 104/210] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:07.567968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ad0af-96ab-4a5e-a0b3-57e193149808 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:07.674509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ad0af-96ab-4a5e-a0b3-57e193149808 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:07.710126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bfa82-395e-44f5-b119-7d3afa4d8835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:07.711173 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bfa82-395e-44f5-b119-7d3afa4d8835 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:07.711648 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bfa82-395e-44f5-b119-7d3afa4d8835 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:07.712111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bfa82-395e-44f5-b119-7d3afa4d8835 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:07.723658 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bfa82-395e-44f5-b119-7d3afa4d8835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-395bfa82-395e-44f5-b119-7d3afa4d8835 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:07.728835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:07.729687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:07.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:07.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:07.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:07.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:07.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:07.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:07.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:07.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:07.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:07.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:07.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:07.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:07.733183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 107/211] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:10:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:07.740685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a141be-a792-46d0-a608-2ed6828b24c2 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:07.802225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b40194-9811-4620-871b-d043e49aeb7b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:07.802415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b40194-9811-4620-871b-d043e49aeb7b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:07.802684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b40194-9811-4620-871b-d043e49aeb7b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:07.804304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 108/212] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:07.809551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d40e28-2842-4387-a45a-5b19765ff58d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:07.809832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d40e28-2842-4387-a45a-5b19765ff58d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:07.810111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d40e28-2842-4387-a45a-5b19765ff58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:07.828514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-24d40e28-2842-4387-a45a-5b19765ff58d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:07.829756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-24d40e28-2842-4387-a45a-5b19765ff58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:07.849639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a141be-a792-46d0-a608-2ed6828b24c2 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:07.883944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:07.888286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69746d9-d017-4c5c-a5a9-b7a0a033e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:07.889359 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69746d9-d017-4c5c-a5a9-b7a0a033e84f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:07.889838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69746d9-d017-4c5c-a5a9-b7a0a033e84f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:07.890305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69746d9-d017-4c5c-a5a9-b7a0a033e84f None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:07.891194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69746d9-d017-4c5c-a5a9-b7a0a033e84f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:07.891692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69746d9-d017-4c5c-a5a9-b7a0a033e84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:07.893441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69746d9-d017-4c5c-a5a9-b7a0a033e84f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:07.907273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 109/214] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:07.907653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 105/214] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:07.909658 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d40e28-2842-4387-a45a-5b19765ff58d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:08.012424 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d40e28-2842-4387-a45a-5b19765ff58d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:08.047420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f496bac-9362-4bff-8faf-93501e9e0bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:08.048460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f496bac-9362-4bff-8faf-93501e9e0bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.048967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f496bac-9362-4bff-8faf-93501e9e0bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.049437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f496bac-9362-4bff-8faf-93501e9e0bf3 None admin] PATH_INFO: `/v3/users/270cc73d880844eeaeb8b1428d37bb11` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.050801 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f496bac-9362-4bff-8faf-93501e9e0bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=270cc73d880844eeaeb8b1428d37bb11)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:08.052532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f496bac-9362-4bff-8faf-93501e9e0bf3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:08.054662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 110/215] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:07 2022] GET /identity/v3/users/270cc73d880844eeaeb8b1428d37bb11 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:08.062829 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69746d9-d017-4c5c-a5a9-b7a0a033e84f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:08.087181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:08.159496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d2d51-d582-4732-93c6-873442b9bd6e None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.160148 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d2d51-d582-4732-93c6-873442b9bd6e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.160426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d2d51-d582-4732-93c6-873442b9bd6e None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.162089 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 111/216] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:10:08.162962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3e6d-68a1-4939-a980-3804415370c3 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.163241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3e6d-68a1-4939-a980-3804415370c3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.163514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3e6d-68a1-4939-a980-3804415370c3 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.164363 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69746d9-d017-4c5c-a5a9-b7a0a033e84f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:08.164761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 112/217] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:08.170424 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d192c2-61f6-489e-8763-5226725a5209 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.170797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d192c2-61f6-489e-8763-5226725a5209 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.171142 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d192c2-61f6-489e-8763-5226725a5209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.190073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-43d192c2-61f6-489e-8763-5226725a5209 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:08.191276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-43d192c2-61f6-489e-8763-5226725a5209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:08.199579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba67236-8d87-4260-a4ec-631fa76b34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:08.200225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba67236-8d87-4260-a4ec-631fa76b34fa None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.200507 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba67236-8d87-4260-a4ec-631fa76b34fa None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.200816 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba67236-8d87-4260-a4ec-631fa76b34fa None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.201961 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba67236-8d87-4260-a4ec-631fa76b34fa None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:08.203444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba67236-8d87-4260-a4ec-631fa76b34fa None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:08.205146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 106/218] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:08 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:08.209191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f40c82-1c3b-4b35-a249-a7f6c25d2101 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.209475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f40c82-1c3b-4b35-a249-a7f6c25d2101 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.209745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f40c82-1c3b-4b35-a249-a7f6c25d2101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.227610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-93f40c82-1c3b-4b35-a249-a7f6c25d2101 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:08.228865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-93f40c82-1c3b-4b35-a249-a7f6c25d2101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:08.238846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:08.260407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 113/219] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:08.264652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d192c2-61f6-489e-8763-5226725a5209 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:08.298083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 107/220] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:08.308958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f40c82-1c3b-4b35-a249-a7f6c25d2101 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:08.332581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:08.373870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d192c2-61f6-489e-8763-5226725a5209 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:08.421292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8107-5d84-436f-a119-9dc2cfc9cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:08.422267 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8107-5d84-436f-a119-9dc2cfc9cbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.423016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8107-5d84-436f-a119-9dc2cfc9cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.423299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8107-5d84-436f-a119-9dc2cfc9cbc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.426542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f40c82-1c3b-4b35-a249-a7f6c25d2101 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:08.436744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f8107-5d84-436f-a119-9dc2cfc9cbc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-490f8107-5d84-436f-a119-9dc2cfc9cbc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:08.444146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:08.445095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:08.445915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:08.445915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:08.445915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:08.445915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:08.445915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:08.445915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:08.445915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:08.445915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:08.445915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:08.445915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:08.445915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:10:08.445915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:08.446508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 114/221] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:10:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:08.451649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8107-5d84-436f-a119-9dc2cfc9cbc2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:08.468611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56325020-b3a7-4139-a147-46c706bfb411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:08.469317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56325020-b3a7-4139-a147-46c706bfb411 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.469593 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56325020-b3a7-4139-a147-46c706bfb411 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.469860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56325020-b3a7-4139-a147-46c706bfb411 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8/users/270cc73d880844eeaeb8b1428d37bb11/roles/db4150b658a14804af1bf240ea2e31f9` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.472058 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56325020-b3a7-4139-a147-46c706bfb411 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d94df893fa24cea85162a87d72139e8, user_id=270cc73d880844eeaeb8b1428d37bb11, role_id=db4150b658a14804af1bf240ea2e31f9)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:08.473839 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56325020-b3a7-4139-a147-46c706bfb411 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:08.490487 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 108/222] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:10:08 2022] PUT /identity/v3/projects/7d94df893fa24cea85162a87d72139e8/users/270cc73d880844eeaeb8b1428d37bb11/roles/db4150b658a14804af1bf240ea2e31f9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:08.512454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:08.530151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56325020-b3a7-4139-a147-46c706bfb411 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:08.609594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8107-5d84-436f-a119-9dc2cfc9cbc2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:08.624588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:08.649013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56325020-b3a7-4139-a147-46c706bfb411 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:08.650154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c31e6-c810-4261-8df5-38f4f7c0e1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:08.650791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c31e6-c810-4261-8df5-38f4f7c0e1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.651068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c31e6-c810-4261-8df5-38f4f7c0e1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.651339 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c31e6-c810-4261-8df5-38f4f7c0e1c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.652087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c31e6-c810-4261-8df5-38f4f7c0e1c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:08.652386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c31e6-c810-4261-8df5-38f4f7c0e1c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:08.653926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c31e6-c810-4261-8df5-38f4f7c0e1c0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:08.665855 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 115/223] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:08.666729 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c31e6-c810-4261-8df5-38f4f7c0e1c0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:08.693361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc702c2f-a7e6-4519-a6d8-222e6dce4f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:08.694025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc702c2f-a7e6-4519-a6d8-222e6dce4f80 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.694307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc702c2f-a7e6-4519-a6d8-222e6dce4f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.694591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc702c2f-a7e6-4519-a6d8-222e6dce4f80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.706195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc702c2f-a7e6-4519-a6d8-222e6dce4f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-fc702c2f-a7e6-4519-a6d8-222e6dce4f80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:08.711525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:08.712408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:08.713249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 109/224] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:10:08.713901 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc702c2f-a7e6-4519-a6d8-222e6dce4f80 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:08.784555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c31e6-c810-4261-8df5-38f4f7c0e1c0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:08.786283 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:08.826758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3cc97-7ba1-44e4-b2bf-4f2adf0bbaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:08.827490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3cc97-7ba1-44e4-b2bf-4f2adf0bbaec None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.827957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3cc97-7ba1-44e4-b2bf-4f2adf0bbaec None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.828092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3cc97-7ba1-44e4-b2bf-4f2adf0bbaec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.829275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3cc97-7ba1-44e4-b2bf-4f2adf0bbaec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:08.830899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3cc97-7ba1-44e4-b2bf-4f2adf0bbaec None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:08.832486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 116/225] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:08.833784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc702c2f-a7e6-4519-a6d8-222e6dce4f80 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:08.837583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3cc97-7ba1-44e4-b2bf-4f2adf0bbaec None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:08.869861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27af6a1-a82b-4dcf-8bfe-ea9d99566c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:08.870632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27af6a1-a82b-4dcf-8bfe-ea9d99566c28 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.870909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27af6a1-a82b-4dcf-8bfe-ea9d99566c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.871175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27af6a1-a82b-4dcf-8bfe-ea9d99566c28 None admin] PATH_INFO: `/v3/users/270cc73d880844eeaeb8b1428d37bb11` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.872325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27af6a1-a82b-4dcf-8bfe-ea9d99566c28 None admin] RBAC: Authorizing `identity:get_user(user_id=270cc73d880844eeaeb8b1428d37bb11)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:08.873824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27af6a1-a82b-4dcf-8bfe-ea9d99566c28 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:08.875429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 110/226] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:08 2022] GET /identity/v3/users/270cc73d880844eeaeb8b1428d37bb11 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:08.876164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27af6a1-a82b-4dcf-8bfe-ea9d99566c28 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:08.890754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:08.956043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3cc97-7ba1-44e4-b2bf-4f2adf0bbaec None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:08.985900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27af6a1-a82b-4dcf-8bfe-ea9d99566c28 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:08.992923 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c177201-35d5-42c4-8e8a-3ff8c6960043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:08.993543 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c177201-35d5-42c4-8e8a-3ff8c6960043 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:08.993830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c177201-35d5-42c4-8e8a-3ff8c6960043 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:08.994086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c177201-35d5-42c4-8e8a-3ff8c6960043 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:08.994750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c177201-35d5-42c4-8e8a-3ff8c6960043 None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:08.995598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c177201-35d5-42c4-8e8a-3ff8c6960043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:08.996984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c177201-35d5-42c4-8e8a-3ff8c6960043 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:09.005934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 117/227] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:09.006565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c177201-35d5-42c4-8e8a-3ff8c6960043 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:09.029138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43790dc-d525-47af-9874-527cf723cb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:09.029924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43790dc-d525-47af-9874-527cf723cb04 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:09.030210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43790dc-d525-47af-9874-527cf723cb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:09.030477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43790dc-d525-47af-9874-527cf723cb04 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:09.031141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43790dc-d525-47af-9874-527cf723cb04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:09.032609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43790dc-d525-47af-9874-527cf723cb04 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:09.038819 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:09.059851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 111/228] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:10:08 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:10:09.070994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43790dc-d525-47af-9874-527cf723cb04 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:09.132588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c177201-35d5-42c4-8e8a-3ff8c6960043 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:09.162022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:09.178161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259431c4-dfd7-42c1-99c5-deb9b5edd9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:09.178912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259431c4-dfd7-42c1-99c5-deb9b5edd9be None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:09.179258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259431c4-dfd7-42c1-99c5-deb9b5edd9be None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:09.179599 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259431c4-dfd7-42c1-99c5-deb9b5edd9be None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:09.181095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259431c4-dfd7-42c1-99c5-deb9b5edd9be None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:09.182755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259431c4-dfd7-42c1-99c5-deb9b5edd9be None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:09.189732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 118/229] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:09 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:09.190863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259431c4-dfd7-42c1-99c5-deb9b5edd9be None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:09.212910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43790dc-d525-47af-9874-527cf723cb04 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:09.252677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b8f0e-5828-4d62-bb51-7af050f2d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:09.253640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b8f0e-5828-4d62-bb51-7af050f2d2ee None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:09.254094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b8f0e-5828-4d62-bb51-7af050f2d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:09.254367 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b8f0e-5828-4d62-bb51-7af050f2d2ee None admin] PATH_INFO: `/v3/users/ed94cef785a14f73b2ed7c7a798b0f2e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:09.272828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b8f0e-5828-4d62-bb51-7af050f2d2ee None admin] RBAC: Authorizing `identity:get_user(user_id=ed94cef785a14f73b2ed7c7a798b0f2e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:09.274681 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b8f0e-5828-4d62-bb51-7af050f2d2ee None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:09.276615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 112/230] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:09 2022] GET /identity/v3/users/ed94cef785a14f73b2ed7c7a798b0f2e => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:09.284472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b8f0e-5828-4d62-bb51-7af050f2d2ee None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:09.314510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:09.317802 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259431c4-dfd7-42c1-99c5-deb9b5edd9be None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:09.365536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a279cc4-1b9c-438e-950d-4363cc69c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:09.366217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a279cc4-1b9c-438e-950d-4363cc69c808 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:09.366497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a279cc4-1b9c-438e-950d-4363cc69c808 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:09.366822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a279cc4-1b9c-438e-950d-4363cc69c808 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8/users/270cc73d880844eeaeb8b1428d37bb11/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:09.368832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a279cc4-1b9c-438e-950d-4363cc69c808 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d94df893fa24cea85162a87d72139e8, user_id=270cc73d880844eeaeb8b1428d37bb11, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:09.370394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a279cc4-1b9c-438e-950d-4363cc69c808 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:09.387662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 119/231] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:10:09 2022] PUT /identity/v3/projects/7d94df893fa24cea85162a87d72139e8/users/270cc73d880844eeaeb8b1428d37bb11/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:10:09.419585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b8f0e-5828-4d62-bb51-7af050f2d2ee None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:09.449823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:09.463565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6c204-a6f5-4d09-97f3-cbb7532638cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:09.464347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6c204-a6f5-4d09-97f3-cbb7532638cb None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:09.464537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6c204-a6f5-4d09-97f3-cbb7532638cb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:09.464876 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6c204-a6f5-4d09-97f3-cbb7532638cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:09.545841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6c204-a6f5-4d09-97f3-cbb7532638cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:09.547563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6c204-a6f5-4d09-97f3-cbb7532638cb None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:09.665799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 113/232] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:09.671368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a279cc4-1b9c-438e-950d-4363cc69c808 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:09.828851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a279cc4-1b9c-438e-950d-4363cc69c808 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:09.879233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdf732-c294-4e07-bf97-c623ac8d5a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:09.879878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdf732-c294-4e07-bf97-c623ac8d5a45 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:09.880153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdf732-c294-4e07-bf97-c623ac8d5a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:09.880422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdf732-c294-4e07-bf97-c623ac8d5a45 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:09.881578 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdf732-c294-4e07-bf97-c623ac8d5a45 None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:09.883031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdf732-c294-4e07-bf97-c623ac8d5a45 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:09.884879 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 120/233] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:09 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:09.890774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6c204-a6f5-4d09-97f3-cbb7532638cb None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:09.930521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:10.028765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6c204-a6f5-4d09-97f3-cbb7532638cb None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:10.076280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432dea4-9140-434e-8bd8-5d96b05ab75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:10.076920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432dea4-9140-434e-8bd8-5d96b05ab75d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:10.077197 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432dea4-9140-434e-8bd8-5d96b05ab75d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:10.077455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432dea4-9140-434e-8bd8-5d96b05ab75d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:10.078183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432dea4-9140-434e-8bd8-5d96b05ab75d None admin] RBAC: Adding query filter params (role.id=b7d5979aed50487cbf98896a6fa6f162, scope.project.id=7d94df893fa24cea85162a87d72139e8, user.id=ed94cef785a14f73b2ed7c7a798b0f2e) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:10.078489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432dea4-9140-434e-8bd8-5d96b05ab75d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:10.079925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432dea4-9140-434e-8bd8-5d96b05ab75d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:10.085753 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 114/234] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:09 2022] GET /identity/v3/role_assignments?user.id=ed94cef785a14f73b2ed7c7a798b0f2e&scope.project.id=7d94df893fa24cea85162a87d72139e8&role.id=b7d5979aed50487cbf98896a6fa6f162 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:10.878800 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c13a0-7065-4666-8828-c38353fe1dde None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:10.879526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c13a0-7065-4666-8828-c38353fe1dde None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:10.879526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c13a0-7065-4666-8828-c38353fe1dde None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:10.881869 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 121/235] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:10.896909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8f95e-1164-4199-a25a-b36127ed74b4 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:10.897667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8f95e-1164-4199-a25a-b36127ed74b4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:10.897667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8f95e-1164-4199-a25a-b36127ed74b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:10.925721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-abb8f95e-1164-4199-a25a-b36127ed74b4 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:10.926906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-abb8f95e-1164-4199-a25a-b36127ed74b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:11.015316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 115/236] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:11.372939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c13a0-7065-4666-8828-c38353fe1dde None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:11.411579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:11.535286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c13a0-7065-4666-8828-c38353fe1dde None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:11.594583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d72ee-5b5c-46a0-9e1b-ed1b4a871644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:11.595657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d72ee-5b5c-46a0-9e1b-ed1b4a871644 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:11.596140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d72ee-5b5c-46a0-9e1b-ed1b4a871644 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:11.596617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d72ee-5b5c-46a0-9e1b-ed1b4a871644 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:11.615376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d72ee-5b5c-46a0-9e1b-ed1b4a871644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1b8d72ee-5b5c-46a0-9e1b-ed1b4a871644 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:11.625182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:11.626810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:11.627718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 122/237] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:10:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:11.633268 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8f95e-1164-4199-a25a-b36127ed74b4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:11.681089 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:11.796285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8f95e-1164-4199-a25a-b36127ed74b4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:11.834036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e561a-86d1-4af5-aaa4-e99bf59e29e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:11.834661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e561a-86d1-4af5-aaa4-e99bf59e29e1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:11.834937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e561a-86d1-4af5-aaa4-e99bf59e29e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:11.835207 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e561a-86d1-4af5-aaa4-e99bf59e29e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:11.835882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e561a-86d1-4af5-aaa4-e99bf59e29e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:11.836184 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e561a-86d1-4af5-aaa4-e99bf59e29e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:11.837621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e561a-86d1-4af5-aaa4-e99bf59e29e1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:11.850631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 116/238] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:11.856111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d72ee-5b5c-46a0-9e1b-ed1b4a871644 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:11.995503 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:12.015749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d72ee-5b5c-46a0-9e1b-ed1b4a871644 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:12.069708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e616d7-f3db-48d7-b1a5-dcf0dfb8cdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:12.070686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e616d7-f3db-48d7-b1a5-dcf0dfb8cdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.071160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e616d7-f3db-48d7-b1a5-dcf0dfb8cdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.071628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e616d7-f3db-48d7-b1a5-dcf0dfb8cdc9 None admin] PATH_INFO: `/v3/users/270cc73d880844eeaeb8b1428d37bb11` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.077450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e616d7-f3db-48d7-b1a5-dcf0dfb8cdc9 None admin] RBAC: Authorizing `identity:get_user(user_id=270cc73d880844eeaeb8b1428d37bb11)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:12.079143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e616d7-f3db-48d7-b1a5-dcf0dfb8cdc9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:12.081015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 123/239] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:11 2022] GET /identity/v3/users/270cc73d880844eeaeb8b1428d37bb11 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:12.086745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e561a-86d1-4af5-aaa4-e99bf59e29e1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:12.156763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd71060-358d-46ca-9fe6-37e29e77ac92 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.157544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd71060-358d-46ca-9fe6-37e29e77ac92 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.158024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd71060-358d-46ca-9fe6-37e29e77ac92 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.159998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 124/240] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:12.165405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3e598-2034-4cba-ab46-b2bacf709f6d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.166178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3e598-2034-4cba-ab46-b2bacf709f6d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.166663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3e598-2034-4cba-ab46-b2bacf709f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.188961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5cc3e598-2034-4cba-ab46-b2bacf709f6d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:12.190156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5cc3e598-2034-4cba-ab46-b2bacf709f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:12.194001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:12.219095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e561a-86d1-4af5-aaa4-e99bf59e29e1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:12.254959 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19b4f3-5a57-4f46-a1fe-c9c159c186d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:12.255505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19b4f3-5a57-4f46-a1fe-c9c159c186d8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.255788 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19b4f3-5a57-4f46-a1fe-c9c159c186d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.256063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19b4f3-5a57-4f46-a1fe-c9c159c186d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.262213 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 125/241] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:12.263305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793835f7-996a-4646-8e52-f33948d2dc2e None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.263590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793835f7-996a-4646-8e52-f33948d2dc2e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.263861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793835f7-996a-4646-8e52-f33948d2dc2e None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.272752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 126/242] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:12.272752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf27627-b5d3-48c1-b5be-72d7215622ae None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.272752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf27627-b5d3-48c1-b5be-72d7215622ae None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.272752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf27627-b5d3-48c1-b5be-72d7215622ae None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.277195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 127/243] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:12.278632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cc961-00f6-4689-9b0b-b4cb09844ac0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.278913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cc961-00f6-4689-9b0b-b4cb09844ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.279185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cc961-00f6-4689-9b0b-b4cb09844ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.298405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-079cc961-00f6-4689-9b0b-b4cb09844ac0 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:12.299607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-079cc961-00f6-4689-9b0b-b4cb09844ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:12.331651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19b4f3-5a57-4f46-a1fe-c9c159c186d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:12.333209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19b4f3-5a57-4f46-a1fe-c9c159c186d8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:12.387775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 128/244] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:12.389233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acd3cc-e4c4-4c49-a5d2-93759e50e042 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.389524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acd3cc-e4c4-4c49-a5d2-93759e50e042 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.389800 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acd3cc-e4c4-4c49-a5d2-93759e50e042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.417155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:12.426075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-83acd3cc-e4c4-4c49-a5d2-93759e50e042 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:12.427361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-83acd3cc-e4c4-4c49-a5d2-93759e50e042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:12.437273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 117/245] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:12.443536 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19b4f3-5a57-4f46-a1fe-c9c159c186d8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:12.448469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:12.550766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 129/246] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:12.551665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acd3cc-e4c4-4c49-a5d2-93759e50e042 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:12.591025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19b4f3-5a57-4f46-a1fe-c9c159c186d8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:12.631908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387eb773-8829-4649-aada-fdefe3241c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:12.632869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387eb773-8829-4649-aada-fdefe3241c8d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.633286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387eb773-8829-4649-aada-fdefe3241c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.633721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387eb773-8829-4649-aada-fdefe3241c8d None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.636194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387eb773-8829-4649-aada-fdefe3241c8d None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:12.637880 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387eb773-8829-4649-aada-fdefe3241c8d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:12.640157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 118/247] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:12 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:12.649429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387eb773-8829-4649-aada-fdefe3241c8d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:12.723693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:12.744487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acd3cc-e4c4-4c49-a5d2-93759e50e042 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:12.784192 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695c037-4f5d-4f65-b823-432cfc67f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:12.784768 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695c037-4f5d-4f65-b823-432cfc67f1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.785047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695c037-4f5d-4f65-b823-432cfc67f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.785517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695c037-4f5d-4f65-b823-432cfc67f1f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.786615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695c037-4f5d-4f65-b823-432cfc67f1f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:12.787157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387eb773-8829-4649-aada-fdefe3241c8d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:12.788072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695c037-4f5d-4f65-b823-432cfc67f1f1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:12.790059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 130/248] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:12.790451 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695c037-4f5d-4f65-b823-432cfc67f1f1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:12.807587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:12.827114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb3578-1d08-44e6-9dd1-cd84a0c323fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:12.827730 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb3578-1d08-44e6-9dd1-cd84a0c323fd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.828013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb3578-1d08-44e6-9dd1-cd84a0c323fd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.828288 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb3578-1d08-44e6-9dd1-cd84a0c323fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.829049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb3578-1d08-44e6-9dd1-cd84a0c323fd None admin] RBAC: Adding query filter params (role.id=db4150b658a14804af1bf240ea2e31f9, scope.project.id=7d94df893fa24cea85162a87d72139e8, user.id=270cc73d880844eeaeb8b1428d37bb11) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:12.829958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb3578-1d08-44e6-9dd1-cd84a0c323fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:12.830795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb3578-1d08-44e6-9dd1-cd84a0c323fd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:12.836746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 119/249] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:12 2022] GET /identity/v3/role_assignments?user.id=270cc73d880844eeaeb8b1428d37bb11&scope.project.id=7d94df893fa24cea85162a87d72139e8&role.id=db4150b658a14804af1bf240ea2e31f9 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:12.845357 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb31e0-0a25-4f6b-a801-0a66e399168a None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.845689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb31e0-0a25-4f6b-a801-0a66e399168a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.845921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb31e0-0a25-4f6b-a801-0a66e399168a None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.847553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 120/250] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:12.848429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb31e0-0a25-4f6b-a801-0a66e399168a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:12.913069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695c037-4f5d-4f65-b823-432cfc67f1f1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:12.948684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5105-13ea-44e0-ad24-29622fb690b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:12.949397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5105-13ea-44e0-ad24-29622fb690b7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:12.949674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5105-13ea-44e0-ad24-29622fb690b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:12.949949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5105-13ea-44e0-ad24-29622fb690b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:12.962753 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e5105-13ea-44e0-ad24-29622fb690b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-333e5105-13ea-44e0-ad24-29622fb690b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:12.968254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:12.969223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:12.970021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:12.970021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:12.970021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:12.970021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:12.970021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:12.970021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:12.970021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:12.970021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:12.970021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:12.970021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:12.970021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:12.970021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:12.970613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb31e0-0a25-4f6b-a801-0a66e399168a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:12.974764 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 131/251] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:12.975625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5105-13ea-44e0-ad24-29622fb690b7 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:12.985871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:13.016431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a5a28-829d-44e0-bb1b-0f47d601cd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:13.016431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a5a28-829d-44e0-bb1b-0f47d601cd62 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:13.016431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a5a28-829d-44e0-bb1b-0f47d601cd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:13.016431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a5a28-829d-44e0-bb1b-0f47d601cd62 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:13.017069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a5a28-829d-44e0-bb1b-0f47d601cd62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:13.018506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a5a28-829d-44e0-bb1b-0f47d601cd62 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:13.041897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 121/252] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:10:12 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:10:13.046010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57defb-61ed-43a1-ace0-650a865a9b0b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:13.046589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57defb-61ed-43a1-ace0-650a865a9b0b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:13.047084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57defb-61ed-43a1-ace0-650a865a9b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:13.069967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:13.070989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-bd57defb-61ed-43a1-ace0-650a865a9b0b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:13.072227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bd57defb-61ed-43a1-ace0-650a865a9b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:13.110537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5105-13ea-44e0-ad24-29622fb690b7 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:13.149926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089847c-4cd9-4df8-90b6-cd787e609bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:13.150686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089847c-4cd9-4df8-90b6-cd787e609bcc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:13.150985 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089847c-4cd9-4df8-90b6-cd787e609bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:13.151513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089847c-4cd9-4df8-90b6-cd787e609bcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:13.164770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 122/253] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:13.164770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57defb-61ed-43a1-ace0-650a865a9b0b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:13.172911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089847c-4cd9-4df8-90b6-cd787e609bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-a089847c-4cd9-4df8-90b6-cd787e609bcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:13.179107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:13.180235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:13.181075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 132/254] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:10:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:13.187105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089847c-4cd9-4df8-90b6-cd787e609bcc None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:13.294953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:13.298727 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57defb-61ed-43a1-ace0-650a865a9b0b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:13.311020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089847c-4cd9-4df8-90b6-cd787e609bcc None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:13.352611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17443a-8fec-4bde-bff8-b72c117fea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:13.353080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925051a-c324-49bc-ab9b-12593316c53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:13.353707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925051a-c324-49bc-ab9b-12593316c53a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:13.353985 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925051a-c324-49bc-ab9b-12593316c53a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:13.354250 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925051a-c324-49bc-ab9b-12593316c53a None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:13.354507 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17443a-8fec-4bde-bff8-b72c117fea03 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:13.354970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17443a-8fec-4bde-bff8-b72c117fea03 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:13.355117 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925051a-c324-49bc-ab9b-12593316c53a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:13.355334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925051a-c324-49bc-ab9b-12593316c53a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:13.355795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17443a-8fec-4bde-bff8-b72c117fea03 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:13.356660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17443a-8fec-4bde-bff8-b72c117fea03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:13.356918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925051a-c324-49bc-ab9b-12593316c53a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:13.357410 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17443a-8fec-4bde-bff8-b72c117fea03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:13.358451 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:13.359422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17443a-8fec-4bde-bff8-b72c117fea03 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:13.369814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 133/255] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:13.371195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 123/256] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:13.375226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925051a-c324-49bc-ab9b-12593316c53a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:13.376906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17443a-8fec-4bde-bff8-b72c117fea03 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:13.498505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925051a-c324-49bc-ab9b-12593316c53a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:13.502745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17443a-8fec-4bde-bff8-b72c117fea03 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:13.539441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061389ce-4499-48d4-8b0c-bc41b67a2fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:13.540093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061389ce-4499-48d4-8b0c-bc41b67a2fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:13.540376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061389ce-4499-48d4-8b0c-bc41b67a2fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:13.540650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061389ce-4499-48d4-8b0c-bc41b67a2fe3 None admin] PATH_INFO: `/v3/users/e06cb793614c4a9a9a9ae6276d9dc7ca` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:13.544217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea060f-118f-40d4-bed7-e7b3c0d863d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:13.544908 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea060f-118f-40d4-bed7-e7b3c0d863d1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:13.545243 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea060f-118f-40d4-bed7-e7b3c0d863d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:13.545461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea060f-118f-40d4-bed7-e7b3c0d863d1 None admin] PATH_INFO: `/v3/users/270cc73d880844eeaeb8b1428d37bb11` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:13.546626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea060f-118f-40d4-bed7-e7b3c0d863d1 None admin] RBAC: Authorizing `identity:get_user(user_id=270cc73d880844eeaeb8b1428d37bb11)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:13.548120 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea060f-118f-40d4-bed7-e7b3c0d863d1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:13.550062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 134/257] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:13 2022] GET /identity/v3/users/270cc73d880844eeaeb8b1428d37bb11 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:13.550850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea060f-118f-40d4-bed7-e7b3c0d863d1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:13.561265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061389ce-4499-48d4-8b0c-bc41b67a2fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=e06cb793614c4a9a9a9ae6276d9dc7ca)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:13.562877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061389ce-4499-48d4-8b0c-bc41b67a2fe3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:13.565267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 124/258] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:13 2022] GET /identity/v3/users/e06cb793614c4a9a9a9ae6276d9dc7ca => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:13.566129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061389ce-4499-48d4-8b0c-bc41b67a2fe3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:13.593170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:13.617294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:13.656117 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea060f-118f-40d4-bed7-e7b3c0d863d1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:13.687168 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061389ce-4499-48d4-8b0c-bc41b67a2fe3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:13.690248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64080f7-7e34-4ebe-b7ba-5ac9ca0522dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:13.691001 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64080f7-7e34-4ebe-b7ba-5ac9ca0522dd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:13.691377 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64080f7-7e34-4ebe-b7ba-5ac9ca0522dd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:13.691746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64080f7-7e34-4ebe-b7ba-5ac9ca0522dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:13.702896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64080f7-7e34-4ebe-b7ba-5ac9ca0522dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c64080f7-7e34-4ebe-b7ba-5ac9ca0522dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:13.708421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:13.709544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:13.710517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:13.710517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:13.710517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:13.710517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:13.710517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:13.710517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:13.710517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:13.710517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:13.710517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:13.710517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:13.710517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:13.710517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:13.717003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 135/259] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:13.718043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64080f7-7e34-4ebe-b7ba-5ac9ca0522dd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:13.724149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c5217-c62d-4b5d-b3bb-8130ae124f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:13.724801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c5217-c62d-4b5d-b3bb-8130ae124f47 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:13.725391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c5217-c62d-4b5d-b3bb-8130ae124f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:13.725767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c5217-c62d-4b5d-b3bb-8130ae124f47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:13.798610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c5217-c62d-4b5d-b3bb-8130ae124f47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:13.800078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c5217-c62d-4b5d-b3bb-8130ae124f47 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:13.820043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64080f7-7e34-4ebe-b7ba-5ac9ca0522dd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:13.843859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:13.849482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:13.859656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c679f-7a6d-4090-be1f-e2eb71a747ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:13.860276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c679f-7a6d-4090-be1f-e2eb71a747ae None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:13.860552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c679f-7a6d-4090-be1f-e2eb71a747ae None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:13.860850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c679f-7a6d-4090-be1f-e2eb71a747ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:13.919248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 125/260] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:13.920289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c5217-c62d-4b5d-b3bb-8130ae124f47 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:13.959437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c679f-7a6d-4090-be1f-e2eb71a747ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:13.960993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c679f-7a6d-4090-be1f-e2eb71a747ae None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:14.051784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c5217-c62d-4b5d-b3bb-8130ae124f47 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:14.063118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 136/261] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:14.064036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c679f-7a6d-4090-be1f-e2eb71a747ae None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:14.070086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:14.090358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:14.090870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef6df2-76d7-43a1-9371-f880e8f3f675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:14.091329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef6df2-76d7-43a1-9371-f880e8f3f675 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:14.091615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef6df2-76d7-43a1-9371-f880e8f3f675 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:14.091883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef6df2-76d7-43a1-9371-f880e8f3f675 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:14.092547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef6df2-76d7-43a1-9371-f880e8f3f675 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:14.092988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef6df2-76d7-43a1-9371-f880e8f3f675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:14.094390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef6df2-76d7-43a1-9371-f880e8f3f675 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:14.104023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 126/262] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:14.104972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef6df2-76d7-43a1-9371-f880e8f3f675 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:14.173811 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c679f-7a6d-4090-be1f-e2eb71a747ae None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:14.206831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef6df2-76d7-43a1-9371-f880e8f3f675 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:14.210724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0d9c4-9a96-453c-abb3-39053e4ff67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:14.211362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0d9c4-9a96-453c-abb3-39053e4ff67f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:14.211642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0d9c4-9a96-453c-abb3-39053e4ff67f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:14.211916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0d9c4-9a96-453c-abb3-39053e4ff67f None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:14.213087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0d9c4-9a96-453c-abb3-39053e4ff67f None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:14.214579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0d9c4-9a96-453c-abb3-39053e4ff67f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:14.216525 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 137/263] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:14 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:14.217345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0d9c4-9a96-453c-abb3-39053e4ff67f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:14.247771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0c422-d5ff-41a4-b1d7-6ab72b60b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:14.248416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0c422-d5ff-41a4-b1d7-6ab72b60b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:14.248694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0c422-d5ff-41a4-b1d7-6ab72b60b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:14.248996 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0c422-d5ff-41a4-b1d7-6ab72b60b2d7 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:14.250186 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0c422-d5ff-41a4-b1d7-6ab72b60b2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:14.251635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0c422-d5ff-41a4-b1d7-6ab72b60b2d7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:14.253309 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 127/264] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:14 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:14.254353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0c422-d5ff-41a4-b1d7-6ab72b60b2d7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:14.305417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:14.315262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:14.325269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0d9c4-9a96-453c-abb3-39053e4ff67f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:14.361726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756f2f6-5249-4f5b-9ada-d4845585df9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:14.362372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756f2f6-5249-4f5b-9ada-d4845585df9a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:14.362652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756f2f6-5249-4f5b-9ada-d4845585df9a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:14.362927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756f2f6-5249-4f5b-9ada-d4845585df9a None admin] PATH_INFO: `/v3/users/ed94cef785a14f73b2ed7c7a798b0f2e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:14.364183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756f2f6-5249-4f5b-9ada-d4845585df9a None admin] RBAC: Authorizing `identity:get_user(user_id=ed94cef785a14f73b2ed7c7a798b0f2e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:14.365686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756f2f6-5249-4f5b-9ada-d4845585df9a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:14.367352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 138/265] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:14 2022] GET /identity/v3/users/ed94cef785a14f73b2ed7c7a798b0f2e => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:14.368130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756f2f6-5249-4f5b-9ada-d4845585df9a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:14.379798 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0c422-d5ff-41a4-b1d7-6ab72b60b2d7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:14.432807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279bf6a-153e-4cd2-bead-ec78c776abb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:14.433794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279bf6a-153e-4cd2-bead-ec78c776abb2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:14.434284 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279bf6a-153e-4cd2-bead-ec78c776abb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:14.434787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279bf6a-153e-4cd2-bead-ec78c776abb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:14.435651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279bf6a-153e-4cd2-bead-ec78c776abb2 None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=7d94df893fa24cea85162a87d72139e8, user.id=270cc73d880844eeaeb8b1428d37bb11) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:14.436101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279bf6a-153e-4cd2-bead-ec78c776abb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:14.438251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279bf6a-153e-4cd2-bead-ec78c776abb2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:14.447418 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 128/266] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:14 2022] GET /identity/v3/role_assignments?user.id=270cc73d880844eeaeb8b1428d37bb11&scope.project.id=7d94df893fa24cea85162a87d72139e8&role.id=db572ad3d504403cbb227c2155c93eda => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:14.448582 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279bf6a-153e-4cd2-bead-ec78c776abb2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:14.485174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756f2f6-5249-4f5b-9ada-d4845585df9a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:14.533028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790e55f-f246-460f-94d7-0436780bb686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:14.533662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790e55f-f246-460f-94d7-0436780bb686 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:14.533941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790e55f-f246-460f-94d7-0436780bb686 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:14.534212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790e55f-f246-460f-94d7-0436780bb686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:14.535020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790e55f-f246-460f-94d7-0436780bb686 None admin] RBAC: Adding query filter params (role.id=f95d8b8d42f2490c8085f32706af9823, scope.project.id=7d94df893fa24cea85162a87d72139e8, user.id=e06cb793614c4a9a9a9ae6276d9dc7ca) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:14.535355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790e55f-f246-460f-94d7-0436780bb686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:14.537079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790e55f-f246-460f-94d7-0436780bb686 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:14.542721 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 139/267] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:14 2022] GET /identity/v3/role_assignments?user.id=e06cb793614c4a9a9a9ae6276d9dc7ca&scope.project.id=7d94df893fa24cea85162a87d72139e8&role.id=f95d8b8d42f2490c8085f32706af9823 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:14.582163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279bf6a-153e-4cd2-bead-ec78c776abb2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:14.597785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:14.633776 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298353a8-e777-4748-914f-5bcbb03fcfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:14.634786 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298353a8-e777-4748-914f-5bcbb03fcfcd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:14.635249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298353a8-e777-4748-914f-5bcbb03fcfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:14.635661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298353a8-e777-4748-914f-5bcbb03fcfcd None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:14.637469 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298353a8-e777-4748-914f-5bcbb03fcfcd None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:14.639130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298353a8-e777-4748-914f-5bcbb03fcfcd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:14.645350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 129/268] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:14 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:14.653870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790e55f-f246-460f-94d7-0436780bb686 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:14.705463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:14.786391 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790e55f-f246-460f-94d7-0436780bb686 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:14.822518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeef1e-cf0c-4853-9686-3283b58e9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:14.823210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeef1e-cf0c-4853-9686-3283b58e9a07 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:14.823492 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeef1e-cf0c-4853-9686-3283b58e9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:14.823758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeef1e-cf0c-4853-9686-3283b58e9a07 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8/users/ed94cef785a14f73b2ed7c7a798b0f2e/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:14.826717 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeef1e-cf0c-4853-9686-3283b58e9a07 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d94df893fa24cea85162a87d72139e8, user_id=ed94cef785a14f73b2ed7c7a798b0f2e, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:14.828258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeef1e-cf0c-4853-9686-3283b58e9a07 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:14.847457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 140/269] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:10:14 2022] PUT /identity/v3/projects/7d94df893fa24cea85162a87d72139e8/users/ed94cef785a14f73b2ed7c7a798b0f2e/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:15.330667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3b713-b0e0-46c4-8a3a-93a3898e8e59 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:15.330667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3b713-b0e0-46c4-8a3a-93a3898e8e59 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:15.330667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3b713-b0e0-46c4-8a3a-93a3898e8e59 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:15.331738 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 130/270] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:15.337433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99fff0-e66f-46a3-b3cc-37143e6806a8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:15.338228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99fff0-e66f-46a3-b3cc-37143e6806a8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:15.338720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99fff0-e66f-46a3-b3cc-37143e6806a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:15.358178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ee99fff0-e66f-46a3-b3cc-37143e6806a8 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:15.359713 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ee99fff0-e66f-46a3-b3cc-37143e6806a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:15.434237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 141/271] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:15.438614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafcab1-4222-4025-b683-d37e09ea7104 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:15.438888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafcab1-4222-4025-b683-d37e09ea7104 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:15.439154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafcab1-4222-4025-b683-d37e09ea7104 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:15.440811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 131/272] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:15.445948 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81746a8-fcf9-4e2a-be9b-9edec72df10b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:15.446233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81746a8-fcf9-4e2a-be9b-9edec72df10b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:15.446506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81746a8-fcf9-4e2a-be9b-9edec72df10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:15.464812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f81746a8-fcf9-4e2a-be9b-9edec72df10b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:15.465999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f81746a8-fcf9-4e2a-be9b-9edec72df10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:15.475634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:15.534991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 142/273] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:15.722427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafcab1-4222-4025-b683-d37e09ea7104 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:15.804084 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81746a8-fcf9-4e2a-be9b-9edec72df10b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:15.830495 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafcab1-4222-4025-b683-d37e09ea7104 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:15.869572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34952a-8270-4b39-a9dd-08c417df6024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:15.870326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34952a-8270-4b39-a9dd-08c417df6024 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:15.870646 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34952a-8270-4b39-a9dd-08c417df6024 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:15.871090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34952a-8270-4b39-a9dd-08c417df6024 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:15.882704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34952a-8270-4b39-a9dd-08c417df6024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ad34952a-8270-4b39-a9dd-08c417df6024 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:15.888530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:15.889462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:15.890270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 132/274] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:15.895871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34952a-8270-4b39-a9dd-08c417df6024 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:15.937559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81746a8-fcf9-4e2a-be9b-9edec72df10b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:15.948763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:15.972810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0bbcd-d689-498b-aa3e-c4224734651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:15.973986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0bbcd-d689-498b-aa3e-c4224734651f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:15.974408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0bbcd-d689-498b-aa3e-c4224734651f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:15.974816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0bbcd-d689-498b-aa3e-c4224734651f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:15.976075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0bbcd-d689-498b-aa3e-c4224734651f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:15.977714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0bbcd-d689-498b-aa3e-c4224734651f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:15.979891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 143/275] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:15.993661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0bbcd-d689-498b-aa3e-c4224734651f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:16.007281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34952a-8270-4b39-a9dd-08c417df6024 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:16.013954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:16.045191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11f4c4-bd85-482e-919d-e41aa1698cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:16.046367 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11f4c4-bd85-482e-919d-e41aa1698cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:16.046740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11f4c4-bd85-482e-919d-e41aa1698cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:16.047114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11f4c4-bd85-482e-919d-e41aa1698cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:16.047874 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11f4c4-bd85-482e-919d-e41aa1698cd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:16.048272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11f4c4-bd85-482e-919d-e41aa1698cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:16.049906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11f4c4-bd85-482e-919d-e41aa1698cd3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:16.060863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 133/276] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:16.065630 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11f4c4-bd85-482e-919d-e41aa1698cd3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:16.111248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0bbcd-d689-498b-aa3e-c4224734651f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:16.146655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165577c-dc42-4da1-a5d5-850e12a1b09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:16.147698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165577c-dc42-4da1-a5d5-850e12a1b09b None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:16.148167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165577c-dc42-4da1-a5d5-850e12a1b09b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:16.148625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165577c-dc42-4da1-a5d5-850e12a1b09b None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:16.149521 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165577c-dc42-4da1-a5d5-850e12a1b09b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:16.151235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165577c-dc42-4da1-a5d5-850e12a1b09b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:16.176764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11f4c4-bd85-482e-919d-e41aa1698cd3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:16.178683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:16.188160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 144/277] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:10:15 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:10:16.223893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d6ec5-b21a-4c49-baa6-3818863ecd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:16.224917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d6ec5-b21a-4c49-baa6-3818863ecd51 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:16.225384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d6ec5-b21a-4c49-baa6-3818863ecd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:16.225861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d6ec5-b21a-4c49-baa6-3818863ecd51 None admin] PATH_INFO: `/v3/users/242adb9f142f4d0d80a270b81b49d582` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:16.242138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d6ec5-b21a-4c49-baa6-3818863ecd51 None admin] RBAC: Authorizing `identity:get_user(user_id=242adb9f142f4d0d80a270b81b49d582)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:16.244043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d6ec5-b21a-4c49-baa6-3818863ecd51 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:16.246868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 134/278] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:16 2022] GET /identity/v3/users/242adb9f142f4d0d80a270b81b49d582 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:16.253257 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165577c-dc42-4da1-a5d5-850e12a1b09b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:16.335530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:16.372517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165577c-dc42-4da1-a5d5-850e12a1b09b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:16.407354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54712bd3-6fe0-422b-97ba-b04a50bb241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:16.408020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54712bd3-6fe0-422b-97ba-b04a50bb241e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:16.408300 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54712bd3-6fe0-422b-97ba-b04a50bb241e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:16.408566 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54712bd3-6fe0-422b-97ba-b04a50bb241e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:16.409322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54712bd3-6fe0-422b-97ba-b04a50bb241e None admin] RBAC: Adding query filter params (role.id=b7d5979aed50487cbf98896a6fa6f162, user.id=242adb9f142f4d0d80a270b81b49d582, scope.system=all) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:16.409659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54712bd3-6fe0-422b-97ba-b04a50bb241e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:16.411563 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54712bd3-6fe0-422b-97ba-b04a50bb241e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:16.418008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 145/279] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Aug 26 18:10:16 2022] GET /identity/v3/role_assignments?user.id=242adb9f142f4d0d80a270b81b49d582&scope.system=all&role.id=b7d5979aed50487cbf98896a6fa6f162 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:16.693565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036a7ac-31fd-4d31-a06a-d73c78e3ee7d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:16.694083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036a7ac-31fd-4d31-a06a-d73c78e3ee7d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:16.694083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036a7ac-31fd-4d31-a06a-d73c78e3ee7d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:16.695682 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 135/280] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:16.702983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b00f0a-15f9-42d5-bb2b-638053634b98 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:16.703268 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b00f0a-15f9-42d5-bb2b-638053634b98 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:16.703536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b00f0a-15f9-42d5-bb2b-638053634b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:16.725836 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c3b00f0a-15f9-42d5-bb2b-638053634b98 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:16.727042 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c3b00f0a-15f9-42d5-bb2b-638053634b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:16.828185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 146/281] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:17.000464 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3f8b5-4822-452a-8d69-cf21daf42319 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:17.001023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3f8b5-4822-452a-8d69-cf21daf42319 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:17.001487 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3f8b5-4822-452a-8d69-cf21daf42319 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:17.002969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 136/282] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:17.008342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a487-5c7e-467b-b6a4-79c9589fc488 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:17.008821 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a487-5c7e-467b-b6a4-79c9589fc488 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:17.009232 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a487-5c7e-467b-b6a4-79c9589fc488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:17.033535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a9e8a487-5c7e-467b-b6a4-79c9589fc488 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:17.034965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a9e8a487-5c7e-467b-b6a4-79c9589fc488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:17.107679 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:17.120322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 147/283] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:17.209801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3f8b5-4822-452a-8d69-cf21daf42319 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:17.322477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3f8b5-4822-452a-8d69-cf21daf42319 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:17.366481 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7261-01eb-416b-9512-edf96176403d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:17.367033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7261-01eb-416b-9512-edf96176403d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:17.367318 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7261-01eb-416b-9512-edf96176403d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:17.367588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7261-01eb-416b-9512-edf96176403d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:17.381685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a7261-01eb-416b-9512-edf96176403d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-670a7261-01eb-416b-9512-edf96176403d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:17.386711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:17.387592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:17.388386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 137/284] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:17.394854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8a487-5c7e-467b-b6a4-79c9589fc488 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:17.533348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8a487-5c7e-467b-b6a4-79c9589fc488 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:17.546580 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7261-01eb-416b-9512-edf96176403d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:17.583338 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a9ba4-95c5-4652-923a-9a4b0bf4f6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:17.583959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a9ba4-95c5-4652-923a-9a4b0bf4f6be None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:17.584239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a9ba4-95c5-4652-923a-9a4b0bf4f6be None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:17.584510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a9ba4-95c5-4652-923a-9a4b0bf4f6be None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:17.585206 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a9ba4-95c5-4652-923a-9a4b0bf4f6be None admin] RBAC: Adding query filter params (name=reader) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:17.585510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a9ba4-95c5-4652-923a-9a4b0bf4f6be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:17.586901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a9ba4-95c5-4652-923a-9a4b0bf4f6be None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:17.591312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:17.603469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 148/285] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:17.610887 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a9ba4-95c5-4652-923a-9a4b0bf4f6be None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:17.691427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:17.726931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a9ba4-95c5-4652-923a-9a4b0bf4f6be None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:17.760901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc9d5-f009-4104-94b6-47364a48edb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:17.761843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc9d5-f009-4104-94b6-47364a48edb0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:17.762262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc9d5-f009-4104-94b6-47364a48edb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:17.762676 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc9d5-f009-4104-94b6-47364a48edb0 None admin] PATH_INFO: `/v3/users/e06cb793614c4a9a9a9ae6276d9dc7ca` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:17.764006 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dc9d5-f009-4104-94b6-47364a48edb0 None admin] RBAC: Authorizing `identity:get_user(user_id=e06cb793614c4a9a9a9ae6276d9dc7ca)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:17.765623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dc9d5-f009-4104-94b6-47364a48edb0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:17.767663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 149/286] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:17 2022] GET /identity/v3/users/e06cb793614c4a9a9a9ae6276d9dc7ca => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:17.776767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc9d5-f009-4104-94b6-47364a48edb0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:17.778764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7261-01eb-416b-9512-edf96176403d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:17.851107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6a67d-dc7a-4c15-be8c-29f3ffe34a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:17.851762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6a67d-dc7a-4c15-be8c-29f3ffe34a86 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:17.852045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6a67d-dc7a-4c15-be8c-29f3ffe34a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:17.852317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6a67d-dc7a-4c15-be8c-29f3ffe34a86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:17.868976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6a67d-dc7a-4c15-be8c-29f3ffe34a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-fae6a67d-dc7a-4c15-be8c-29f3ffe34a86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:17.874176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:17.875035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:17.875828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 138/287] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:17.886953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6a67d-dc7a-4c15-be8c-29f3ffe34a86 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:17.978152 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc9d5-f009-4104-94b6-47364a48edb0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:18.010314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:18.031194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74625a-1f06-47cc-bc97-22b19f3c6ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:18.031843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74625a-1f06-47cc-bc97-22b19f3c6ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:18.032118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74625a-1f06-47cc-bc97-22b19f3c6ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:18.032387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74625a-1f06-47cc-bc97-22b19f3c6ba0 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:18.033630 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74625a-1f06-47cc-bc97-22b19f3c6ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:18.035102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74625a-1f06-47cc-bc97-22b19f3c6ba0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:18.036752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 150/288] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:17 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:18.044050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74625a-1f06-47cc-bc97-22b19f3c6ba0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:18.058232 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:18.090578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6a67d-dc7a-4c15-be8c-29f3ffe34a86 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:18.154015 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08a846-913f-4ee2-9c60-d1b55c91faf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:18.154631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08a846-913f-4ee2-9c60-d1b55c91faf0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:18.154906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08a846-913f-4ee2-9c60-d1b55c91faf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:18.155172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08a846-913f-4ee2-9c60-d1b55c91faf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:18.155839 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08a846-913f-4ee2-9c60-d1b55c91faf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:18.156140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08a846-913f-4ee2-9c60-d1b55c91faf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:18.157542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08a846-913f-4ee2-9c60-d1b55c91faf0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:18.170640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 139/289] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:18.173021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08a846-913f-4ee2-9c60-d1b55c91faf0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:18.232385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74625a-1f06-47cc-bc97-22b19f3c6ba0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:18.307568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69834ab6-3f57-45ec-a4d2-0c31b2237a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:18.308960 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69834ab6-3f57-45ec-a4d2-0c31b2237a10 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:18.309434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69834ab6-3f57-45ec-a4d2-0c31b2237a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:18.309893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69834ab6-3f57-45ec-a4d2-0c31b2237a10 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8/users/e06cb793614c4a9a9a9ae6276d9dc7ca/roles/f95d8b8d42f2490c8085f32706af9823` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:18.315106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69834ab6-3f57-45ec-a4d2-0c31b2237a10 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d94df893fa24cea85162a87d72139e8, user_id=e06cb793614c4a9a9a9ae6276d9dc7ca, role_id=f95d8b8d42f2490c8085f32706af9823)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:18.316884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69834ab6-3f57-45ec-a4d2-0c31b2237a10 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:18.337301 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 151/290] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:10:18 2022] PUT /identity/v3/projects/7d94df893fa24cea85162a87d72139e8/users/e06cb793614c4a9a9a9ae6276d9dc7ca/roles/f95d8b8d42f2490c8085f32706af9823 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:18.356673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08a846-913f-4ee2-9c60-d1b55c91faf0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:18.393960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ec6a0-3052-455b-ab32-e84dda3fd9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:18.395008 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ec6a0-3052-455b-ab32-e84dda3fd9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:18.395519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ec6a0-3052-455b-ab32-e84dda3fd9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:18.396026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ec6a0-3052-455b-ab32-e84dda3fd9f0 None admin] PATH_INFO: `/v3/users/ed94cef785a14f73b2ed7c7a798b0f2e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:18.397607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ec6a0-3052-455b-ab32-e84dda3fd9f0 None admin] RBAC: Authorizing `identity:get_user(user_id=ed94cef785a14f73b2ed7c7a798b0f2e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:18.399303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ec6a0-3052-455b-ab32-e84dda3fd9f0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:18.401827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 140/291] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:18 2022] GET /identity/v3/users/ed94cef785a14f73b2ed7c7a798b0f2e => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:18.409872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69834ab6-3f57-45ec-a4d2-0c31b2237a10 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:18.485065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:18.551832 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0862-a718-4e3c-b35a-7e73aa637be7 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:18.552148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0862-a718-4e3c-b35a-7e73aa637be7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:18.552382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0862-a718-4e3c-b35a-7e73aa637be7 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:18.554034 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 141/292] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:18.562979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1dc33-a26e-4f59-a990-ff5023cf5925 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:18.563279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1dc33-a26e-4f59-a990-ff5023cf5925 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:18.563591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1dc33-a26e-4f59-a990-ff5023cf5925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:18.569206 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69834ab6-3f57-45ec-a4d2-0c31b2237a10 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:18.588992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f2c1dc33-a26e-4f59-a990-ff5023cf5925 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:18.591007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f2c1dc33-a26e-4f59-a990-ff5023cf5925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:18.595756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:18.628102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40018cfb-9d79-4f72-97b7-988135fa3daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:18.629064 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40018cfb-9d79-4f72-97b7-988135fa3daa None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:18.629552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40018cfb-9d79-4f72-97b7-988135fa3daa None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:18.629835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40018cfb-9d79-4f72-97b7-988135fa3daa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:18.676755 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 142/293] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:18.701849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40018cfb-9d79-4f72-97b7-988135fa3daa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:18.703490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40018cfb-9d79-4f72-97b7-988135fa3daa None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:18.752755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:18.765985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289a7f5-f900-4502-98a8-55d37ae67a29 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:18.766290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289a7f5-f900-4502-98a8-55d37ae67a29 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:18.766532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289a7f5-f900-4502-98a8-55d37ae67a29 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:18.768133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 143/294] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:18.773563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe2b63-b0f0-4592-8c07-d81e70a5dced None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:18.773845 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe2b63-b0f0-4592-8c07-d81e70a5dced None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:18.774119 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe2b63-b0f0-4592-8c07-d81e70a5dced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:18.793068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-72fe2b63-b0f0-4592-8c07-d81e70a5dced None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:18.794367 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-72fe2b63-b0f0-4592-8c07-d81e70a5dced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:18.808345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 152/295] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:18.815695 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40018cfb-9d79-4f72-97b7-988135fa3daa None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:18.871778 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 144/296] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:18.949857 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40018cfb-9d79-4f72-97b7-988135fa3daa None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:18.962804 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe2b63-b0f0-4592-8c07-d81e70a5dced None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:18.985848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebb87-55dd-4b13-adce-490bee18f749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:18.986488 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebb87-55dd-4b13-adce-490bee18f749 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:18.986762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebb87-55dd-4b13-adce-490bee18f749 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:18.987031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebb87-55dd-4b13-adce-490bee18f749 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:18.988146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ebb87-55dd-4b13-adce-490bee18f749 None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:18.989626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ebb87-55dd-4b13-adce-490bee18f749 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:18.991568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 153/297] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:18 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:18.998549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebb87-55dd-4b13-adce-490bee18f749 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:19.025398 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:19.046236 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:19.080871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe2b63-b0f0-4592-8c07-d81e70a5dced None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:19.109915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebb87-55dd-4b13-adce-490bee18f749 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:19.116439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa68944-b6ff-4178-9368-d06faa0cd7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:19.117368 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa68944-b6ff-4178-9368-d06faa0cd7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:19.117846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa68944-b6ff-4178-9368-d06faa0cd7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:19.118311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa68944-b6ff-4178-9368-d06faa0cd7b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:19.129311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa68944-b6ff-4178-9368-d06faa0cd7b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ffa68944-b6ff-4178-9368-d06faa0cd7b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:19.134475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:19.135340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:19.136128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:19.136128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:19.136128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:19.136128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:19.136128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:19.136128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:19.136128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:19.136128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:19.136128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:19.136128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:19.136128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:19.136128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:19.143137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 145/298] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:10:19.143137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a919-b4c8-4c02-8816-d03f4e26fd8a None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:19.143137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a919-b4c8-4c02-8816-d03f4e26fd8a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:19.143137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a919-b4c8-4c02-8816-d03f4e26fd8a None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:19.144460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 146/299] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:19.145201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a919-b4c8-4c02-8816-d03f4e26fd8a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:19.150081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b131e-d20e-45ee-9092-e492cb24c837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:19.150937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b131e-d20e-45ee-9092-e492cb24c837 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:19.151422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b131e-d20e-45ee-9092-e492cb24c837 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:19.151993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b131e-d20e-45ee-9092-e492cb24c837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:19.153021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b131e-d20e-45ee-9092-e492cb24c837 None admin] RBAC: Adding query filter params (role.id=b7d5979aed50487cbf98896a6fa6f162, scope.project.id=7d94df893fa24cea85162a87d72139e8, user.id=ed94cef785a14f73b2ed7c7a798b0f2e) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:19.153496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b131e-d20e-45ee-9092-e492cb24c837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:19.155233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b131e-d20e-45ee-9092-e492cb24c837 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:19.162085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 154/300] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:18 2022] GET /identity/v3/role_assignments?user.id=ed94cef785a14f73b2ed7c7a798b0f2e&scope.project.id=7d94df893fa24cea85162a87d72139e8&role.id=b7d5979aed50487cbf98896a6fa6f162 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:19.163513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ea6d7-3db9-4909-a51c-19812471ebd3 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:19.164046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ea6d7-3db9-4909-a51c-19812471ebd3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:19.164578 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ea6d7-3db9-4909-a51c-19812471ebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:19.203036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1a9ea6d7-3db9-4909-a51c-19812471ebd3 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:19.204649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1a9ea6d7-3db9-4909-a51c-19812471ebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:19.279093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a919-b4c8-4c02-8816-d03f4e26fd8a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:19.293775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 155/301] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:19.294786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ea6d7-3db9-4909-a51c-19812471ebd3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:19.313500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:19.317095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:19.326558 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0305f-bcd9-4039-8d87-4840ee856f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:19.327592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0305f-bcd9-4039-8d87-4840ee856f88 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:19.328044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0305f-bcd9-4039-8d87-4840ee856f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:19.328537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0305f-bcd9-4039-8d87-4840ee856f88 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:19.329545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0305f-bcd9-4039-8d87-4840ee856f88 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:19.330145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0305f-bcd9-4039-8d87-4840ee856f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:19.331796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0305f-bcd9-4039-8d87-4840ee856f88 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:19.342445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 147/302] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:19.352767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0305f-bcd9-4039-8d87-4840ee856f88 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:19.414273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ea6d7-3db9-4909-a51c-19812471ebd3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:19.457649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a3440-32e4-4671-b568-a2cc08f3ad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:19.458293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a3440-32e4-4671-b568-a2cc08f3ad7b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:19.458725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a3440-32e4-4671-b568-a2cc08f3ad7b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:19.459002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a3440-32e4-4671-b568-a2cc08f3ad7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:19.468705 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0305f-bcd9-4039-8d87-4840ee856f88 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:19.474020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a3440-32e4-4671-b568-a2cc08f3ad7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-ca7a3440-32e4-4671-b568-a2cc08f3ad7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:19.479080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:19.479949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:19.480812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 156/303] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:19.489131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a3440-32e4-4671-b568-a2cc08f3ad7b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:19.516710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ccf53-0bd9-4dfd-b8bc-41d373d96b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:19.517387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ccf53-0bd9-4dfd-b8bc-41d373d96b62 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:19.517671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ccf53-0bd9-4dfd-b8bc-41d373d96b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:19.518007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ccf53-0bd9-4dfd-b8bc-41d373d96b62 None admin] PATH_INFO: `/v3/users/b369841974e64ee7aad3e29df1f68805` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:19.540148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ccf53-0bd9-4dfd-b8bc-41d373d96b62 None admin] RBAC: Authorizing `identity:get_user(user_id=b369841974e64ee7aad3e29df1f68805)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:19.543245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ccf53-0bd9-4dfd-b8bc-41d373d96b62 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:19.552939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 148/304] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:19 2022] GET /identity/v3/users/b369841974e64ee7aad3e29df1f68805 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:19.557655 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ccf53-0bd9-4dfd-b8bc-41d373d96b62 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:19.580424 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:19.616749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a3440-32e4-4671-b568-a2cc08f3ad7b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:19.666402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189efda9-80c3-400f-a299-a56ef6f48c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:19.667100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189efda9-80c3-400f-a299-a56ef6f48c15 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:19.667383 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189efda9-80c3-400f-a299-a56ef6f48c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:19.667654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189efda9-80c3-400f-a299-a56ef6f48c15 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:19.668330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189efda9-80c3-400f-a299-a56ef6f48c15 None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:19.668635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189efda9-80c3-400f-a299-a56ef6f48c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:19.670122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189efda9-80c3-400f-a299-a56ef6f48c15 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:19.671907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:19.679494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 157/305] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:19.680409 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189efda9-80c3-400f-a299-a56ef6f48c15 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:19.735254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ccf53-0bd9-4dfd-b8bc-41d373d96b62 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:19.776819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05fa10-81e0-42ad-8ea1-2ad034e805cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:19.777491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05fa10-81e0-42ad-8ea1-2ad034e805cd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:19.778264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05fa10-81e0-42ad-8ea1-2ad034e805cd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:19.778537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05fa10-81e0-42ad-8ea1-2ad034e805cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:19.779273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05fa10-81e0-42ad-8ea1-2ad034e805cd None admin] RBAC: Adding query filter params (role.id=f95d8b8d42f2490c8085f32706af9823, user.id=b369841974e64ee7aad3e29df1f68805, scope.system=all) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:19.780028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05fa10-81e0-42ad-8ea1-2ad034e805cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:19.782058 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05fa10-81e0-42ad-8ea1-2ad034e805cd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:19.797128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 149/306] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Aug 26 18:10:19 2022] GET /identity/v3/role_assignments?user.id=b369841974e64ee7aad3e29df1f68805&scope.system=all&role.id=f95d8b8d42f2490c8085f32706af9823 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:19.797128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05fa10-81e0-42ad-8ea1-2ad034e805cd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:19.803823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189efda9-80c3-400f-a299-a56ef6f48c15 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:19.842783 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d9072-310b-4a29-bf65-20588a07e38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:19.843498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d9072-310b-4a29-bf65-20588a07e38d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:19.843785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d9072-310b-4a29-bf65-20588a07e38d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:19.844058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d9072-310b-4a29-bf65-20588a07e38d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:19.845470 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d9072-310b-4a29-bf65-20588a07e38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:19.847038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d9072-310b-4a29-bf65-20588a07e38d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:19.849366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 158/307] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:19.855068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d9072-310b-4a29-bf65-20588a07e38d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:19.858448 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:19.935061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05fa10-81e0-42ad-8ea1-2ad034e805cd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:19.954945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:19.980251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d9072-310b-4a29-bf65-20588a07e38d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:19.982971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e73a8c-7225-4cb4-bae9-0ce91eed2ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:19.983684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e73a8c-7225-4cb4-bae9-0ce91eed2ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:19.984006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e73a8c-7225-4cb4-bae9-0ce91eed2ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:19.984277 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e73a8c-7225-4cb4-bae9-0ce91eed2ff6 None admin] PATH_INFO: `/v3/users/242adb9f142f4d0d80a270b81b49d582` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:19.985833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e73a8c-7225-4cb4-bae9-0ce91eed2ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=242adb9f142f4d0d80a270b81b49d582)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:19.987281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e73a8c-7225-4cb4-bae9-0ce91eed2ff6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:19.988936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 150/308] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:19 2022] GET /identity/v3/users/242adb9f142f4d0d80a270b81b49d582 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:19.994648 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e73a8c-7225-4cb4-bae9-0ce91eed2ff6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:20.030412 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5338f-56cb-495d-8930-fbe73d64457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:20.031034 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5338f-56cb-495d-8930-fbe73d64457a None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:20.031311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5338f-56cb-495d-8930-fbe73d64457a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:20.031582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5338f-56cb-495d-8930-fbe73d64457a None admin] PATH_INFO: `/v3/groups` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:20.032217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5338f-56cb-495d-8930-fbe73d64457a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:20.033812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5338f-56cb-495d-8930-fbe73d64457a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:20.057346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 159/309] 10.222.0.45 () {60 vars in 1134 bytes} [Fri Aug 26 18:10:19 2022] POST /identity/v3/groups => generated 229 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:10:20.111345 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e73a8c-7225-4cb4-bae9-0ce91eed2ff6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:20.151685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29205667-5a81-448e-ba9b-7aa733295892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:20.152922 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29205667-5a81-448e-ba9b-7aa733295892 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:20.153402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29205667-5a81-448e-ba9b-7aa733295892 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:20.153866 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29205667-5a81-448e-ba9b-7aa733295892 None admin] PATH_INFO: `/v3/system/users/242adb9f142f4d0d80a270b81b49d582/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:20.155591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29205667-5a81-448e-ba9b-7aa733295892 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=242adb9f142f4d0d80a270b81b49d582, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:20.157270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29205667-5a81-448e-ba9b-7aa733295892 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:20.168323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 151/310] 10.222.0.45 () {58 vars in 1334 bytes} [Fri Aug 26 18:10:19 2022] PUT /identity/v3/system/users/242adb9f142f4d0d80a270b81b49d582/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:20.659387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda6522-a9d1-4a72-b367-cddcde75345c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:20.659903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda6522-a9d1-4a72-b367-cddcde75345c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:20.659976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda6522-a9d1-4a72-b367-cddcde75345c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:20.661618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 160/311] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:20.666861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d98b9d-211d-4ec9-8398-18b423ee5129 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:20.667148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d98b9d-211d-4ec9-8398-18b423ee5129 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:20.667514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d98b9d-211d-4ec9-8398-18b423ee5129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:20.685756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c4d98b9d-211d-4ec9-8398-18b423ee5129 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:20.686957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c4d98b9d-211d-4ec9-8398-18b423ee5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:20.730810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:20.759968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 152/312] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:21.028635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda6522-a9d1-4a72-b367-cddcde75345c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:21.093766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:21.143660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda6522-a9d1-4a72-b367-cddcde75345c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:21.179036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac5198-903f-4093-8d82-36657284d434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:21.179722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac5198-903f-4093-8d82-36657284d434 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:21.180003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac5198-903f-4093-8d82-36657284d434 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:21.180275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac5198-903f-4093-8d82-36657284d434 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:21.191061 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac5198-903f-4093-8d82-36657284d434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c5ac5198-903f-4093-8d82-36657284d434 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:21.196547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:21.197540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:21.198958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 161/313] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:21.203998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d98b9d-211d-4ec9-8398-18b423ee5129 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:21.304116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d98b9d-211d-4ec9-8398-18b423ee5129 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:21.344015 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209837c-642a-4c0a-8e37-4905403bdd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:21.344630 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209837c-642a-4c0a-8e37-4905403bdd44 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:21.344955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209837c-642a-4c0a-8e37-4905403bdd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:21.345227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209837c-642a-4c0a-8e37-4905403bdd44 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:21.345895 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209837c-642a-4c0a-8e37-4905403bdd44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:21.346196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209837c-642a-4c0a-8e37-4905403bdd44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:21.347598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209837c-642a-4c0a-8e37-4905403bdd44 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:21.357152 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 153/314] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:21.362531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac5198-903f-4093-8d82-36657284d434 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:21.484388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac5198-903f-4093-8d82-36657284d434 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:21.520558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:21.534281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6cb0a-f483-4460-9cf6-3142703f8a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:21.534986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6cb0a-f483-4460-9cf6-3142703f8a26 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:21.535268 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6cb0a-f483-4460-9cf6-3142703f8a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:21.535591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6cb0a-f483-4460-9cf6-3142703f8a26 None admin] PATH_INFO: `/v3/users/e06cb793614c4a9a9a9ae6276d9dc7ca` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:21.536762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6cb0a-f483-4460-9cf6-3142703f8a26 None admin] RBAC: Authorizing `identity:get_user(user_id=e06cb793614c4a9a9a9ae6276d9dc7ca)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:21.538232 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6cb0a-f483-4460-9cf6-3142703f8a26 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:21.540225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 162/315] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:21 2022] GET /identity/v3/users/e06cb793614c4a9a9a9ae6276d9dc7ca => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:21.546116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209837c-642a-4c0a-8e37-4905403bdd44 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:21.588437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:21.651179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209837c-642a-4c0a-8e37-4905403bdd44 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:21.687070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfe7b6-5d04-402c-9037-99dc0984f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:21.687687 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfe7b6-5d04-402c-9037-99dc0984f598 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:21.687966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfe7b6-5d04-402c-9037-99dc0984f598 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:21.688267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfe7b6-5d04-402c-9037-99dc0984f598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:21.759005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfe7b6-5d04-402c-9037-99dc0984f598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:21.760491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfe7b6-5d04-402c-9037-99dc0984f598 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:21.800157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:21.825701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6e89-83ea-4562-9670-f20685b88735 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:21.826651 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6e89-83ea-4562-9670-f20685b88735 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:21.827146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6e89-83ea-4562-9670-f20685b88735 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:21.832701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 163/316] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:10:21.834479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52dd64-9b93-4f2f-b66a-b31925e82a40 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:21.834953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52dd64-9b93-4f2f-b66a-b31925e82a40 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:21.835436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52dd64-9b93-4f2f-b66a-b31925e82a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:21.855683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-af52dd64-9b93-4f2f-b66a-b31925e82a40 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:21.857312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-af52dd64-9b93-4f2f-b66a-b31925e82a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:21.868876 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 154/317] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:21.870828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfe7b6-5d04-402c-9037-99dc0984f598 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:21.943691 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 164/318] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:21.980273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfe7b6-5d04-402c-9037-99dc0984f598 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:22.014567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550937a7-3ef5-4608-bf4e-e82d8c40fb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:22.015204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550937a7-3ef5-4608-bf4e-e82d8c40fb5d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.015483 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550937a7-3ef5-4608-bf4e-e82d8c40fb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.015752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550937a7-3ef5-4608-bf4e-e82d8c40fb5d None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.016909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550937a7-3ef5-4608-bf4e-e82d8c40fb5d None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:22.018349 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550937a7-3ef5-4608-bf4e-e82d8c40fb5d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:22.020270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 155/319] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:21 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:22.026161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52dd64-9b93-4f2f-b66a-b31925e82a40 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:22.074547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4d04-ee74-4ed8-8e2f-d04e0e844287 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.074837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4d04-ee74-4ed8-8e2f-d04e0e844287 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.075214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4d04-ee74-4ed8-8e2f-d04e0e844287 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.076846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 156/320] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:10:22.082703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a392fbd-9609-4831-ba32-669ef371018c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.083245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a392fbd-9609-4831-ba32-669ef371018c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.083713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a392fbd-9609-4831-ba32-669ef371018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.097443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:22.103944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0a392fbd-9609-4831-ba32-669ef371018c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:22.105935 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0a392fbd-9609-4831-ba32-669ef371018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:22.138693 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52dd64-9b93-4f2f-b66a-b31925e82a40 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:22.159327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:22.174028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be81405-ad76-4e1c-8f03-7d1bfefc5be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:22.174797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be81405-ad76-4e1c-8f03-7d1bfefc5be2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.175173 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be81405-ad76-4e1c-8f03-7d1bfefc5be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.175540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be81405-ad76-4e1c-8f03-7d1bfefc5be2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.176368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be81405-ad76-4e1c-8f03-7d1bfefc5be2 None admin] RBAC: Adding query filter params (role.id=f95d8b8d42f2490c8085f32706af9823, scope.project.id=7d94df893fa24cea85162a87d72139e8, user.id=e06cb793614c4a9a9a9ae6276d9dc7ca) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:22.176802 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be81405-ad76-4e1c-8f03-7d1bfefc5be2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:22.178528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be81405-ad76-4e1c-8f03-7d1bfefc5be2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:22.191394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 165/321] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:22 2022] GET /identity/v3/role_assignments?user.id=e06cb793614c4a9a9a9ae6276d9dc7ca&scope.project.id=7d94df893fa24cea85162a87d72139e8&role.id=f95d8b8d42f2490c8085f32706af9823 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:22.196834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 157/322] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:22.215073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be81405-ad76-4e1c-8f03-7d1bfefc5be2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:22.230848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae06a73-96f1-4137-b31a-4be67d59cac8 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.231765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae06a73-96f1-4137-b31a-4be67d59cac8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.232210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae06a73-96f1-4137-b31a-4be67d59cac8 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.234152 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 158/323] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:10:22.241836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80811fe-3bb3-4595-a067-19f062acf71c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.242248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80811fe-3bb3-4595-a067-19f062acf71c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.242377 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80811fe-3bb3-4595-a067-19f062acf71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.263956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d80811fe-3bb3-4595-a067-19f062acf71c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:22.265596 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d80811fe-3bb3-4595-a067-19f062acf71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:22.338167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be81405-ad76-4e1c-8f03-7d1bfefc5be2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:22.340642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 159/324] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:22.382413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1143c1c-3508-4d67-ad1e-161dae537029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:22.382976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1143c1c-3508-4d67-ad1e-161dae537029 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.383253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1143c1c-3508-4d67-ad1e-161dae537029 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.383539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1143c1c-3508-4d67-ad1e-161dae537029 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.394096 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1143c1c-3508-4d67-ad1e-161dae537029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-f1143c1c-3508-4d67-ad1e-161dae537029 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:22.399275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:22.400125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:22.401286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 166/325] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:22.406903 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80811fe-3bb3-4595-a067-19f062acf71c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:22.455058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1143c1c-3508-4d67-ad1e-161dae537029 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:22.480501 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:22.507837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:22.529588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80811fe-3bb3-4595-a067-19f062acf71c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:22.569674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1143c1c-3508-4d67-ad1e-161dae537029 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:22.587164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a2742-58c1-46b8-98fd-c41179dbe6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:22.588203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a2742-58c1-46b8-98fd-c41179dbe6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.588698 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a2742-58c1-46b8-98fd-c41179dbe6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.589237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a2742-58c1-46b8-98fd-c41179dbe6f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.590567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a2742-58c1-46b8-98fd-c41179dbe6f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:22.591109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a2742-58c1-46b8-98fd-c41179dbe6f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:22.593656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a2742-58c1-46b8-98fd-c41179dbe6f6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:22.605063 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464800d-c2e5-4b70-8b8b-2b6453da0265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:22.605877 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464800d-c2e5-4b70-8b8b-2b6453da0265 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.606158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464800d-c2e5-4b70-8b8b-2b6453da0265 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.606430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464800d-c2e5-4b70-8b8b-2b6453da0265 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.607593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464800d-c2e5-4b70-8b8b-2b6453da0265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:22.609085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464800d-c2e5-4b70-8b8b-2b6453da0265 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:22.613752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 160/326] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:22.613752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a2742-58c1-46b8-98fd-c41179dbe6f6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:22.613946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 167/327] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:22.614737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464800d-c2e5-4b70-8b8b-2b6453da0265 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:22.717074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a2742-58c1-46b8-98fd-c41179dbe6f6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:22.718902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464800d-c2e5-4b70-8b8b-2b6453da0265 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:22.732462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:22.742648 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:22.750734 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65faad-0002-4dd1-821d-3b53c925ed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:22.751363 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65faad-0002-4dd1-821d-3b53c925ed48 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.751637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65faad-0002-4dd1-821d-3b53c925ed48 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.751904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65faad-0002-4dd1-821d-3b53c925ed48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.755145 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b6eba-1d41-49b7-89bd-7bdbbf70c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:22.755805 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b6eba-1d41-49b7-89bd-7bdbbf70c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.756087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b6eba-1d41-49b7-89bd-7bdbbf70c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.756359 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b6eba-1d41-49b7-89bd-7bdbbf70c8d1 None admin] PATH_INFO: `/v3/users/b369841974e64ee7aad3e29df1f68805` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.757503 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b6eba-1d41-49b7-89bd-7bdbbf70c8d1 None admin] RBAC: Authorizing `identity:get_user(user_id=b369841974e64ee7aad3e29df1f68805)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:22.758992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b6eba-1d41-49b7-89bd-7bdbbf70c8d1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:22.760592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 168/328] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:22 2022] GET /identity/v3/users/b369841974e64ee7aad3e29df1f68805 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:22.761881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b6eba-1d41-49b7-89bd-7bdbbf70c8d1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:22.762626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65faad-0002-4dd1-821d-3b53c925ed48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-7f65faad-0002-4dd1-821d-3b53c925ed48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:22.767944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:22.769050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:22.769823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:22.769823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:22.769823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:22.769823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:22.769823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:22.769823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:22.769823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:22.769823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:22.769823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:22.769823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:22.769823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:22.769823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:22.772853 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 161/329] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:22.774105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65faad-0002-4dd1-821d-3b53c925ed48 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:22.863672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b6eba-1d41-49b7-89bd-7bdbbf70c8d1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:22.877671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65faad-0002-4dd1-821d-3b53c925ed48 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:22.896654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61987014-e3a6-40c8-adb6-5af2eb0c5a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:22.897295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61987014-e3a6-40c8-adb6-5af2eb0c5a33 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.897570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61987014-e3a6-40c8-adb6-5af2eb0c5a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.897842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61987014-e3a6-40c8-adb6-5af2eb0c5a33 None admin] PATH_INFO: `/v3/groups` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.898480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61987014-e3a6-40c8-adb6-5af2eb0c5a33 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:22.899935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61987014-e3a6-40c8-adb6-5af2eb0c5a33 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:22.910536 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff18fd-e92f-459e-8378-e48c470dfb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:22.911209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff18fd-e92f-459e-8378-e48c470dfb52 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:22.911467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff18fd-e92f-459e-8378-e48c470dfb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:22.911739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff18fd-e92f-459e-8378-e48c470dfb52 None admin] PATH_INFO: `/v3/system/users/b369841974e64ee7aad3e29df1f68805/roles/f95d8b8d42f2490c8085f32706af9823` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:22.913178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff18fd-e92f-459e-8378-e48c470dfb52 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b369841974e64ee7aad3e29df1f68805, role_id=f95d8b8d42f2490c8085f32706af9823)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:22.914549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff18fd-e92f-459e-8378-e48c470dfb52 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:22.915621 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 169/330] 10.222.0.45 () {60 vars in 1134 bytes} [Fri Aug 26 18:10:22 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:10:22.916432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61987014-e3a6-40c8-adb6-5af2eb0c5a33 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:22.936578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 162/331] 10.222.0.45 () {58 vars in 1334 bytes} [Fri Aug 26 18:10:22 2022] PUT /identity/v3/system/users/b369841974e64ee7aad3e29df1f68805/roles/f95d8b8d42f2490c8085f32706af9823 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:22.971375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:23.046000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61987014-e3a6-40c8-adb6-5af2eb0c5a33 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:23.086129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4e22a-cc09-405d-bfb8-1a7decb1306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:23.086780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e22a-cc09-405d-bfb8-1a7decb1306b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:23.087046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e22a-cc09-405d-bfb8-1a7decb1306b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:23.087319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e22a-cc09-405d-bfb8-1a7decb1306b None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:23.088005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4e22a-cc09-405d-bfb8-1a7decb1306b None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:23.088313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4e22a-cc09-405d-bfb8-1a7decb1306b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:23.089881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4e22a-cc09-405d-bfb8-1a7decb1306b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:23.099295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 170/332] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:23.104970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff18fd-e92f-459e-8378-e48c470dfb52 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:23.160968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:23.215446 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff18fd-e92f-459e-8378-e48c470dfb52 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:23.250979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad14bc7-a821-4bb9-9dc8-3a430e35f70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:23.251586 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad14bc7-a821-4bb9-9dc8-3a430e35f70b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:23.251829 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad14bc7-a821-4bb9-9dc8-3a430e35f70b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:23.252084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad14bc7-a821-4bb9-9dc8-3a430e35f70b None admin] PATH_INFO: `/v3/users/242adb9f142f4d0d80a270b81b49d582` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:23.253373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad14bc7-a821-4bb9-9dc8-3a430e35f70b None admin] RBAC: Authorizing `identity:get_user(user_id=242adb9f142f4d0d80a270b81b49d582)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:23.254869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad14bc7-a821-4bb9-9dc8-3a430e35f70b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:23.256607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 163/333] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:23 2022] GET /identity/v3/users/242adb9f142f4d0d80a270b81b49d582 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:23.262477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4e22a-cc09-405d-bfb8-1a7decb1306b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:23.372696 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4e22a-cc09-405d-bfb8-1a7decb1306b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:23.374531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:23.410604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580d732-834e-4cf1-a69a-f34b70a4f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:23.411225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580d732-834e-4cf1-a69a-f34b70a4f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:23.411507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580d732-834e-4cf1-a69a-f34b70a4f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:23.411782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580d732-834e-4cf1-a69a-f34b70a4f3d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:23.412522 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580d732-834e-4cf1-a69a-f34b70a4f3d9 None admin] RBAC: Adding query filter params (role.id=b7d5979aed50487cbf98896a6fa6f162, user.id=242adb9f142f4d0d80a270b81b49d582, scope.system=all) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:23.412863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580d732-834e-4cf1-a69a-f34b70a4f3d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:23.414453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580d732-834e-4cf1-a69a-f34b70a4f3d9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:23.427595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 171/334] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Aug 26 18:10:23 2022] GET /identity/v3/role_assignments?user.id=242adb9f142f4d0d80a270b81b49d582&scope.system=all&role.id=b7d5979aed50487cbf98896a6fa6f162 => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:24.914204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ca41c-9a16-465e-a51b-6b79dbe4979d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:24.914717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ca41c-9a16-465e-a51b-6b79dbe4979d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:24.914717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ca41c-9a16-465e-a51b-6b79dbe4979d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:24.916304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 164/335] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:24.921791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eb289-58bf-4b8a-9669-c9a7351e05bc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:24.922662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eb289-58bf-4b8a-9669-c9a7351e05bc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:24.923143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eb289-58bf-4b8a-9669-c9a7351e05bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:24.949513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c16eb289-58bf-4b8a-9669-c9a7351e05bc None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:24.951061 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c16eb289-58bf-4b8a-9669-c9a7351e05bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:25.032514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 172/336] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:25.153551 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74105551-b260-4be7-aaf3-97e18cdd09f5 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:25.154168 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74105551-b260-4be7-aaf3-97e18cdd09f5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:25.154637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74105551-b260-4be7-aaf3-97e18cdd09f5 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:25.156447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 165/337] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:25.161927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6425a-2cfd-4e96-a25d-b930ce59895b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:25.162210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6425a-2cfd-4e96-a25d-b930ce59895b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:25.162481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6425a-2cfd-4e96-a25d-b930ce59895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:25.189765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a3a6425a-2cfd-4e96-a25d-b930ce59895b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:25.190970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a3a6425a-2cfd-4e96-a25d-b930ce59895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:25.270247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 173/338] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:25.481426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab9f4-d8b0-4ef5-bb6b-2f1ff6147a30 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:25.481766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab9f4-d8b0-4ef5-bb6b-2f1ff6147a30 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:25.481952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab9f4-d8b0-4ef5-bb6b-2f1ff6147a30 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:25.483530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 166/339] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:25.489299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce795aaf-45d9-4bfe-82bf-f9fff4f3ef41 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:25.489893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce795aaf-45d9-4bfe-82bf-f9fff4f3ef41 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:25.490357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce795aaf-45d9-4bfe-82bf-f9fff4f3ef41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:25.529815 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ce795aaf-45d9-4bfe-82bf-f9fff4f3ef41 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:25.531358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ce795aaf-45d9-4bfe-82bf-f9fff4f3ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:25.548383 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:25.564229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab9f4-d8b0-4ef5-bb6b-2f1ff6147a30 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:25.630382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 174/340] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:25.691969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab9f4-d8b0-4ef5-bb6b-2f1ff6147a30 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:25.719544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:25.740326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685505e-2ec9-44ea-ae84-bddaa6f5afa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:25.740923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685505e-2ec9-44ea-ae84-bddaa6f5afa3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:25.741204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685505e-2ec9-44ea-ae84-bddaa6f5afa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:25.741477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685505e-2ec9-44ea-ae84-bddaa6f5afa3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:25.752912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685505e-2ec9-44ea-ae84-bddaa6f5afa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:25.756351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce795aaf-45d9-4bfe-82bf-f9fff4f3ef41 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-8685505e-2ec9-44ea-ae84-bddaa6f5afa3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:25.758150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:25.759006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:25.759784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 167/341] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:25.766291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685505e-2ec9-44ea-ae84-bddaa6f5afa3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:25.884628 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685505e-2ec9-44ea-ae84-bddaa6f5afa3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:25.924372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ca0eb-75d5-41c4-a428-9791788fd887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:25.925370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ca0eb-75d5-41c4-a428-9791788fd887 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:25.925821 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ca0eb-75d5-41c4-a428-9791788fd887 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:25.926259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ca0eb-75d5-41c4-a428-9791788fd887 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:25.927325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ca0eb-75d5-41c4-a428-9791788fd887 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:25.927912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ca0eb-75d5-41c4-a428-9791788fd887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:25.929348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ca0eb-75d5-41c4-a428-9791788fd887 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:25.939338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 168/342] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:25.945945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ca0eb-75d5-41c4-a428-9791788fd887 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:25.946843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce795aaf-45d9-4bfe-82bf-f9fff4f3ef41 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:26.011524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:26.039656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1767e81-a38f-492c-80a6-d313fc651e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:26.040404 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1767e81-a38f-492c-80a6-d313fc651e12 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:26.040852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1767e81-a38f-492c-80a6-d313fc651e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:26.041133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1767e81-a38f-492c-80a6-d313fc651e12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:26.064760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1767e81-a38f-492c-80a6-d313fc651e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-f1767e81-a38f-492c-80a6-d313fc651e12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:26.070281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:26.072364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:26.074372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:26.074372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:26.074372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:26.074372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:26.074372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:26.074372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:26.074372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:26.074372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:26.074372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:26.074372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:26.074372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:26.074372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:26.080740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 175/343] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:10:26.080740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e64b24-54ba-4d09-add5-c77623316d4c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:26.080740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e64b24-54ba-4d09-add5-c77623316d4c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:26.080740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e64b24-54ba-4d09-add5-c77623316d4c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:26.082399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ca0eb-75d5-41c4-a428-9791788fd887 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:26.085021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 176/344] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:26.086732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e64b24-54ba-4d09-add5-c77623316d4c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:26.112410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:26.123979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f337a-f1f4-4fd1-b8ea-7513cf158ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:26.124964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f337a-f1f4-4fd1-b8ea-7513cf158ccb None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:26.125419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f337a-f1f4-4fd1-b8ea-7513cf158ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:26.126135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f337a-f1f4-4fd1-b8ea-7513cf158ccb None admin] PATH_INFO: `/v3/users/b369841974e64ee7aad3e29df1f68805` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:26.127623 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f337a-f1f4-4fd1-b8ea-7513cf158ccb None admin] RBAC: Authorizing `identity:get_user(user_id=b369841974e64ee7aad3e29df1f68805)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:26.129304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f337a-f1f4-4fd1-b8ea-7513cf158ccb None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:26.131387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 169/345] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:10:25 2022] GET /identity/v3/users/b369841974e64ee7aad3e29df1f68805 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:26.133038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9866db-4f13-4cd9-b0cc-3deceabe0d87 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:26.133499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9866db-4f13-4cd9-b0cc-3deceabe0d87 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:26.133945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9866db-4f13-4cd9-b0cc-3deceabe0d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:26.158548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-df9866db-4f13-4cd9-b0cc-3deceabe0d87 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:26.160513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-df9866db-4f13-4cd9-b0cc-3deceabe0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:26.255791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 170/346] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:26.256573 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e64b24-54ba-4d09-add5-c77623316d4c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:26.259092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9866db-4f13-4cd9-b0cc-3deceabe0d87 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:26.307505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cb8b8-77cf-4fe5-bad8-b5cfafa25065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:26.308059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cb8b8-77cf-4fe5-bad8-b5cfafa25065 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:26.308379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cb8b8-77cf-4fe5-bad8-b5cfafa25065 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:26.308749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cb8b8-77cf-4fe5-bad8-b5cfafa25065 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:26.309409 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7cb8b8-77cf-4fe5-bad8-b5cfafa25065 None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:26.309770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7cb8b8-77cf-4fe5-bad8-b5cfafa25065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:26.311201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7cb8b8-77cf-4fe5-bad8-b5cfafa25065 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:26.321051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 177/347] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:26.322313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cb8b8-77cf-4fe5-bad8-b5cfafa25065 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:26.330002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:26.391605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9866db-4f13-4cd9-b0cc-3deceabe0d87 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:26.406273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:26.427565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26249e26-e7c1-45f8-af5c-508b9d477468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:26.428180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26249e26-e7c1-45f8-af5c-508b9d477468 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:26.428460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26249e26-e7c1-45f8-af5c-508b9d477468 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:26.428748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26249e26-e7c1-45f8-af5c-508b9d477468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:26.429545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26249e26-e7c1-45f8-af5c-508b9d477468 None admin] RBAC: Adding query filter params (role.id=f95d8b8d42f2490c8085f32706af9823, user.id=b369841974e64ee7aad3e29df1f68805, scope.system=all) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:26.429797 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26249e26-e7c1-45f8-af5c-508b9d477468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:26.431244 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26249e26-e7c1-45f8-af5c-508b9d477468 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:26.441598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cb8b8-77cf-4fe5-bad8-b5cfafa25065 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:26.443437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 171/348] 10.222.0.45 () {56 vars in 1308 bytes} [Fri Aug 26 18:10:26 2022] GET /identity/v3/role_assignments?user.id=b369841974e64ee7aad3e29df1f68805&scope.system=all&role.id=f95d8b8d42f2490c8085f32706af9823 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:26.444277 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26249e26-e7c1-45f8-af5c-508b9d477468 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:26.483671 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81325b64-92da-476d-962f-fb1f506be3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:26.484833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81325b64-92da-476d-962f-fb1f506be3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:26.485321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81325b64-92da-476d-962f-fb1f506be3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:26.485786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81325b64-92da-476d-962f-fb1f506be3b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:26.498513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81325b64-92da-476d-962f-fb1f506be3b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-81325b64-92da-476d-962f-fb1f506be3b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:26.504555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:26.505647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:26.506441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:26.506441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:26.506441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:26.506441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:26.506441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:26.506441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:26.506441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:26.506441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:26.506441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:26.506441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:26.506441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:26.506441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:26.508926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 178/349] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:10:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:26.519043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81325b64-92da-476d-962f-fb1f506be3b3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:26.654745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:26.671400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26249e26-e7c1-45f8-af5c-508b9d477468 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:26.675522 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81325b64-92da-476d-962f-fb1f506be3b3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:26.729115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:26.732647 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02f13a-52da-4471-b383-f8fb8a822ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:26.733920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02f13a-52da-4471-b383-f8fb8a822ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:26.734400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02f13a-52da-4471-b383-f8fb8a822ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:26.734883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02f13a-52da-4471-b383-f8fb8a822ea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:26.749750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149f645-c36b-4aad-a2c0-07bb3f601b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:26.750710 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149f645-c36b-4aad-a2c0-07bb3f601b42 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:26.750999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149f645-c36b-4aad-a2c0-07bb3f601b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:26.751274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149f645-c36b-4aad-a2c0-07bb3f601b42 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:26.752249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149f645-c36b-4aad-a2c0-07bb3f601b42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:26.752561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149f645-c36b-4aad-a2c0-07bb3f601b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:26.754336 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149f645-c36b-4aad-a2c0-07bb3f601b42 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:26.772642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 179/350] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:26.772642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149f645-c36b-4aad-a2c0-07bb3f601b42 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:26.832608 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02f13a-52da-4471-b383-f8fb8a822ea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:26.834522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02f13a-52da-4471-b383-f8fb8a822ea6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:26.918264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149f645-c36b-4aad-a2c0-07bb3f601b42 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:26.954930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 172/351] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:26.955443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:26.956466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02f13a-52da-4471-b383-f8fb8a822ea6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:26.964696 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d260a6-9474-4790-938d-38c7cb9f8e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:26.965454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d260a6-9474-4790-938d-38c7cb9f8e8b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:26.965681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d260a6-9474-4790-938d-38c7cb9f8e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:26.965941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d260a6-9474-4790-938d-38c7cb9f8e8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:26.981180 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d260a6-9474-4790-938d-38c7cb9f8e8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-d6d260a6-9474-4790-938d-38c7cb9f8e8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:26.988867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:26.989772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:26.990559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 180/352] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:26.991194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d260a6-9474-4790-938d-38c7cb9f8e8b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:27.064617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:27.087516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02f13a-52da-4471-b383-f8fb8a822ea6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:27.113881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d260a6-9474-4790-938d-38c7cb9f8e8b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:27.126856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56ed67-849a-47e1-ae40-0edb0c0fdf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:27.127701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56ed67-849a-47e1-ae40-0edb0c0fdf76 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:27.128157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56ed67-849a-47e1-ae40-0edb0c0fdf76 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:27.128597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56ed67-849a-47e1-ae40-0edb0c0fdf76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:27.151934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718aa4c-f4a2-4ae5-adab-5d2276614bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:27.151934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718aa4c-f4a2-4ae5-adab-5d2276614bfe None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:27.151934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718aa4c-f4a2-4ae5-adab-5d2276614bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:27.151934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718aa4c-f4a2-4ae5-adab-5d2276614bfe None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:27.152999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718aa4c-f4a2-4ae5-adab-5d2276614bfe None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:27.156306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718aa4c-f4a2-4ae5-adab-5d2276614bfe None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:27.156584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 181/353] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:26 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:27.157423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718aa4c-f4a2-4ae5-adab-5d2276614bfe None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:27.216531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:27.221802 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56ed67-849a-47e1-ae40-0edb0c0fdf76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:27.224279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56ed67-849a-47e1-ae40-0edb0c0fdf76 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:27.281546 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718aa4c-f4a2-4ae5-adab-5d2276614bfe None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:27.307682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:27.323519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15621844-599b-43cf-99d0-4ed49e7a07b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:27.324096 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15621844-599b-43cf-99d0-4ed49e7a07b9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:27.324416 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15621844-599b-43cf-99d0-4ed49e7a07b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:27.324687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15621844-599b-43cf-99d0-4ed49e7a07b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:27.325926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15621844-599b-43cf-99d0-4ed49e7a07b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:27.326388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15621844-599b-43cf-99d0-4ed49e7a07b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:27.327816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15621844-599b-43cf-99d0-4ed49e7a07b9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:27.336970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 182/354] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:27.338396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0605ec-b597-4191-bdd5-c90533e03c42 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:27.338682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0605ec-b597-4191-bdd5-c90533e03c42 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:27.338959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0605ec-b597-4191-bdd5-c90533e03c42 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:27.340425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 183/355] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:27.342392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0605ec-b597-4191-bdd5-c90533e03c42 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:27.343187 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 173/356] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:27.344041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56ed67-849a-47e1-ae40-0edb0c0fdf76 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:27.479880 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:27.484431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56ed67-849a-47e1-ae40-0edb0c0fdf76 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:27.493512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0605ec-b597-4191-bdd5-c90533e03c42 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:27.531432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b9743-b100-4858-8a86-ae4b4fab76a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:27.532054 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b9743-b100-4858-8a86-ae4b4fab76a8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:27.532331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b9743-b100-4858-8a86-ae4b4fab76a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:27.532599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b9743-b100-4858-8a86-ae4b4fab76a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:27.544698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e95407-33b0-42e6-aefa-7aabe839cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:27.545416 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e95407-33b0-42e6-aefa-7aabe839cc3b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:27.545681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e95407-33b0-42e6-aefa-7aabe839cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:27.546470 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e95407-33b0-42e6-aefa-7aabe839cc3b None admin] PATH_INFO: `/v3/groups/1ba07586afc340838ab5ab2a97b45d92` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:27.558868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e95407-33b0-42e6-aefa-7aabe839cc3b None admin] RBAC: Authorizing `identity:get_group(group_id=1ba07586afc340838ab5ab2a97b45d92)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:27.560424 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e95407-33b0-42e6-aefa-7aabe839cc3b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:27.562333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 184/357] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:27 2022] GET /identity/v3/groups/1ba07586afc340838ab5ab2a97b45d92 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:27.562913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e95407-33b0-42e6-aefa-7aabe839cc3b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:27.615331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b9743-b100-4858-8a86-ae4b4fab76a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:27.617178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b9743-b100-4858-8a86-ae4b4fab76a8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:27.630005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:27.696357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e95407-33b0-42e6-aefa-7aabe839cc3b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:27.738125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4ed0a-5b74-423c-bf94-12350fa5d66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:27.738696 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4ed0a-5b74-423c-bf94-12350fa5d66e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:27.739164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4ed0a-5b74-423c-bf94-12350fa5d66e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:27.739314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4ed0a-5b74-423c-bf94-12350fa5d66e None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:27.741024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4ed0a-5b74-423c-bf94-12350fa5d66e None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:27.743631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4ed0a-5b74-423c-bf94-12350fa5d66e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:27.748249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 185/358] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:27 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:27.750475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddc9ad-f478-43f9-9bea-259338ad87d0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:27.750959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddc9ad-f478-43f9-9bea-259338ad87d0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:27.751442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddc9ad-f478-43f9-9bea-259338ad87d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:27.761867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:27.768930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 174/359] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:27.769629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b9743-b100-4858-8a86-ae4b4fab76a8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:27.770831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-83ddc9ad-f478-43f9-9bea-259338ad87d0 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:27.772023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-83ddc9ad-f478-43f9-9bea-259338ad87d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:27.890079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 186/360] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:27.891613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddc9ad-f478-43f9-9bea-259338ad87d0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:27.912505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b9743-b100-4858-8a86-ae4b4fab76a8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:27.956619 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:27.961777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df992-7b74-418f-9640-cc25567cd083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:27.963402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df992-7b74-418f-9640-cc25567cd083 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:27.963877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df992-7b74-418f-9640-cc25567cd083 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:27.964668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df992-7b74-418f-9640-cc25567cd083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:27.965663 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df992-7b74-418f-9640-cc25567cd083 None admin] RBAC: Adding query filter params (group.id=1ba07586afc340838ab5ab2a97b45d92, role.id=b7d5979aed50487cbf98896a6fa6f162, scope.project.id=0565423b088f492581b9dc3e0ad10362) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:27.967918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df992-7b74-418f-9640-cc25567cd083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:27.971575 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df992-7b74-418f-9640-cc25567cd083 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:27.979842 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 175/361] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 26 18:10:27 2022] GET /identity/v3/role_assignments?group.id=1ba07586afc340838ab5ab2a97b45d92&scope.project.id=0565423b088f492581b9dc3e0ad10362&role.id=b7d5979aed50487cbf98896a6fa6f162 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:27.980541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df992-7b74-418f-9640-cc25567cd083 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:28.033120 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddc9ad-f478-43f9-9bea-259338ad87d0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:28.063521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:28.074339 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96e8c6-870c-4928-a52b-7ec377a82d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:28.075380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e8c6-870c-4928-a52b-7ec377a82d5e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:28.075853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e8c6-870c-4928-a52b-7ec377a82d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:28.076355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e8c6-870c-4928-a52b-7ec377a82d5e None admin] PATH_INFO: `/v3/groups/1ba07586afc340838ab5ab2a97b45d92` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:28.077889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96e8c6-870c-4928-a52b-7ec377a82d5e None admin] RBAC: Authorizing `identity:get_group(group_id=1ba07586afc340838ab5ab2a97b45d92)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:28.079624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96e8c6-870c-4928-a52b-7ec377a82d5e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:28.081583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 187/362] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:27 2022] GET /identity/v3/groups/1ba07586afc340838ab5ab2a97b45d92 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:28.083224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b830a2f-6096-4f18-91b0-0203bbdb5029 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:28.083724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b830a2f-6096-4f18-91b0-0203bbdb5029 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:28.084177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b830a2f-6096-4f18-91b0-0203bbdb5029 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:28.089098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 188/363] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:28.090648 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b830a2f-6096-4f18-91b0-0203bbdb5029 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:28.111930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df992-7b74-418f-9640-cc25567cd083 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:28.151112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6722f2-dca0-473c-b398-76a2778608ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:28.151785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6722f2-dca0-473c-b398-76a2778608ab None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:28.152052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6722f2-dca0-473c-b398-76a2778608ab None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:28.152335 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6722f2-dca0-473c-b398-76a2778608ab None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:28.153728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6722f2-dca0-473c-b398-76a2778608ab None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:28.155302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6722f2-dca0-473c-b398-76a2778608ab None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:28.157307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 176/364] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:27 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:28.158680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901b56c-3174-4626-bae6-5cf9b0497227 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:28.159092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901b56c-3174-4626-bae6-5cf9b0497227 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:28.159358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901b56c-3174-4626-bae6-5cf9b0497227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:28.178686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4901b56c-3174-4626-bae6-5cf9b0497227 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:28.179895 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4901b56c-3174-4626-bae6-5cf9b0497227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:28.209646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b830a2f-6096-4f18-91b0-0203bbdb5029 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:28.233225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:28.263823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea16a4-b3f8-4961-a2c0-a2e3e75deccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:28.264446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea16a4-b3f8-4961-a2c0-a2e3e75deccd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:28.264786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea16a4-b3f8-4961-a2c0-a2e3e75deccd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:28.265014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea16a4-b3f8-4961-a2c0-a2e3e75deccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:28.265969 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea16a4-b3f8-4961-a2c0-a2e3e75deccd None admin] RBAC: Adding query filter params (group.id=1ba07586afc340838ab5ab2a97b45d92, role.id=db4150b658a14804af1bf240ea2e31f9, scope.project.id=0565423b088f492581b9dc3e0ad10362) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:28.266070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea16a4-b3f8-4961-a2c0-a2e3e75deccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:28.267123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 177/365] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:28.268360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea16a4-b3f8-4961-a2c0-a2e3e75deccd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:28.268477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901b56c-3174-4626-bae6-5cf9b0497227 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:28.273920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 189/366] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 26 18:10:28 2022] GET /identity/v3/role_assignments?group.id=1ba07586afc340838ab5ab2a97b45d92&scope.project.id=0565423b088f492581b9dc3e0ad10362&role.id=db4150b658a14804af1bf240ea2e31f9 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:28.274838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea16a4-b3f8-4961-a2c0-a2e3e75deccd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:28.345981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:28.406948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901b56c-3174-4626-bae6-5cf9b0497227 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:28.448049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e4bfe-2cc5-491f-ad30-68e0f2495538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:28.448735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e4bfe-2cc5-491f-ad30-68e0f2495538 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:28.449028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e4bfe-2cc5-491f-ad30-68e0f2495538 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:28.449458 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e4bfe-2cc5-491f-ad30-68e0f2495538 None admin] PATH_INFO: `/v3/groups/1ba07586afc340838ab5ab2a97b45d92` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:28.451945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e4bfe-2cc5-491f-ad30-68e0f2495538 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba07586afc340838ab5ab2a97b45d92)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:28.453459 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e4bfe-2cc5-491f-ad30-68e0f2495538 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:28.455421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 178/367] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:28 2022] GET /identity/v3/groups/1ba07586afc340838ab5ab2a97b45d92 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:28.461647 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e4bfe-2cc5-491f-ad30-68e0f2495538 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:28.520900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea16a4-b3f8-4961-a2c0-a2e3e75deccd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:28.567668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5206b9-7de1-47a5-b222-37de70f5bb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:28.568406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5206b9-7de1-47a5-b222-37de70f5bb24 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:28.568685 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5206b9-7de1-47a5-b222-37de70f5bb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:28.569022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5206b9-7de1-47a5-b222-37de70f5bb24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:28.583875 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5206b9-7de1-47a5-b222-37de70f5bb24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-be5206b9-7de1-47a5-b222-37de70f5bb24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:28.589386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:28.590356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:28.591143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 190/368] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:10:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:28.592350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e4bfe-2cc5-491f-ad30-68e0f2495538 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:28.596739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5206b9-7de1-47a5-b222-37de70f5bb24 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:28.630270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:28.641758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da395905-c1ce-429d-8b49-b04fff8335e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:28.642379 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da395905-c1ce-429d-8b49-b04fff8335e7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:28.642657 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da395905-c1ce-429d-8b49-b04fff8335e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:28.642929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da395905-c1ce-429d-8b49-b04fff8335e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:28.643669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da395905-c1ce-429d-8b49-b04fff8335e7 None admin] RBAC: Adding query filter params (group.id=1ba07586afc340838ab5ab2a97b45d92, role.id=b7d5979aed50487cbf98896a6fa6f162, scope.project.id=7d94df893fa24cea85162a87d72139e8) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:28.643975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da395905-c1ce-429d-8b49-b04fff8335e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:28.646700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da395905-c1ce-429d-8b49-b04fff8335e7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:28.651942 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:28.654337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 179/369] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 26 18:10:28 2022] GET /identity/v3/role_assignments?group.id=1ba07586afc340838ab5ab2a97b45d92&scope.project.id=7d94df893fa24cea85162a87d72139e8&role.id=b7d5979aed50487cbf98896a6fa6f162 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:28.655268 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da395905-c1ce-429d-8b49-b04fff8335e7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:28.748844 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5206b9-7de1-47a5-b222-37de70f5bb24 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:28.827982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b639fc1-9a2c-4cdf-b096-84eed802b560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:28.829064 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b639fc1-9a2c-4cdf-b096-84eed802b560 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:28.829592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b639fc1-9a2c-4cdf-b096-84eed802b560 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:28.831753 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b639fc1-9a2c-4cdf-b096-84eed802b560 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:28.832702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b639fc1-9a2c-4cdf-b096-84eed802b560 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:28.833233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b639fc1-9a2c-4cdf-b096-84eed802b560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:28.836197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b639fc1-9a2c-4cdf-b096-84eed802b560 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:28.854161 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da395905-c1ce-429d-8b49-b04fff8335e7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:28.857081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 191/370] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:28.865806 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b639fc1-9a2c-4cdf-b096-84eed802b560 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:28.922497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9bb4d-6882-4fbd-baf1-fa5fc360e951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:28.923188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9bb4d-6882-4fbd-baf1-fa5fc360e951 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:28.923466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9bb4d-6882-4fbd-baf1-fa5fc360e951 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:28.923736 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9bb4d-6882-4fbd-baf1-fa5fc360e951 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:28.946455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9bb4d-6882-4fbd-baf1-fa5fc360e951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-28f9bb4d-6882-4fbd-baf1-fa5fc360e951 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:28.952211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:28.953143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:28.953960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:28.953960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:28.953960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:28.953960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:28.953960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:28.953960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:28.953960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:28.953960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:28.953960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:28.953960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:28.953960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:10:28.953960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:28.961853 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 180/371] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:10:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:28.969025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9bb4d-6882-4fbd-baf1-fa5fc360e951 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:29.023392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:29.028805 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b639fc1-9a2c-4cdf-b096-84eed802b560 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:29.033698 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:29.072121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241fe6b-f2d9-485d-94d3-c491124ed36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:29.073535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241fe6b-f2d9-485d-94d3-c491124ed36f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:29.074320 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241fe6b-f2d9-485d-94d3-c491124ed36f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:29.074810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241fe6b-f2d9-485d-94d3-c491124ed36f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:29.123724 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9bb4d-6882-4fbd-baf1-fa5fc360e951 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:29.173455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241fe6b-f2d9-485d-94d3-c491124ed36f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:29.177163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241fe6b-f2d9-485d-94d3-c491124ed36f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:29.177373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafd329-49af-434e-929d-c8839dcdfc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:29.178007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafd329-49af-434e-929d-c8839dcdfc34 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:29.178284 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafd329-49af-434e-929d-c8839dcdfc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:29.178552 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafd329-49af-434e-929d-c8839dcdfc34 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:29.179289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafd329-49af-434e-929d-c8839dcdfc34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:29.179653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafd329-49af-434e-929d-c8839dcdfc34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:29.185313 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafd329-49af-434e-929d-c8839dcdfc34 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:29.195733 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 181/372] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:29.200624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafd329-49af-434e-929d-c8839dcdfc34 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:29.280057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:29.280359 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 192/373] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:29.301894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241fe6b-f2d9-485d-94d3-c491124ed36f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:29.359014 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafd329-49af-434e-929d-c8839dcdfc34 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:29.386744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:29.432083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b1431-f4e9-4ca3-80d1-abdb1e639a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:29.433104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b1431-f4e9-4ca3-80d1-abdb1e639a26 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:29.433617 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b1431-f4e9-4ca3-80d1-abdb1e639a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:29.434218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b1431-f4e9-4ca3-80d1-abdb1e639a26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:29.448700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241fe6b-f2d9-485d-94d3-c491124ed36f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:29.487457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44365090-f842-454b-a06e-f456781f8882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:29.488110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44365090-f842-454b-a06e-f456781f8882 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:29.488411 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44365090-f842-454b-a06e-f456781f8882 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:29.488660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44365090-f842-454b-a06e-f456781f8882 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:29.490656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44365090-f842-454b-a06e-f456781f8882 None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:29.492124 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44365090-f842-454b-a06e-f456781f8882 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:29.494006 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 193/374] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:29 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:29.500524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44365090-f842-454b-a06e-f456781f8882 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:29.559399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b1431-f4e9-4ca3-80d1-abdb1e639a26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:29.563521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b1431-f4e9-4ca3-80d1-abdb1e639a26 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:29.629090 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:29.714965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 182/375] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 18:10:29.721638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b1431-f4e9-4ca3-80d1-abdb1e639a26 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:29.734718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44365090-f842-454b-a06e-f456781f8882 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:29.751427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:29.819308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a351d-be05-409f-9935-0b995dad2342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:29.819963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a351d-be05-409f-9935-0b995dad2342 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:29.820238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a351d-be05-409f-9935-0b995dad2342 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:29.820506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a351d-be05-409f-9935-0b995dad2342 None admin] PATH_INFO: `/v3/groups/1ba07586afc340838ab5ab2a97b45d92` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:29.822093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a351d-be05-409f-9935-0b995dad2342 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba07586afc340838ab5ab2a97b45d92)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:29.823665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a351d-be05-409f-9935-0b995dad2342 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:29.825858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 194/376] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:29 2022] GET /identity/v3/groups/1ba07586afc340838ab5ab2a97b45d92 => generated 226 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:29.836379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a351d-be05-409f-9935-0b995dad2342 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:29.947321 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b1431-f4e9-4ca3-80d1-abdb1e639a26 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:29.977147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a351d-be05-409f-9935-0b995dad2342 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:30.015845 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b15bf-12cb-4020-83e0-7bd4148fed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:30.017593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7afe35-365b-4b6f-b5c3-d1dbd11452fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:30.018218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7afe35-365b-4b6f-b5c3-d1dbd11452fc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:30.018497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7afe35-365b-4b6f-b5c3-d1dbd11452fc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:30.018771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7afe35-365b-4b6f-b5c3-d1dbd11452fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:30.019511 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7afe35-365b-4b6f-b5c3-d1dbd11452fc None admin] RBAC: Adding query filter params (group.id=1ba07586afc340838ab5ab2a97b45d92, role.id=db4150b658a14804af1bf240ea2e31f9, scope.project.id=7d94df893fa24cea85162a87d72139e8) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:30.019824 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7afe35-365b-4b6f-b5c3-d1dbd11452fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:30.020921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b15bf-12cb-4020-83e0-7bd4148fed86 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:30.021209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b15bf-12cb-4020-83e0-7bd4148fed86 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:30.021485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b15bf-12cb-4020-83e0-7bd4148fed86 None admin] PATH_INFO: `/v3/projects/8a44db81f3af4ce4ac409fec8e68c2cd` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:30.022638 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7afe35-365b-4b6f-b5c3-d1dbd11452fc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:30.025403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b15bf-12cb-4020-83e0-7bd4148fed86 None admin] RBAC: Authorizing `identity:get_project(project_id=8a44db81f3af4ce4ac409fec8e68c2cd)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:30.026934 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b15bf-12cb-4020-83e0-7bd4148fed86 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:30.028872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 183/377] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:29 2022] GET /identity/v3/projects/8a44db81f3af4ce4ac409fec8e68c2cd => generated 344 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:30.030394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:30.033910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 195/378] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 26 18:10:29 2022] GET /identity/v3/role_assignments?group.id=1ba07586afc340838ab5ab2a97b45d92&scope.project.id=7d94df893fa24cea85162a87d72139e8&role.id=db4150b658a14804af1bf240ea2e31f9 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:30.041962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b15bf-12cb-4020-83e0-7bd4148fed86 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:30.160048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:30.182947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a07f47-2938-431b-9a26-795eebb7c8fe None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:30.183537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a07f47-2938-431b-9a26-795eebb7c8fe None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:30.183537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a07f47-2938-431b-9a26-795eebb7c8fe None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:30.185023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 196/379] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:10:30.186129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b15bf-12cb-4020-83e0-7bd4148fed86 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:30.190702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bece75-eda5-4cd0-bb6d-42f842776e2c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:30.190999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bece75-eda5-4cd0-bb6d-42f842776e2c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:30.191249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bece75-eda5-4cd0-bb6d-42f842776e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:30.228111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-24bece75-eda5-4cd0-bb6d-42f842776e2c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:30.229283 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-24bece75-eda5-4cd0-bb6d-42f842776e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:30.229625 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de504dec-fe70-48f6-8631-ba6b0e402faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:30.230282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de504dec-fe70-48f6-8631-ba6b0e402faf None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:30.230595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de504dec-fe70-48f6-8631-ba6b0e402faf None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:30.230864 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de504dec-fe70-48f6-8631-ba6b0e402faf None admin] PATH_INFO: `/v3/groups/b52c0fc53b364dffa5df518890a32462` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:30.237472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de504dec-fe70-48f6-8631-ba6b0e402faf None admin] RBAC: Authorizing `identity:get_group(group_id=b52c0fc53b364dffa5df518890a32462)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:30.238948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de504dec-fe70-48f6-8631-ba6b0e402faf None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:30.240949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 184/380] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:30 2022] GET /identity/v3/groups/b52c0fc53b364dffa5df518890a32462 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:30.246691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de504dec-fe70-48f6-8631-ba6b0e402faf None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:30.319680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 197/381] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:30.384852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de504dec-fe70-48f6-8631-ba6b0e402faf None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:30.431842 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53662f6e-befa-470c-b08b-85460a945de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:30.432463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53662f6e-befa-470c-b08b-85460a945de4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:30.432758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53662f6e-befa-470c-b08b-85460a945de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:30.433034 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53662f6e-befa-470c-b08b-85460a945de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:30.433892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53662f6e-befa-470c-b08b-85460a945de4 None admin] RBAC: Adding query filter params (group.id=b52c0fc53b364dffa5df518890a32462, role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=8a44db81f3af4ce4ac409fec8e68c2cd) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:30.434207 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53662f6e-befa-470c-b08b-85460a945de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:30.435701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53662f6e-befa-470c-b08b-85460a945de4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:30.442260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 185/382] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 26 18:10:30 2022] GET /identity/v3/role_assignments?group.id=b52c0fc53b364dffa5df518890a32462&scope.project.id=8a44db81f3af4ce4ac409fec8e68c2cd&role.id=db572ad3d504403cbb227c2155c93eda => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:30.698399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bece75-eda5-4cd0-bb6d-42f842776e2c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:30.827665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bece75-eda5-4cd0-bb6d-42f842776e2c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:30.861345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:30.867421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ed8aa-324d-4252-8a8a-8bf7bf943a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:30.868111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ed8aa-324d-4252-8a8a-8bf7bf943a45 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:30.868394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ed8aa-324d-4252-8a8a-8bf7bf943a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:30.868665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ed8aa-324d-4252-8a8a-8bf7bf943a45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:30.883802 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ed8aa-324d-4252-8a8a-8bf7bf943a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3e8ed8aa-324d-4252-8a8a-8bf7bf943a45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:30.888825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:30.889731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:30.890996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 198/383] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:30.896323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53662f6e-befa-470c-b08b-85460a945de4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:30.909754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:31.023040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53662f6e-befa-470c-b08b-85460a945de4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:31.048850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2ac60-374b-4611-8d94-8a255c2c6a64 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:31.049145 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2ac60-374b-4611-8d94-8a255c2c6a64 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:31.049399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2ac60-374b-4611-8d94-8a255c2c6a64 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:31.051611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 199/384] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:10:31.056614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde04c5-5328-4c09-bf01-e36067d9463c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:31.056918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde04c5-5328-4c09-bf01-e36067d9463c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:31.057272 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde04c5-5328-4c09-bf01-e36067d9463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:31.063649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e6d85-33ec-4549-86e2-46a6a2e89e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:31.064276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6d85-33ec-4549-86e2-46a6a2e89e83 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:31.064557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6d85-33ec-4549-86e2-46a6a2e89e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:31.064919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6d85-33ec-4549-86e2-46a6a2e89e83 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:31.065601 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e6d85-33ec-4549-86e2-46a6a2e89e83 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:31.065907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e6d85-33ec-4549-86e2-46a6a2e89e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:31.067290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e6d85-33ec-4549-86e2-46a6a2e89e83 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:31.076400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 186/385] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:31.077946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8cde04c5-5328-4c09-bf01-e36067d9463c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:31.079226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8cde04c5-5328-4c09-bf01-e36067d9463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:31.086219 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e6d85-33ec-4549-86e2-46a6a2e89e83 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:31.206126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 200/386] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:31.218627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:31.256851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e6d85-33ec-4549-86e2-46a6a2e89e83 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:31.259826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba52ea9-c6d9-4115-a78e-2880b446a3fb None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:31.260119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba52ea9-c6d9-4115-a78e-2880b446a3fb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:31.260400 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba52ea9-c6d9-4115-a78e-2880b446a3fb None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:31.262125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 201/387] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:10:31.267435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca8219-3ef2-4a1a-bbee-c901c071b5a5 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:31.267720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca8219-3ef2-4a1a-bbee-c901c071b5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:31.267994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca8219-3ef2-4a1a-bbee-c901c071b5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:31.294928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115258e-fe13-48f1-aad2-e144c3404ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:31.295634 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115258e-fe13-48f1-aad2-e144c3404ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:31.295915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115258e-fe13-48f1-aad2-e144c3404ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:31.296189 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115258e-fe13-48f1-aad2-e144c3404ce1 None admin] PATH_INFO: `/v3/groups/1ba07586afc340838ab5ab2a97b45d92` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:31.297427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115258e-fe13-48f1-aad2-e144c3404ce1 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba07586afc340838ab5ab2a97b45d92)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:31.298925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115258e-fe13-48f1-aad2-e144c3404ce1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:31.300842 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 187/388] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:31 2022] GET /identity/v3/groups/1ba07586afc340838ab5ab2a97b45d92 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:31.305910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-bdca8219-3ef2-4a1a-bbee-c901c071b5a5 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:31.306974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115258e-fe13-48f1-aad2-e144c3404ce1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:31.307156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bdca8219-3ef2-4a1a-bbee-c901c071b5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:31.414091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115258e-fe13-48f1-aad2-e144c3404ce1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:31.451852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e3848-a709-4563-999d-31e1e9e8d636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:31.452500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e3848-a709-4563-999d-31e1e9e8d636 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:31.452824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e3848-a709-4563-999d-31e1e9e8d636 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:31.453099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e3848-a709-4563-999d-31e1e9e8d636 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:31.454259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e3848-a709-4563-999d-31e1e9e8d636 None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:31.455715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e3848-a709-4563-999d-31e1e9e8d636 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:31.457693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 188/389] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:31 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:31.462787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 202/390] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:31.463399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e3848-a709-4563-999d-31e1e9e8d636 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:31.481138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:31.568580 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e3848-a709-4563-999d-31e1e9e8d636 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:31.603227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb696d-16d8-48fb-8763-9eb284ebd5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:31.603900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb696d-16d8-48fb-8763-9eb284ebd5d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:31.604176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb696d-16d8-48fb-8763-9eb284ebd5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:31.604448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb696d-16d8-48fb-8763-9eb284ebd5d5 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362/groups/1ba07586afc340838ab5ab2a97b45d92/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:31.606543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb696d-16d8-48fb-8763-9eb284ebd5d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0565423b088f492581b9dc3e0ad10362, group_id=1ba07586afc340838ab5ab2a97b45d92, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:31.608064 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb696d-16d8-48fb-8763-9eb284ebd5d5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:31.627923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 189/391] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Aug 26 18:10:31 2022] PUT /identity/v3/projects/0565423b088f492581b9dc3e0ad10362/groups/1ba07586afc340838ab5ab2a97b45d92/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:10:31.697754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca8219-3ef2-4a1a-bbee-c901c071b5a5 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:31.766431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:31.824209 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca8219-3ef2-4a1a-bbee-c901c071b5a5 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:31.862879 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1119d-a622-449c-b557-ec58cfc331a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:31.863532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1119d-a622-449c-b557-ec58cfc331a9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:31.863810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1119d-a622-449c-b557-ec58cfc331a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:31.864069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1119d-a622-449c-b557-ec58cfc331a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:31.877637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1119d-a622-449c-b557-ec58cfc331a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1fc1119d-a622-449c-b557-ec58cfc331a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:31.882441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:31.883312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:31.884095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:31.884095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:31.884095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:31.884095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:31.884095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:31.884095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:31.884095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:31.884095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:31.884095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:31.884095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:31.884095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:31.884095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:31.888778 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 203/392] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:10:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:31.890257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb696d-16d8-48fb-8763-9eb284ebd5d5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:31.949301 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1119d-a622-449c-b557-ec58cfc331a9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:31.987304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:32.020431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb696d-16d8-48fb-8763-9eb284ebd5d5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:32.061247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a811c1-db7d-4964-a55d-f66805defa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:32.061869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a811c1-db7d-4964-a55d-f66805defa53 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:32.062142 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a811c1-db7d-4964-a55d-f66805defa53 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:32.062414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a811c1-db7d-4964-a55d-f66805defa53 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:32.063093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a811c1-db7d-4964-a55d-f66805defa53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:32.063400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a811c1-db7d-4964-a55d-f66805defa53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:32.064816 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a811c1-db7d-4964-a55d-f66805defa53 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:32.076512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 190/393] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:32.085659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a811c1-db7d-4964-a55d-f66805defa53 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:32.114533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1119d-a622-449c-b557-ec58cfc331a9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:32.130613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:32.206219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea75f1-46c1-4f75-8b45-8382517ddb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:32.206866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea75f1-46c1-4f75-8b45-8382517ddb95 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:32.206959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea75f1-46c1-4f75-8b45-8382517ddb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:32.207232 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea75f1-46c1-4f75-8b45-8382517ddb95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:32.210139 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a811c1-db7d-4964-a55d-f66805defa53 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:32.246268 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53417ec1-d7be-4aa7-876e-cfb6d61c7f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:32.247198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53417ec1-d7be-4aa7-876e-cfb6d61c7f16 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:32.247622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53417ec1-d7be-4aa7-876e-cfb6d61c7f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:32.248798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea75f1-46c1-4f75-8b45-8382517ddb95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:32.249248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53417ec1-d7be-4aa7-876e-cfb6d61c7f16 None admin] PATH_INFO: `/v3/groups/1ba07586afc340838ab5ab2a97b45d92` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:32.250195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-58ea75f1-46c1-4f75-8b45-8382517ddb95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:32.259589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:32.260661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:32.261571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 204/394] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:10:32.263458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea75f1-46c1-4f75-8b45-8382517ddb95 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:32.264874 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53417ec1-d7be-4aa7-876e-cfb6d61c7f16 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba07586afc340838ab5ab2a97b45d92)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:32.266451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53417ec1-d7be-4aa7-876e-cfb6d61c7f16 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:32.268517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 191/395] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:32 2022] GET /identity/v3/groups/1ba07586afc340838ab5ab2a97b45d92 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:32.277891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53417ec1-d7be-4aa7-876e-cfb6d61c7f16 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:32.423372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea75f1-46c1-4f75-8b45-8382517ddb95 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:32.443694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53417ec1-d7be-4aa7-876e-cfb6d61c7f16 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:32.460520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714b1e9-f607-4983-beb6-3952097f2be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:32.461190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714b1e9-f607-4983-beb6-3952097f2be8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:32.461463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714b1e9-f607-4983-beb6-3952097f2be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:32.461830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714b1e9-f607-4983-beb6-3952097f2be8 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:32.462540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714b1e9-f607-4983-beb6-3952097f2be8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:32.462851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714b1e9-f607-4983-beb6-3952097f2be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:32.464435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714b1e9-f607-4983-beb6-3952097f2be8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:32.475346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 205/396] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:32.476571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ba6da-4f44-4f43-a3d4-d68ccff319db None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:32.476887 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ba6da-4f44-4f43-a3d4-d68ccff319db None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:32.477160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ba6da-4f44-4f43-a3d4-d68ccff319db None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:32.483565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 206/397] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:32.484488 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ba6da-4f44-4f43-a3d4-d68ccff319db None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:32.487700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebc8a7-f073-4f1e-8635-bbff4c30c6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:32.489843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebc8a7-f073-4f1e-8635-bbff4c30c6cb None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:32.490333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebc8a7-f073-4f1e-8635-bbff4c30c6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:32.490819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebc8a7-f073-4f1e-8635-bbff4c30c6cb None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:32.492159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebc8a7-f073-4f1e-8635-bbff4c30c6cb None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:32.493824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebc8a7-f073-4f1e-8635-bbff4c30c6cb None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:32.496585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 192/398] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:32 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:32.498815 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd53a64-eb76-4cd7-a719-1a4e3987a319 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:32.499482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd53a64-eb76-4cd7-a719-1a4e3987a319 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:32.500047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd53a64-eb76-4cd7-a719-1a4e3987a319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:32.521707 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-5fd53a64-eb76-4cd7-a719-1a4e3987a319 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:32.522953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5fd53a64-eb76-4cd7-a719-1a4e3987a319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:32.531512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:32.606853 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:32.614727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ba6da-4f44-4f43-a3d4-d68ccff319db None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:32.624744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 193/399] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:32.624744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd53a64-eb76-4cd7-a719-1a4e3987a319 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:32.714799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efb068-234f-4791-bd30-552da641ba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:32.715708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efb068-234f-4791-bd30-552da641ba31 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:32.715989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efb068-234f-4791-bd30-552da641ba31 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:32.716261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efb068-234f-4791-bd30-552da641ba31 None admin] PATH_INFO: `/v3/groups/1ba07586afc340838ab5ab2a97b45d92` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:32.719020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efb068-234f-4791-bd30-552da641ba31 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba07586afc340838ab5ab2a97b45d92)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:32.720496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efb068-234f-4791-bd30-552da641ba31 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:32.722143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 207/400] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:32 2022] GET /identity/v3/groups/1ba07586afc340838ab5ab2a97b45d92 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:32.729592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efb068-234f-4791-bd30-552da641ba31 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:32.758923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd53a64-eb76-4cd7-a719-1a4e3987a319 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:32.829531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d493e-01ce-4766-908c-0644ae66f7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:32.830209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d493e-01ce-4766-908c-0644ae66f7e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:32.830488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d493e-01ce-4766-908c-0644ae66f7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:32.830763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d493e-01ce-4766-908c-0644ae66f7e0 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362/groups/1ba07586afc340838ab5ab2a97b45d92/roles/db4150b658a14804af1bf240ea2e31f9` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:32.835691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d493e-01ce-4766-908c-0644ae66f7e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0565423b088f492581b9dc3e0ad10362, group_id=1ba07586afc340838ab5ab2a97b45d92, role_id=db4150b658a14804af1bf240ea2e31f9)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:32.837164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d493e-01ce-4766-908c-0644ae66f7e0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:32.863668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 194/401] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Aug 26 18:10:32 2022] PUT /identity/v3/projects/0565423b088f492581b9dc3e0ad10362/groups/1ba07586afc340838ab5ab2a97b45d92/roles/db4150b658a14804af1bf240ea2e31f9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:32.919477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:32.923615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efb068-234f-4791-bd30-552da641ba31 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:32.924971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d493e-01ce-4766-908c-0644ae66f7e0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:32.976274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16695c64-a62e-40e4-bf6c-087eb57819f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:32.978657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16695c64-a62e-40e4-bf6c-087eb57819f0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:32.979282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16695c64-a62e-40e4-bf6c-087eb57819f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:32.979750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16695c64-a62e-40e4-bf6c-087eb57819f0 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:32.983791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16695c64-a62e-40e4-bf6c-087eb57819f0 None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:32.985878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16695c64-a62e-40e4-bf6c-087eb57819f0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:32.990857 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 208/402] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:32 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:32.997167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16695c64-a62e-40e4-bf6c-087eb57819f0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:33.017114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:33.077671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d493e-01ce-4766-908c-0644ae66f7e0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:33.123137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41458cfb-1985-4e55-a66b-3d578da2cd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:33.123784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41458cfb-1985-4e55-a66b-3d578da2cd16 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:33.124058 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41458cfb-1985-4e55-a66b-3d578da2cd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:33.124342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41458cfb-1985-4e55-a66b-3d578da2cd16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:33.138653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41458cfb-1985-4e55-a66b-3d578da2cd16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-41458cfb-1985-4e55-a66b-3d578da2cd16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:33.144988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:33.145937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:33.146770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:33.146770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:33.146770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:33.146770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:33.146770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:33.146770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:33.146770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:33.146770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:33.146770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:33.146770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:33.146770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:33.146770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:33.149800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 195/403] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:10:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:10:33.152697 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41458cfb-1985-4e55-a66b-3d578da2cd16 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:33.160879 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16695c64-a62e-40e4-bf6c-087eb57819f0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:33.197843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df97c4a-3ae2-49ed-8815-758ddd9449b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:33.198885 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df97c4a-3ae2-49ed-8815-758ddd9449b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:33.199414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df97c4a-3ae2-49ed-8815-758ddd9449b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:33.199889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df97c4a-3ae2-49ed-8815-758ddd9449b4 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8/groups/1ba07586afc340838ab5ab2a97b45d92/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:33.202099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df97c4a-3ae2-49ed-8815-758ddd9449b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d94df893fa24cea85162a87d72139e8, group_id=1ba07586afc340838ab5ab2a97b45d92, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:33.203834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df97c4a-3ae2-49ed-8815-758ddd9449b4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:33.231086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 209/404] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Aug 26 18:10:32 2022] PUT /identity/v3/projects/7d94df893fa24cea85162a87d72139e8/groups/1ba07586afc340838ab5ab2a97b45d92/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:33.283156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca4dc-aa54-4d7e-8a96-233f6dc082ea None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:33.283500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca4dc-aa54-4d7e-8a96-233f6dc082ea None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:33.283889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca4dc-aa54-4d7e-8a96-233f6dc082ea None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:33.287014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 210/405] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:10:33.291782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9d73d-25cd-44af-81c6-114640050abe None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:33.292104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9d73d-25cd-44af-81c6-114640050abe None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:33.292321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9d73d-25cd-44af-81c6-114640050abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:33.311799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41458cfb-1985-4e55-a66b-3d578da2cd16 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:33.315228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b0f9d73d-25cd-44af-81c6-114640050abe None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:33.316516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b0f9d73d-25cd-44af-81c6-114640050abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:33.339164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:33.358494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:33.371227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9f960-dc82-48dc-a67d-7abfe918b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:33.371874 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9f960-dc82-48dc-a67d-7abfe918b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:33.372153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9f960-dc82-48dc-a67d-7abfe918b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:33.372422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9f960-dc82-48dc-a67d-7abfe918b7f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:33.373704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9f960-dc82-48dc-a67d-7abfe918b7f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:33.373704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9f960-dc82-48dc-a67d-7abfe918b7f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:33.374918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9f960-dc82-48dc-a67d-7abfe918b7f9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:33.390161 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 196/406] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:33.395924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9f960-dc82-48dc-a67d-7abfe918b7f9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:33.409345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 211/407] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:33.528522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9f960-dc82-48dc-a67d-7abfe918b7f9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:33.564248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d5b55-1479-45ae-a9ea-b10ee139cc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:33.564930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d5b55-1479-45ae-a9ea-b10ee139cc0d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:33.565215 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d5b55-1479-45ae-a9ea-b10ee139cc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:33.565488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d5b55-1479-45ae-a9ea-b10ee139cc0d None admin] PATH_INFO: `/v3/groups/1ba07586afc340838ab5ab2a97b45d92` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:33.566629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d5b55-1479-45ae-a9ea-b10ee139cc0d None admin] RBAC: Authorizing `identity:get_group(group_id=1ba07586afc340838ab5ab2a97b45d92)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:33.568252 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d5b55-1479-45ae-a9ea-b10ee139cc0d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:33.570204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 197/408] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:33 2022] GET /identity/v3/groups/1ba07586afc340838ab5ab2a97b45d92 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:33.577907 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9d73d-25cd-44af-81c6-114640050abe None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:33.681000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9d73d-25cd-44af-81c6-114640050abe None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:33.720237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774d65-109d-4a0d-b494-f981b8fa8ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:33.720908 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774d65-109d-4a0d-b494-f981b8fa8ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:33.721189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774d65-109d-4a0d-b494-f981b8fa8ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:33.721460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774d65-109d-4a0d-b494-f981b8fa8ec6 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:33.722670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59774d65-109d-4a0d-b494-f981b8fa8ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:33.724494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59774d65-109d-4a0d-b494-f981b8fa8ec6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:33.726171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 212/409] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:33 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:33.732667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d5b55-1479-45ae-a9ea-b10ee139cc0d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:33.782226 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:33.783143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774d65-109d-4a0d-b494-f981b8fa8ec6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:33.855159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:33.859819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d5b55-1479-45ae-a9ea-b10ee139cc0d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:33.919231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92984521-8ec8-454c-9825-bc63d0c1b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:33.919918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92984521-8ec8-454c-9825-bc63d0c1b7de None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:33.920354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92984521-8ec8-454c-9825-bc63d0c1b7de None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:33.920644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92984521-8ec8-454c-9825-bc63d0c1b7de None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8/groups/1ba07586afc340838ab5ab2a97b45d92/roles/db4150b658a14804af1bf240ea2e31f9` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:33.922943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92984521-8ec8-454c-9825-bc63d0c1b7de None admin] RBAC: Authorizing `identity:create_grant(project_id=7d94df893fa24cea85162a87d72139e8, group_id=1ba07586afc340838ab5ab2a97b45d92, role_id=db4150b658a14804af1bf240ea2e31f9)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:33.924585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92984521-8ec8-454c-9825-bc63d0c1b7de None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:33.939862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774d65-109d-4a0d-b494-f981b8fa8ec6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:33.956506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 198/410] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Aug 26 18:10:33 2022] PUT /identity/v3/projects/7d94df893fa24cea85162a87d72139e8/groups/1ba07586afc340838ab5ab2a97b45d92/roles/db4150b658a14804af1bf240ea2e31f9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:33.976593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11b118-88ac-4271-931f-f5020fddf308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:33.977297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b118-88ac-4271-931f-f5020fddf308 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:33.977579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b118-88ac-4271-931f-f5020fddf308 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:33.977854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b118-88ac-4271-931f-f5020fddf308 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:33.990775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11b118-88ac-4271-931f-f5020fddf308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-8c11b118-88ac-4271-931f-f5020fddf308 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:33.997123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:33.998122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:33.998987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 213/411] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:10:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:34.004396 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92984521-8ec8-454c-9825-bc63d0c1b7de None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:34.065119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca33b1-5a26-4824-9298-ae5db0a9f926 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:34.065866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca33b1-5a26-4824-9298-ae5db0a9f926 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:34.066139 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca33b1-5a26-4824-9298-ae5db0a9f926 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:34.068527 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 214/412] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:34.074912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d90973-2b85-430b-91d5-d4a5c229f016 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:34.075234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d90973-2b85-430b-91d5-d4a5c229f016 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:34.075740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d90973-2b85-430b-91d5-d4a5c229f016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:34.096533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-13d90973-2b85-430b-91d5-d4a5c229f016 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:34.098442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-13d90973-2b85-430b-91d5-d4a5c229f016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:34.167990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92984521-8ec8-454c-9825-bc63d0c1b7de None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:34.176285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:34.211875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923aab4-9382-42df-bb8c-f406740e3e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:34.212513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923aab4-9382-42df-bb8c-f406740e3e76 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:34.212820 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923aab4-9382-42df-bb8c-f406740e3e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:34.213094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923aab4-9382-42df-bb8c-f406740e3e76 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:34.213782 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923aab4-9382-42df-bb8c-f406740e3e76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:34.214088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923aab4-9382-42df-bb8c-f406740e3e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:34.215605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923aab4-9382-42df-bb8c-f406740e3e76 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:34.225319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 215/413] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:34.226017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 199/414] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:34.232308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d90973-2b85-430b-91d5-d4a5c229f016 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:34.250921 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:34.338524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d90973-2b85-430b-91d5-d4a5c229f016 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:34.376982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702c5fe-d101-4e99-9905-941240b1a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:34.377627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702c5fe-d101-4e99-9905-941240b1a254 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:34.377907 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702c5fe-d101-4e99-9905-941240b1a254 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:34.378181 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702c5fe-d101-4e99-9905-941240b1a254 None admin] PATH_INFO: `/v3/groups/b52c0fc53b364dffa5df518890a32462` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:34.379338 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702c5fe-d101-4e99-9905-941240b1a254 None admin] RBAC: Authorizing `identity:get_group(group_id=b52c0fc53b364dffa5df518890a32462)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:34.380824 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702c5fe-d101-4e99-9905-941240b1a254 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:34.382713 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 216/415] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:34 2022] GET /identity/v3/groups/b52c0fc53b364dffa5df518890a32462 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:34.388378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923aab4-9382-42df-bb8c-f406740e3e76 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:34.520787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923aab4-9382-42df-bb8c-f406740e3e76 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:34.561346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702c5fe-d101-4e99-9905-941240b1a254 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:34.597358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb32d13-4e46-404f-a690-af094eb19521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:34.597929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb32d13-4e46-404f-a690-af094eb19521 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:34.598212 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb32d13-4e46-404f-a690-af094eb19521 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:34.598490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb32d13-4e46-404f-a690-af094eb19521 None admin] PATH_INFO: `/v3/projects/8a44db81f3af4ce4ac409fec8e68c2cd` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:34.601150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb32d13-4e46-404f-a690-af094eb19521 None admin] RBAC: Authorizing `identity:get_project(project_id=8a44db81f3af4ce4ac409fec8e68c2cd)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:34.602611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb32d13-4e46-404f-a690-af094eb19521 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:34.608141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 200/416] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:34 2022] GET /identity/v3/projects/8a44db81f3af4ce4ac409fec8e68c2cd => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:34.630928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb32d13-4e46-404f-a690-af094eb19521 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:34.685120 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:34.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:34.770121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb32d13-4e46-404f-a690-af094eb19521 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:34.781864 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702c5fe-d101-4e99-9905-941240b1a254 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:34.829653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d37bbc-166f-42e9-8bb8-3809ab94dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:34.830332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d37bbc-166f-42e9-8bb8-3809ab94dd73 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:34.830606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d37bbc-166f-42e9-8bb8-3809ab94dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:34.830873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d37bbc-166f-42e9-8bb8-3809ab94dd73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:34.835650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a443f-4971-4f75-af93-a35ab065687f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:34.836347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a443f-4971-4f75-af93-a35ab065687f None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:34.836626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a443f-4971-4f75-af93-a35ab065687f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:34.840990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a443f-4971-4f75-af93-a35ab065687f None admin] PATH_INFO: `/v3/projects/8a44db81f3af4ce4ac409fec8e68c2cd/groups/b52c0fc53b364dffa5df518890a32462/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:34.845355 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a443f-4971-4f75-af93-a35ab065687f None admin] RBAC: Authorizing `identity:create_grant(project_id=8a44db81f3af4ce4ac409fec8e68c2cd, group_id=b52c0fc53b364dffa5df518890a32462, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:34.848298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a443f-4971-4f75-af93-a35ab065687f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:34.854210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d37bbc-166f-42e9-8bb8-3809ab94dd73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-b6d37bbc-166f-42e9-8bb8-3809ab94dd73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:34.861082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:34.861999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:34.862786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:34.862786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:34.862786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:34.862786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:34.862786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:34.862786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:34.862786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:34.862786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:34.862786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:34.862786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:34.862786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:34.862786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:34.865147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 217/417] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:10:34.872891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d37bbc-166f-42e9-8bb8-3809ab94dd73 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:34.882896 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 201/418] 10.222.0.45 () {58 vars in 1442 bytes} [Fri Aug 26 18:10:34 2022] PUT /identity/v3/projects/8a44db81f3af4ce4ac409fec8e68c2cd/groups/b52c0fc53b364dffa5df518890a32462/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:10:35.022966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d37bbc-166f-42e9-8bb8-3809ab94dd73 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:35.075017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c64ed-e7fd-4f14-8335-19d595cd1fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:35.075881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c64ed-e7fd-4f14-8335-19d595cd1fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:35.076319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c64ed-e7fd-4f14-8335-19d595cd1fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:35.076763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c64ed-e7fd-4f14-8335-19d595cd1fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:35.077583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c64ed-e7fd-4f14-8335-19d595cd1fc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:35.078019 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c64ed-e7fd-4f14-8335-19d595cd1fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:35.079551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c64ed-e7fd-4f14-8335-19d595cd1fc0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:35.088888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 218/419] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:35.095026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a443f-4971-4f75-af93-a35ab065687f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:35.204042 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:35.213451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a443f-4971-4f75-af93-a35ab065687f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:35.251798 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822716c-001b-42d5-a195-564edbe094e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:35.252416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822716c-001b-42d5-a195-564edbe094e4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:35.252691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822716c-001b-42d5-a195-564edbe094e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:35.252990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822716c-001b-42d5-a195-564edbe094e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:35.324692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822716c-001b-42d5-a195-564edbe094e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:35.326558 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822716c-001b-42d5-a195-564edbe094e4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:35.425169 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:35.428288 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 202/420] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:35.434340 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c64ed-e7fd-4f14-8335-19d595cd1fc0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:35.435071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c085be-0208-498c-b9af-a95b6bf23d0c None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:35.435564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c085be-0208-498c-b9af-a95b6bf23d0c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:35.435847 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c085be-0208-498c-b9af-a95b6bf23d0c None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:35.437689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 203/421] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:35.443314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed154607-42a6-4d8a-9327-3e5cb39bd3bf None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:35.443621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed154607-42a6-4d8a-9327-3e5cb39bd3bf None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:35.443865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed154607-42a6-4d8a-9327-3e5cb39bd3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:35.453177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:35.473157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ed154607-42a6-4d8a-9327-3e5cb39bd3bf None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:35.474585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ed154607-42a6-4d8a-9327-3e5cb39bd3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:35.612339 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c64ed-e7fd-4f14-8335-19d595cd1fc0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:35.646410 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 204/422] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:35.649450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710390d-78ca-4786-afd2-286c24c28d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:35.650099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710390d-78ca-4786-afd2-286c24c28d0b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:35.650375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710390d-78ca-4786-afd2-286c24c28d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:35.650644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710390d-78ca-4786-afd2-286c24c28d0b None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:35.651780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710390d-78ca-4786-afd2-286c24c28d0b None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:35.653385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710390d-78ca-4786-afd2-286c24c28d0b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:35.655355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 219/423] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:35 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:35.662593 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed154607-42a6-4d8a-9327-3e5cb39bd3bf None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:35.715568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dc860-3cbc-4938-be50-48670be1429f None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:35.715896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dc860-3cbc-4938-be50-48670be1429f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:35.716361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dc860-3cbc-4938-be50-48670be1429f None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:35.719652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 220/424] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:10:35.724603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b33a4-beab-423b-b0eb-d8ea49e3cc5b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:35.725286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b33a4-beab-423b-b0eb-d8ea49e3cc5b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:35.725566 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b33a4-beab-423b-b0eb-d8ea49e3cc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:35.759446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9d5b33a4-beab-423b-b0eb-d8ea49e3cc5b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:35.762178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9d5b33a4-beab-423b-b0eb-d8ea49e3cc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:35.815436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed154607-42a6-4d8a-9327-3e5cb39bd3bf None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:35.866573 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:35.881590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506880f-fe51-4e1c-8593-9573f7584b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:35.882242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506880f-fe51-4e1c-8593-9573f7584b7d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:35.884127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506880f-fe51-4e1c-8593-9573f7584b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:35.884416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506880f-fe51-4e1c-8593-9573f7584b7d None admin] PATH_INFO: `/v3/groups/1ba07586afc340838ab5ab2a97b45d92` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:35.886728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 221/425] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:35.887461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506880f-fe51-4e1c-8593-9573f7584b7d None admin] RBAC: Authorizing `identity:get_group(group_id=1ba07586afc340838ab5ab2a97b45d92)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:35.888962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506880f-fe51-4e1c-8593-9573f7584b7d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:35.890840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 205/426] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:35 2022] GET /identity/v3/groups/1ba07586afc340838ab5ab2a97b45d92 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:35.898193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b33a4-beab-423b-b0eb-d8ea49e3cc5b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:35.908748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:36.032369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b33a4-beab-423b-b0eb-d8ea49e3cc5b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:36.079713 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4b9b8-e59d-421b-918d-3885418ca921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:36.080382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4b9b8-e59d-421b-918d-3885418ca921 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:36.080666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4b9b8-e59d-421b-918d-3885418ca921 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:36.080965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4b9b8-e59d-421b-918d-3885418ca921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:36.081711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4b9b8-e59d-421b-918d-3885418ca921 None admin] RBAC: Adding query filter params (group.id=1ba07586afc340838ab5ab2a97b45d92, role.id=b7d5979aed50487cbf98896a6fa6f162, scope.project.id=0565423b088f492581b9dc3e0ad10362) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:36.082017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4b9b8-e59d-421b-918d-3885418ca921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:36.083486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4b9b8-e59d-421b-918d-3885418ca921 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:36.093234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 222/427] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 26 18:10:35 2022] GET /identity/v3/role_assignments?group.id=1ba07586afc340838ab5ab2a97b45d92&scope.project.id=0565423b088f492581b9dc3e0ad10362&role.id=b7d5979aed50487cbf98896a6fa6f162 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:36.096266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506880f-fe51-4e1c-8593-9573f7584b7d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:36.275449 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4b9b8-e59d-421b-918d-3885418ca921 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:36.288858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506880f-fe51-4e1c-8593-9573f7584b7d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:36.342764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0a7bb-60ae-44bb-b39e-570ea3edd9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:36.343429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0a7bb-60ae-44bb-b39e-570ea3edd9cb None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:36.343710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0a7bb-60ae-44bb-b39e-570ea3edd9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:36.343979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0a7bb-60ae-44bb-b39e-570ea3edd9cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:36.361533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0a7bb-60ae-44bb-b39e-570ea3edd9cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b8c0a7bb-60ae-44bb-b39e-570ea3edd9cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:36.369677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:36.370587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:36.371544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 206/428] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:10:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:36.380548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:36.385117 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0a7bb-60ae-44bb-b39e-570ea3edd9cb None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:36.429444 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4b9b8-e59d-421b-918d-3885418ca921 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:36.453115 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:36.482451 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca9645-82a3-47bb-b22a-b511d19fbc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:36.483767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca9645-82a3-47bb-b22a-b511d19fbc72 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:36.484185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca9645-82a3-47bb-b22a-b511d19fbc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:36.484600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca9645-82a3-47bb-b22a-b511d19fbc72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:36.496411 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca9645-82a3-47bb-b22a-b511d19fbc72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-55ca9645-82a3-47bb-b22a-b511d19fbc72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:36.501980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:36.502941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:36.503742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 223/429] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:36.504797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae81ea-b15c-4739-8d91-7396e531e1ca None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:36.504959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae81ea-b15c-4739-8d91-7396e531e1ca None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:36.505216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae81ea-b15c-4739-8d91-7396e531e1ca None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:36.506702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 224/430] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:36.513395 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148db85-5c7d-4d41-ba86-e0ed0925f387 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:36.513912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148db85-5c7d-4d41-ba86-e0ed0925f387 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:36.514315 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148db85-5c7d-4d41-ba86-e0ed0925f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:36.522822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0a7bb-60ae-44bb-b39e-570ea3edd9cb None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:36.535759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f148db85-5c7d-4d41-ba86-e0ed0925f387 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:36.537006 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f148db85-5c7d-4d41-ba86-e0ed0925f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:36.567350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e271bc-2efb-4763-9f09-cfdfd05c21a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:36.568227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e271bc-2efb-4763-9f09-cfdfd05c21a9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:36.568547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e271bc-2efb-4763-9f09-cfdfd05c21a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:36.568967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e271bc-2efb-4763-9f09-cfdfd05c21a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:36.569650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e271bc-2efb-4763-9f09-cfdfd05c21a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:36.569954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e271bc-2efb-4763-9f09-cfdfd05c21a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:36.571361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e271bc-2efb-4763-9f09-cfdfd05c21a9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:36.582614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 207/431] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:36.583300 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e271bc-2efb-4763-9f09-cfdfd05c21a9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:36.615937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 225/432] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:36.616806 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148db85-5c7d-4d41-ba86-e0ed0925f387 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:36.689685 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:36.721927 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e271bc-2efb-4763-9f09-cfdfd05c21a9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:36.748016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:36.753936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148db85-5c7d-4d41-ba86-e0ed0925f387 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:36.770513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee6c98-32a6-4def-a35f-9e50a9c22452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:36.771192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee6c98-32a6-4def-a35f-9e50a9c22452 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:36.771480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee6c98-32a6-4def-a35f-9e50a9c22452 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:36.771757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee6c98-32a6-4def-a35f-9e50a9c22452 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:36.772436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee6c98-32a6-4def-a35f-9e50a9c22452 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:36.772759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee6c98-32a6-4def-a35f-9e50a9c22452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:36.774277 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee6c98-32a6-4def-a35f-9e50a9c22452 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:36.784334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 208/433] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:10:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:36.790167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee6c98-32a6-4def-a35f-9e50a9c22452 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:36.799643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1959dc2-09f4-43a2-ae14-ad8abc2e15e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:36.800640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1959dc2-09f4-43a2-ae14-ad8abc2e15e8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:36.801744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1959dc2-09f4-43a2-ae14-ad8abc2e15e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:36.802281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1959dc2-09f4-43a2-ae14-ad8abc2e15e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:36.885113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1959dc2-09f4-43a2-ae14-ad8abc2e15e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:36.886534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1959dc2-09f4-43a2-ae14-ad8abc2e15e8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:36.911499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee6c98-32a6-4def-a35f-9e50a9c22452 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:36.953592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:36.958512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142a673-c439-46e5-9bb1-0b286eb218e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:36.959165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142a673-c439-46e5-9bb1-0b286eb218e6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:36.959430 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142a673-c439-46e5-9bb1-0b286eb218e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:36.959674 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142a673-c439-46e5-9bb1-0b286eb218e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:37.003100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 226/434] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:37.003792 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1959dc2-09f4-43a2-ae14-ad8abc2e15e8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:37.012355 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:37.037141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142a673-c439-46e5-9bb1-0b286eb218e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:37.038882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142a673-c439-46e5-9bb1-0b286eb218e6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:37.119353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1959dc2-09f4-43a2-ae14-ad8abc2e15e8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:37.147549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 209/435] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 18:10:37.148796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142a673-c439-46e5-9bb1-0b286eb218e6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:37.163007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090223b-fb3b-40b5-a9bc-c79af2b9c8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:37.163666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090223b-fb3b-40b5-a9bc-c79af2b9c8ce None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:37.163949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090223b-fb3b-40b5-a9bc-c79af2b9c8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:37.164219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090223b-fb3b-40b5-a9bc-c79af2b9c8ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:37.175831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090223b-fb3b-40b5-a9bc-c79af2b9c8ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1090223b-fb3b-40b5-a9bc-c79af2b9c8ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:37.181195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:37.182270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:37.183159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 227/436] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:10:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:37.184431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090223b-fb3b-40b5-a9bc-c79af2b9c8ce None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:37.206705 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:37.245217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:37.270013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142a673-c439-46e5-9bb1-0b286eb218e6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:37.299100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090223b-fb3b-40b5-a9bc-c79af2b9c8ce None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:37.304296 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8efc4d-3694-43c9-b82c-71eb8a4873e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:37.305051 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8efc4d-3694-43c9-b82c-71eb8a4873e7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:37.305299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8efc4d-3694-43c9-b82c-71eb8a4873e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:37.305646 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8efc4d-3694-43c9-b82c-71eb8a4873e7 None admin] PATH_INFO: `/v3/projects/0565423b088f492581b9dc3e0ad10362` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:37.306757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8efc4d-3694-43c9-b82c-71eb8a4873e7 None admin] RBAC: Authorizing `identity:get_project(project_id=0565423b088f492581b9dc3e0ad10362)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:37.308205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8efc4d-3694-43c9-b82c-71eb8a4873e7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:37.310061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 210/437] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:37 2022] GET /identity/v3/projects/0565423b088f492581b9dc3e0ad10362 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:37.310937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8efc4d-3694-43c9-b82c-71eb8a4873e7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:37.335222 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaca13-c442-4cfb-8a52-7ed023a1c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:37.335856 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaca13-c442-4cfb-8a52-7ed023a1c91d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:37.336132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaca13-c442-4cfb-8a52-7ed023a1c91d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:37.336397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaca13-c442-4cfb-8a52-7ed023a1c91d None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:37.337545 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaca13-c442-4cfb-8a52-7ed023a1c91d None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:37.339015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaca13-c442-4cfb-8a52-7ed023a1c91d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:37.340887 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 228/438] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:37 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:37.342074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac6971-228f-45c9-9016-63f9ebdadfc4 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:37.342356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac6971-228f-45c9-9016-63f9ebdadfc4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:37.342615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac6971-228f-45c9-9016-63f9ebdadfc4 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:37.343811 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 229/439] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:37.344490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac6971-228f-45c9-9016-63f9ebdadfc4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:37.416142 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8efc4d-3694-43c9-b82c-71eb8a4873e7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:37.438482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:37.450093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf301f-1588-4cae-befe-65e458e7c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:37.450717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf301f-1588-4cae-befe-65e458e7c1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:37.450992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf301f-1588-4cae-befe-65e458e7c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:37.451264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf301f-1588-4cae-befe-65e458e7c1e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:37.451937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf301f-1588-4cae-befe-65e458e7c1e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:37.452236 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf301f-1588-4cae-befe-65e458e7c1e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:37.453675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf301f-1588-4cae-befe-65e458e7c1e9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:37.455526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac6971-228f-45c9-9016-63f9ebdadfc4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:37.462529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 211/440] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:37.463151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf301f-1588-4cae-befe-65e458e7c1e9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:37.476199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:37.490864 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce617031-55c3-4d11-b882-9ab033b78023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:37.491512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce617031-55c3-4d11-b882-9ab033b78023 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:37.491784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce617031-55c3-4d11-b882-9ab033b78023 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:37.492048 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce617031-55c3-4d11-b882-9ab033b78023 None admin] PATH_INFO: `/v3/groups/1ba07586afc340838ab5ab2a97b45d92` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:37.495498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce617031-55c3-4d11-b882-9ab033b78023 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba07586afc340838ab5ab2a97b45d92)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:37.495498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce617031-55c3-4d11-b882-9ab033b78023 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:37.496542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 230/441] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:37 2022] GET /identity/v3/groups/1ba07586afc340838ab5ab2a97b45d92 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:37.497553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8d2f7-a8f2-44cd-9369-1ca753aa76f5 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:37.497889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8d2f7-a8f2-44cd-9369-1ca753aa76f5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:37.498134 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8d2f7-a8f2-44cd-9369-1ca753aa76f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:37.518817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-86f8d2f7-a8f2-44cd-9369-1ca753aa76f5 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:37.520201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-86f8d2f7-a8f2-44cd-9369-1ca753aa76f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:37.588837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 231/442] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:37.589703 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8d2f7-a8f2-44cd-9369-1ca753aa76f5 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:37.596180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf301f-1588-4cae-befe-65e458e7c1e9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:37.637739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178b522-71ea-4624-93f4-f775b6baed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:37.638488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178b522-71ea-4624-93f4-f775b6baed77 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:37.638770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178b522-71ea-4624-93f4-f775b6baed77 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:37.639051 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178b522-71ea-4624-93f4-f775b6baed77 None admin] PATH_INFO: `/v3/groups/1ba07586afc340838ab5ab2a97b45d92` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:37.640897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178b522-71ea-4624-93f4-f775b6baed77 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba07586afc340838ab5ab2a97b45d92)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:37.642595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178b522-71ea-4624-93f4-f775b6baed77 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:37.649621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 212/443] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:37 2022] GET /identity/v3/groups/1ba07586afc340838ab5ab2a97b45d92 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:37.649621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178b522-71ea-4624-93f4-f775b6baed77 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:37.691919 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:37.712160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8d2f7-a8f2-44cd-9369-1ca753aa76f5 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:37.747723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:37.756453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a982c2-ee9a-4131-bd4e-696c94164d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:37.757175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a982c2-ee9a-4131-bd4e-696c94164d82 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:37.757453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a982c2-ee9a-4131-bd4e-696c94164d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:37.757722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a982c2-ee9a-4131-bd4e-696c94164d82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:37.777691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178b522-71ea-4624-93f4-f775b6baed77 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:37.823244 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464b3ec-73d5-4d4d-b3c0-57cdb953a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:37.824280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464b3ec-73d5-4d4d-b3c0-57cdb953a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:37.824917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464b3ec-73d5-4d4d-b3c0-57cdb953a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:37.825460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464b3ec-73d5-4d4d-b3c0-57cdb953a7d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:37.826498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464b3ec-73d5-4d4d-b3c0-57cdb953a7d4 None admin] RBAC: Adding query filter params (group.id=1ba07586afc340838ab5ab2a97b45d92, role.id=db4150b658a14804af1bf240ea2e31f9, scope.project.id=0565423b088f492581b9dc3e0ad10362) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:37.827157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464b3ec-73d5-4d4d-b3c0-57cdb953a7d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:37.829055 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464b3ec-73d5-4d4d-b3c0-57cdb953a7d4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:37.845372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 213/444] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 26 18:10:37 2022] GET /identity/v3/role_assignments?group.id=1ba07586afc340838ab5ab2a97b45d92&scope.project.id=0565423b088f492581b9dc3e0ad10362&role.id=db4150b658a14804af1bf240ea2e31f9 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:37.847989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464b3ec-73d5-4d4d-b3c0-57cdb953a7d4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:37.862887 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a982c2-ee9a-4131-bd4e-696c94164d82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:37.865840 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a982c2-ee9a-4131-bd4e-696c94164d82 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:37.994383 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:37.997666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464b3ec-73d5-4d4d-b3c0-57cdb953a7d4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:38.018701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 232/445] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:38.019909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a982c2-ee9a-4131-bd4e-696c94164d82 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:38.048179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14997cb0-42ce-4b42-99bd-e1ee2d385c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:38.049264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997cb0-42ce-4b42-99bd-e1ee2d385c7a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:38.049767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997cb0-42ce-4b42-99bd-e1ee2d385c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:38.050132 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997cb0-42ce-4b42-99bd-e1ee2d385c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:38.050956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14997cb0-42ce-4b42-99bd-e1ee2d385c7a None admin] RBAC: Adding query filter params (group.id=1ba07586afc340838ab5ab2a97b45d92, role.id=b7d5979aed50487cbf98896a6fa6f162, scope.project.id=7d94df893fa24cea85162a87d72139e8) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:38.051275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14997cb0-42ce-4b42-99bd-e1ee2d385c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:38.053439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14997cb0-42ce-4b42-99bd-e1ee2d385c7a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:38.060234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 214/446] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 26 18:10:37 2022] GET /identity/v3/role_assignments?group.id=1ba07586afc340838ab5ab2a97b45d92&scope.project.id=7d94df893fa24cea85162a87d72139e8&role.id=b7d5979aed50487cbf98896a6fa6f162 => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:38.060749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14997cb0-42ce-4b42-99bd-e1ee2d385c7a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:38.066099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:38.159755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a982c2-ee9a-4131-bd4e-696c94164d82 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:38.210257 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ea3a3-b065-4f0c-9cd9-4cdbb39c2210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:38.210462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14997cb0-42ce-4b42-99bd-e1ee2d385c7a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:38.210927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ea3a3-b065-4f0c-9cd9-4cdbb39c2210 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:38.211205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ea3a3-b065-4f0c-9cd9-4cdbb39c2210 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:38.211478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ea3a3-b065-4f0c-9cd9-4cdbb39c2210 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:38.229397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ea3a3-b065-4f0c-9cd9-4cdbb39c2210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-bb1ea3a3-b065-4f0c-9cd9-4cdbb39c2210 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:38.235594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:38.236832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:38.237835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:38.237835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:38.237835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:38.237835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:38.237835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:38.237835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:38.237835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:38.237835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:38.237835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:38.237835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:38.237835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:10:38.237835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:38.238542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 233/447] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:10:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:38.245440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ea3a3-b065-4f0c-9cd9-4cdbb39c2210 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:38.269044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a003c-c9a9-49d1-a364-799f11fdc015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:38.269695 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a003c-c9a9-49d1-a364-799f11fdc015 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:38.269975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a003c-c9a9-49d1-a364-799f11fdc015 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:38.270242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a003c-c9a9-49d1-a364-799f11fdc015 None admin] PATH_INFO: `/v3/projects/7d94df893fa24cea85162a87d72139e8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:38.271432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a003c-c9a9-49d1-a364-799f11fdc015 None admin] RBAC: Authorizing `identity:get_project(project_id=7d94df893fa24cea85162a87d72139e8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:38.274180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a003c-c9a9-49d1-a364-799f11fdc015 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:38.275869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 215/448] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:38 2022] GET /identity/v3/projects/7d94df893fa24cea85162a87d72139e8 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:38.283515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a003c-c9a9-49d1-a364-799f11fdc015 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:38.311487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:38.378275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:38.388946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ea3a3-b065-4f0c-9cd9-4cdbb39c2210 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:38.413099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a003c-c9a9-49d1-a364-799f11fdc015 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:38.433884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19e21d-0390-4ec3-b03f-6d8dfe7cd012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:38.434517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19e21d-0390-4ec3-b03f-6d8dfe7cd012 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:38.434789 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19e21d-0390-4ec3-b03f-6d8dfe7cd012 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:38.435055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19e21d-0390-4ec3-b03f-6d8dfe7cd012 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:38.435714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19e21d-0390-4ec3-b03f-6d8dfe7cd012 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:38.436015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19e21d-0390-4ec3-b03f-6d8dfe7cd012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:38.438450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19e21d-0390-4ec3-b03f-6d8dfe7cd012 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:38.452465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 234/449] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:38.458525 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19e21d-0390-4ec3-b03f-6d8dfe7cd012 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:38.463778 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5c05f-41d1-457c-ba53-287d7a265d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:38.464583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5c05f-41d1-457c-ba53-287d7a265d31 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:38.465014 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5c05f-41d1-457c-ba53-287d7a265d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:38.465439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5c05f-41d1-457c-ba53-287d7a265d31 None admin] PATH_INFO: `/v3/groups/1ba07586afc340838ab5ab2a97b45d92` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:38.466769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5c05f-41d1-457c-ba53-287d7a265d31 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba07586afc340838ab5ab2a97b45d92)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:38.468349 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5c05f-41d1-457c-ba53-287d7a265d31 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:38.470651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 216/450] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:38 2022] GET /identity/v3/groups/1ba07586afc340838ab5ab2a97b45d92 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:38.478449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5c05f-41d1-457c-ba53-287d7a265d31 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:38.565235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19e21d-0390-4ec3-b03f-6d8dfe7cd012 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:38.572834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:38.582010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5c05f-41d1-457c-ba53-287d7a265d31 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:38.601541 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cec533-6577-4b52-a13a-0ca16c87ce7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:38.602164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cec533-6577-4b52-a13a-0ca16c87ce7b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:38.602437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cec533-6577-4b52-a13a-0ca16c87ce7b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:38.602704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cec533-6577-4b52-a13a-0ca16c87ce7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:38.618155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6add1e7-12c6-4837-85fb-5b631e669cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:38.618772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6add1e7-12c6-4837-85fb-5b631e669cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:38.619051 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6add1e7-12c6-4837-85fb-5b631e669cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:38.619318 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6add1e7-12c6-4837-85fb-5b631e669cd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:38.620053 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6add1e7-12c6-4837-85fb-5b631e669cd0 None admin] RBAC: Adding query filter params (group.id=1ba07586afc340838ab5ab2a97b45d92, role.id=db4150b658a14804af1bf240ea2e31f9, scope.project.id=7d94df893fa24cea85162a87d72139e8) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:38.620362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6add1e7-12c6-4837-85fb-5b631e669cd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:38.621987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6add1e7-12c6-4837-85fb-5b631e669cd0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:38.628243 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 217/451] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 26 18:10:38 2022] GET /identity/v3/role_assignments?group.id=1ba07586afc340838ab5ab2a97b45d92&scope.project.id=7d94df893fa24cea85162a87d72139e8&role.id=db4150b658a14804af1bf240ea2e31f9 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:38.681193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cec533-6577-4b52-a13a-0ca16c87ce7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:38.682708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cec533-6577-4b52-a13a-0ca16c87ce7b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:38.790454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 235/452] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:38.796521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6add1e7-12c6-4837-85fb-5b631e669cd0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:38.800753 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:38.899716 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6add1e7-12c6-4837-85fb-5b631e669cd0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:38.935483 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f32e92-53a2-4b2d-a41c-dc5d12475e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:38.936126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f32e92-53a2-4b2d-a41c-dc5d12475e63 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:38.936419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f32e92-53a2-4b2d-a41c-dc5d12475e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:38.936702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f32e92-53a2-4b2d-a41c-dc5d12475e63 None admin] PATH_INFO: `/v3/projects/8a44db81f3af4ce4ac409fec8e68c2cd` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:38.937909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f32e92-53a2-4b2d-a41c-dc5d12475e63 None admin] RBAC: Authorizing `identity:get_project(project_id=8a44db81f3af4ce4ac409fec8e68c2cd)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:38.939331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f32e92-53a2-4b2d-a41c-dc5d12475e63 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:38.941009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 218/453] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:10:38 2022] GET /identity/v3/projects/8a44db81f3af4ce4ac409fec8e68c2cd => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:38.946976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cec533-6577-4b52-a13a-0ca16c87ce7b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:38.955616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:39.048741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cec533-6577-4b52-a13a-0ca16c87ce7b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:39.087074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f4e8d-3913-49aa-90f6-b6b2aa54d914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:39.087926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f4e8d-3913-49aa-90f6-b6b2aa54d914 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:39.088346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f4e8d-3913-49aa-90f6-b6b2aa54d914 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:39.088788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f4e8d-3913-49aa-90f6-b6b2aa54d914 None admin] PATH_INFO: `/v3/groups/b52c0fc53b364dffa5df518890a32462` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:39.090561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f4e8d-3913-49aa-90f6-b6b2aa54d914 None admin] RBAC: Authorizing `identity:get_group(group_id=b52c0fc53b364dffa5df518890a32462)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:39.092066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f4e8d-3913-49aa-90f6-b6b2aa54d914 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:39.093669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 236/454] 10.222.0.45 () {56 vars in 1180 bytes} [Fri Aug 26 18:10:38 2022] GET /identity/v3/groups/b52c0fc53b364dffa5df518890a32462 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:39.100110 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f32e92-53a2-4b2d-a41c-dc5d12475e63 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:39.173491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:39.205366 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f32e92-53a2-4b2d-a41c-dc5d12475e63 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:39.242528 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d787f0-d9d8-4f0b-b8d4-9f99b70cd6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:39.243130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d787f0-d9d8-4f0b-b8d4-9f99b70cd6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:39.243407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d787f0-d9d8-4f0b-b8d4-9f99b70cd6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:39.243673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d787f0-d9d8-4f0b-b8d4-9f99b70cd6b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:39.244407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d787f0-d9d8-4f0b-b8d4-9f99b70cd6b1 None admin] RBAC: Adding query filter params (group.id=b52c0fc53b364dffa5df518890a32462, role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=8a44db81f3af4ce4ac409fec8e68c2cd) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:39.244749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d787f0-d9d8-4f0b-b8d4-9f99b70cd6b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:39.246171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d787f0-d9d8-4f0b-b8d4-9f99b70cd6b1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:39.252482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 219/455] 10.222.0.45 () {56 vars in 1376 bytes} [Fri Aug 26 18:10:39 2022] GET /identity/v3/role_assignments?group.id=b52c0fc53b364dffa5df518890a32462&scope.project.id=8a44db81f3af4ce4ac409fec8e68c2cd&role.id=db572ad3d504403cbb227c2155c93eda => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:41.810202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d8a18-2d60-490b-9e29-3c7d715db25e None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:41.811290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d8a18-2d60-490b-9e29-3c7d715db25e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:41.811762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d8a18-2d60-490b-9e29-3c7d715db25e None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:41.813699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 237/456] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:41.818981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9b7b-d290-4ddb-a35f-7d2bde674544 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:41.819900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9b7b-d290-4ddb-a35f-7d2bde674544 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:41.820365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9b7b-d290-4ddb-a35f-7d2bde674544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:41.843924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-969d9b7b-d290-4ddb-a35f-7d2bde674544 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:41.845844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-969d9b7b-d290-4ddb-a35f-7d2bde674544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:41.920133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c74348-0fe1-48e1-a9c1-8ef8af7c2d26 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:41.920850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c74348-0fe1-48e1-a9c1-8ef8af7c2d26 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:41.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c74348-0fe1-48e1-a9c1-8ef8af7c2d26 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:41.923177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 238/457] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:41.930504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1d037-45f2-4790-8b44-fc85157adb1e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:41.930787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1d037-45f2-4790-8b44-fc85157adb1e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:41.931226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1d037-45f2-4790-8b44-fc85157adb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:41.942354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 220/458] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:41.957417 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-36d1d037-45f2-4790-8b44-fc85157adb1e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:41.958976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-36d1d037-45f2-4790-8b44-fc85157adb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:42.063695 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 239/459] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:42.141709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e04c-b32d-449c-9413-da872ccc9be2 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:42.141989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e04c-b32d-449c-9413-da872ccc9be2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:42.142461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e04c-b32d-449c-9413-da872ccc9be2 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:42.143995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 221/460] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:42.149507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211ceb1-5e97-4806-ab81-9c5a1690518e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:42.149794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211ceb1-5e97-4806-ab81-9c5a1690518e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:42.150069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211ceb1-5e97-4806-ab81-9c5a1690518e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:42.157649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:42.173261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2211ceb1-5e97-4806-ab81-9c5a1690518e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:42.174482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2211ceb1-5e97-4806-ab81-9c5a1690518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:42.247433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 240/461] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:42.291488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca1930-3efe-4509-a32e-c165b7d53488 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:42.292121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca1930-3efe-4509-a32e-c165b7d53488 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:42.292591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca1930-3efe-4509-a32e-c165b7d53488 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:42.294434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 222/462] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:42.299979 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74a54-fd42-470e-a6ae-e6893c654ab6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:42.300274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74a54-fd42-470e-a6ae-e6893c654ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:42.300552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74a54-fd42-470e-a6ae-e6893c654ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:42.321465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6ec74a54-fd42-470e-a6ae-e6893c654ab6 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:42.322587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6ec74a54-fd42-470e-a6ae-e6893c654ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:42.354805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca1930-3efe-4509-a32e-c165b7d53488 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:42.422551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 241/463] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:42.423781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec74a54-fd42-470e-a6ae-e6893c654ab6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:42.465067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:42.537210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:42.540600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca1930-3efe-4509-a32e-c165b7d53488 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:42.585262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec74a54-fd42-470e-a6ae-e6893c654ab6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:42.620582 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba884ab-c5bb-4a00-893d-15e1a95e295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:42.621808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba884ab-c5bb-4a00-893d-15e1a95e295e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:42.622331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba884ab-c5bb-4a00-893d-15e1a95e295e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:42.622796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba884ab-c5bb-4a00-893d-15e1a95e295e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:42.627486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4144ca4-e8d9-4213-86e4-5b7b9553fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:42.628135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4144ca4-e8d9-4213-86e4-5b7b9553fba0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:42.628414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4144ca4-e8d9-4213-86e4-5b7b9553fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:42.628686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4144ca4-e8d9-4213-86e4-5b7b9553fba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:42.636044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba884ab-c5bb-4a00-893d-15e1a95e295e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:42.638072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba884ab-c5bb-4a00-893d-15e1a95e295e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:42.642244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4144ca4-e8d9-4213-86e4-5b7b9553fba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:42.643778 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4144ca4-e8d9-4213-86e4-5b7b9553fba0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-fba884ab-c5bb-4a00-893d-15e1a95e295e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:42.657116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:42.658107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:42.658925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:42.658925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:42.658925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:42.661105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 223/464] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:42.662561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba884ab-c5bb-4a00-893d-15e1a95e295e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-b4144ca4-e8d9-4213-86e4-5b7b9553fba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:42.663659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:42.664498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:42.665403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:42.665403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:42.665403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:42.665403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 242/465] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:42.666447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4144ca4-e8d9-4213-86e4-5b7b9553fba0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:42.773482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba884ab-c5bb-4a00-893d-15e1a95e295e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:42.779317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4144ca4-e8d9-4213-86e4-5b7b9553fba0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:42.793394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:42.798548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:42.814220 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0d282-f62a-417c-9ff7-20b5088685f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:42.814857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0d282-f62a-417c-9ff7-20b5088685f9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:42.815135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0d282-f62a-417c-9ff7-20b5088685f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:42.815405 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0d282-f62a-417c-9ff7-20b5088685f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:42.818075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29d220-ed50-44f0-b2d6-d730e1f6a78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:42.818639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29d220-ed50-44f0-b2d6-d730e1f6a78c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:42.818883 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29d220-ed50-44f0-b2d6-d730e1f6a78c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:42.819184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29d220-ed50-44f0-b2d6-d730e1f6a78c None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:42.819803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29d220-ed50-44f0-b2d6-d730e1f6a78c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:42.820107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29d220-ed50-44f0-b2d6-d730e1f6a78c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:42.821541 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29d220-ed50-44f0-b2d6-d730e1f6a78c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:42.825940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0d282-f62a-417c-9ff7-20b5088685f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:42.827378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0d282-f62a-417c-9ff7-20b5088685f9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-77e0d282-f62a-417c-9ff7-20b5088685f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:42.841863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:42.842772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:42.843595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:42.843595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:42.843595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:42.843755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 243/466] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:42.843834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 224/467] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:42.843907 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29d220-ed50-44f0-b2d6-d730e1f6a78c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:42.843974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0d282-f62a-417c-9ff7-20b5088685f9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:42.949894 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0d282-f62a-417c-9ff7-20b5088685f9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:42.951704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29d220-ed50-44f0-b2d6-d730e1f6a78c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:42.991589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9bd38-fbfd-4282-8193-1eb476fee646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:42.992619 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9bd38-fbfd-4282-8193-1eb476fee646 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:42.993138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9bd38-fbfd-4282-8193-1eb476fee646 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:42.993620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9bd38-fbfd-4282-8193-1eb476fee646 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:42.994765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9bd38-fbfd-4282-8193-1eb476fee646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:42.995099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bccc34-632f-4d94-95ff-ac6bc99b1418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:42.995269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9bd38-fbfd-4282-8193-1eb476fee646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:42.996659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bccc34-632f-4d94-95ff-ac6bc99b1418 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:42.997055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9bd38-fbfd-4282-8193-1eb476fee646 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:42.997474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bccc34-632f-4d94-95ff-ac6bc99b1418 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:42.997932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bccc34-632f-4d94-95ff-ac6bc99b1418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:43.010658 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bccc34-632f-4d94-95ff-ac6bc99b1418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:43.012391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bccc34-632f-4d94-95ff-ac6bc99b1418 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:43.018057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 244/468] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:43.018057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9bd38-fbfd-4282-8193-1eb476fee646 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f8bccc34-632f-4d94-95ff-ac6bc99b1418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:43.038027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:43.039081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:43.040036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:43.040036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:43.040036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:43.040036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 225/469] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:43.040802 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bccc34-632f-4d94-95ff-ac6bc99b1418 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:43.061895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:43.073866 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:43.154581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9bd38-fbfd-4282-8193-1eb476fee646 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:43.189388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bccc34-632f-4d94-95ff-ac6bc99b1418 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:43.210017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c029185-b61b-47b3-9612-0318cc69002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:43.210971 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c029185-b61b-47b3-9612-0318cc69002f None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:43.211425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c029185-b61b-47b3-9612-0318cc69002f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:43.211869 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c029185-b61b-47b3-9612-0318cc69002f None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:43.212888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c029185-b61b-47b3-9612-0318cc69002f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:43.215443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c029185-b61b-47b3-9612-0318cc69002f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:43.242695 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ed98a-0f41-4960-a8f0-7ae19f870657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:43.243540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ed98a-0f41-4960-a8f0-7ae19f870657 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:43.243957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ed98a-0f41-4960-a8f0-7ae19f870657 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:43.244368 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ed98a-0f41-4960-a8f0-7ae19f870657 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:43.245275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ed98a-0f41-4960-a8f0-7ae19f870657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:43.245720 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ed98a-0f41-4960-a8f0-7ae19f870657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:43.247483 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ed98a-0f41-4960-a8f0-7ae19f870657 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:43.253273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 245/470] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:10:43 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:10:43.254798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c029185-b61b-47b3-9612-0318cc69002f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:43.267610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 226/471] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:43.269697 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ed98a-0f41-4960-a8f0-7ae19f870657 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:43.380845 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:43.387565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:43.396006 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c029185-b61b-47b3-9612-0318cc69002f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:43.412673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ed98a-0f41-4960-a8f0-7ae19f870657 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:43.440459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc519cd-07b0-427a-b327-b50e2df2ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:43.441225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc519cd-07b0-427a-b327-b50e2df2ccf5 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:43.441517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc519cd-07b0-427a-b327-b50e2df2ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:43.441788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc519cd-07b0-427a-b327-b50e2df2ccf5 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:43.442441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc519cd-07b0-427a-b327-b50e2df2ccf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:43.443918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc519cd-07b0-427a-b327-b50e2df2ccf5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:43.472366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 246/472] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:10:43 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:10:43.473278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc519cd-07b0-427a-b327-b50e2df2ccf5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:43.476859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3949-23c4-424b-a8d0-b471104d4631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:43.478852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3949-23c4-424b-a8d0-b471104d4631 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:43.479349 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3949-23c4-424b-a8d0-b471104d4631 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:43.479869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3949-23c4-424b-a8d0-b471104d4631 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:43.480994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f3949-23c4-424b-a8d0-b471104d4631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:43.481519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f3949-23c4-424b-a8d0-b471104d4631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:43.483181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f3949-23c4-424b-a8d0-b471104d4631 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:43.505420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 227/473] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:43.509575 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3949-23c4-424b-a8d0-b471104d4631 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:43.614367 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc519cd-07b0-427a-b327-b50e2df2ccf5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:43.643323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3949-23c4-424b-a8d0-b471104d4631 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:43.662280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416b331-df47-4d08-bed8-7ba8c3fd6185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:43.665201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416b331-df47-4d08-bed8-7ba8c3fd6185 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:43.665201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416b331-df47-4d08-bed8-7ba8c3fd6185 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:43.665201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416b331-df47-4d08-bed8-7ba8c3fd6185 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:43.665201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416b331-df47-4d08-bed8-7ba8c3fd6185 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:43.666919 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416b331-df47-4d08-bed8-7ba8c3fd6185 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:43.689353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbfcc4-4a05-4ab8-92aa-c6962e854e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:43.690330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbfcc4-4a05-4ab8-92aa-c6962e854e1e None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:43.690800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbfcc4-4a05-4ab8-92aa-c6962e854e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:43.691267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbfcc4-4a05-4ab8-92aa-c6962e854e1e None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:43.692398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbfcc4-4a05-4ab8-92aa-c6962e854e1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:43.693680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbfcc4-4a05-4ab8-92aa-c6962e854e1e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:43.694659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 247/474] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:10:43 2022] POST /identity/v3/users => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:10:43.696873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2363a-493e-47e8-86f3-19f42783b031 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:43.697105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2363a-493e-47e8-86f3-19f42783b031 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:43.697388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2363a-493e-47e8-86f3-19f42783b031 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:43.699911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 248/475] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:43.705712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a5a1e-32c3-451a-90a6-fd19a1a614f7 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:43.706038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a5a1e-32c3-451a-90a6-fd19a1a614f7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:43.706316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a5a1e-32c3-451a-90a6-fd19a1a614f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:43.717319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:43.717705 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:43.732855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 228/476] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:10:43 2022] POST /identity/v3/users => generated 249 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:10:43.739026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-882a5a1e-32c3-451a-90a6-fd19a1a614f7 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:43.740547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-882a5a1e-32c3-451a-90a6-fd19a1a614f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:43.826920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 249/477] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:44.106346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbfcc4-4a05-4ab8-92aa-c6962e854e1e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:44.227112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbfcc4-4a05-4ab8-92aa-c6962e854e1e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:44.261757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4b070-fb48-45c5-b714-01f8618f349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:44.262650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4b070-fb48-45c5-b714-01f8618f349b None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:44.262933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4b070-fb48-45c5-b714-01f8618f349b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:44.263207 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4b070-fb48-45c5-b714-01f8618f349b None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:44.263905 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4b070-fb48-45c5-b714-01f8618f349b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:44.265363 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4b070-fb48-45c5-b714-01f8618f349b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:44.278038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.sql.core [None req-a3a4b070-fb48-45c5-b714-01f8618f349b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 18:10:44.278038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 18:10:44.278038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [parameters: {'id': '9b0b3e2d9d5a4f8ba56b23f62681ef18', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 18:10:44.278038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81542) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a3a4b070-fb48-45c5-b714-01f8618f349b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application conn.query(q) Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application result.read() Aug 26 18:10:44.296063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return ref.to_dict() Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 18:10:44.297048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application next(self.gen) Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application yield resource Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application next(self.gen) Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise self.value Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application session.commit() Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 18:10:44.297940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.session.flush() Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application compat.raise_( Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 18:10:44.298828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 18:10:44.299711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application conn.query(q) Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application result.read() Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 18:10:44.300522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [parameters: {'id': '9b0b3e2d9d5a4f8ba56b23f62681ef18', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:44.303401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 18:10:44.305407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:44.313994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 229/478] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Aug 26 18:10:44 2022] POST /identity/v3/roles => generated 144 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:44.316751 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a5a1e-32c3-451a-90a6-fd19a1a614f7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:44.470285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a5a1e-32c3-451a-90a6-fd19a1a614f7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:44.521589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46a6bc-c0c6-4ab3-a50b-aec1ed5fda52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:44.522351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a6bc-c0c6-4ab3-a50b-aec1ed5fda52 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:44.522800 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a6bc-c0c6-4ab3-a50b-aec1ed5fda52 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:44.523172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a6bc-c0c6-4ab3-a50b-aec1ed5fda52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:44.530640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:44.543372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46a6bc-c0c6-4ab3-a50b-aec1ed5fda52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-6e46a6bc-c0c6-4ab3-a50b-aec1ed5fda52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:44.548390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:44.549509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:44.550495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:44.550495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:44.550495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:44.550495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:44.550495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:44.550495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:44.550495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:44.550495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:44.550495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:44.550495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:44.550495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 18:10:44.550495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:44.552427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 250/479] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:10:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:44.561849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4b070-fb48-45c5-b714-01f8618f349b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:44.638491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:44.683535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4b070-fb48-45c5-b714-01f8618f349b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:44.719743 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1d27d-37be-427d-9a35-82d66b65b520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:44.720428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d27d-37be-427d-9a35-82d66b65b520 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:44.720650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d27d-37be-427d-9a35-82d66b65b520 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:44.720939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d27d-37be-427d-9a35-82d66b65b520 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:44.721607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1d27d-37be-427d-9a35-82d66b65b520 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:44.721910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1d27d-37be-427d-9a35-82d66b65b520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:44.723322 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1d27d-37be-427d-9a35-82d66b65b520 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:44.732874 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 230/480] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:45.879855 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335459a1-42ae-4178-8688-18d85eac2ab4 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:45.880366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335459a1-42ae-4178-8688-18d85eac2ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:45.880366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335459a1-42ae-4178-8688-18d85eac2ab4 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:45.882560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 251/481] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:45.887965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a780864-8e28-473c-b998-25949c77e8f1 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:45.888440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a780864-8e28-473c-b998-25949c77e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:45.888531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a780864-8e28-473c-b998-25949c77e8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:45.906925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3a780864-8e28-473c-b998-25949c77e8f1 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:45.908121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3a780864-8e28-473c-b998-25949c77e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:45.992255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 231/482] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:46.047732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d355a-880c-43be-bdc5-4a1d180fe2b0 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:46.048044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d355a-880c-43be-bdc5-4a1d180fe2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:46.048282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d355a-880c-43be-bdc5-4a1d180fe2b0 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:46.049673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 252/483] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:46.054927 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2699b7-fa7d-4fd3-b628-f54301ef49da None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:46.055214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2699b7-fa7d-4fd3-b628-f54301ef49da None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:46.055488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2699b7-fa7d-4fd3-b628-f54301ef49da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:46.075548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-db2699b7-fa7d-4fd3-b628-f54301ef49da None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:46.076750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-db2699b7-fa7d-4fd3-b628-f54301ef49da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:46.131593 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:46.154071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 232/484] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:46.252125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766b8e5-41c7-44b6-946a-bb0c98d22089 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:46.252452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766b8e5-41c7-44b6-946a-bb0c98d22089 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:46.252692 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766b8e5-41c7-44b6-946a-bb0c98d22089 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:46.254077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 253/485] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:46.259755 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a10953-72bb-47e1-9e08-c3b59321dce6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:46.260043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a10953-72bb-47e1-9e08-c3b59321dce6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:46.260330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a10953-72bb-47e1-9e08-c3b59321dce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:46.282908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b1a10953-72bb-47e1-9e08-c3b59321dce6 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:46.284116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b1a10953-72bb-47e1-9e08-c3b59321dce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:46.337289 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766b8e5-41c7-44b6-946a-bb0c98d22089 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:46.385599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 233/486] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:46.386948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281cf51-94a5-46e7-a49a-f6663ce27d78 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:46.387295 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281cf51-94a5-46e7-a49a-f6663ce27d78 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:46.387640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281cf51-94a5-46e7-a49a-f6663ce27d78 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:46.388977 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 234/487] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:46.394591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd527bac-8e31-43e2-ad57-867a7bdd1d9e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:46.394927 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd527bac-8e31-43e2-ad57-867a7bdd1d9e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:46.395210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd527bac-8e31-43e2-ad57-867a7bdd1d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:46.413489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cd527bac-8e31-43e2-ad57-867a7bdd1d9e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:46.414694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cd527bac-8e31-43e2-ad57-867a7bdd1d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:46.478290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766b8e5-41c7-44b6-946a-bb0c98d22089 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:46.520262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a8dc-c9f9-4c44-98d3-c64ccdc9f0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:46.520262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a8dc-c9f9-4c44-98d3-c64ccdc9f0bb None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:46.520262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a8dc-c9f9-4c44-98d3-c64ccdc9f0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:46.520262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a8dc-c9f9-4c44-98d3-c64ccdc9f0bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:46.531544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136a8dc-c9f9-4c44-98d3-c64ccdc9f0bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-2136a8dc-c9f9-4c44-98d3-c64ccdc9f0bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:46.536872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:46.537823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:46.538611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 254/488] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:46.544336 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a8dc-c9f9-4c44-98d3-c64ccdc9f0bb None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:46.566357 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 235/489] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:46.567472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd527bac-8e31-43e2-ad57-867a7bdd1d9e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:46.618772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:46.661156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:46.712831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd527bac-8e31-43e2-ad57-867a7bdd1d9e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:46.719251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a8dc-c9f9-4c44-98d3-c64ccdc9f0bb None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:46.752612 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad1461-f7d9-4b03-a25d-281f66363af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:46.753926 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1461-f7d9-4b03-a25d-281f66363af5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:46.754387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1461-f7d9-4b03-a25d-281f66363af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:46.754580 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64419363-29a6-4493-bbc3-40729373dab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:46.754755 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1461-f7d9-4b03-a25d-281f66363af5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:46.755322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64419363-29a6-4493-bbc3-40729373dab3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:46.755662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64419363-29a6-4493-bbc3-40729373dab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:46.755935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64419363-29a6-4493-bbc3-40729373dab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:46.756611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64419363-29a6-4493-bbc3-40729373dab3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:46.756945 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64419363-29a6-4493-bbc3-40729373dab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:46.758442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64419363-29a6-4493-bbc3-40729373dab3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:46.767384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad1461-f7d9-4b03-a25d-281f66363af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:46.768205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 255/490] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:10:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:46.769119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64419363-29a6-4493-bbc3-40729373dab3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-d4ad1461-f7d9-4b03-a25d-281f66363af5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:46.773267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:46.775353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 236/491] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:46.777225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad1461-f7d9-4b03-a25d-281f66363af5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:46.891449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad1461-f7d9-4b03-a25d-281f66363af5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:46.894417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:46.900136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64419363-29a6-4493-bbc3-40729373dab3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:46.918158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:46.937251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5c5c3-3d19-47ff-a3d7-fa1426f12528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:46.937900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5c5c3-3d19-47ff-a3d7-fa1426f12528 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:46.938176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5c5c3-3d19-47ff-a3d7-fa1426f12528 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:46.938445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5c5c3-3d19-47ff-a3d7-fa1426f12528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:46.939366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9805a4-c959-42dc-aa20-08042406d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:46.940016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9805a4-c959-42dc-aa20-08042406d4fe None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:46.940446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9805a4-c959-42dc-aa20-08042406d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:46.940553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9805a4-c959-42dc-aa20-08042406d4fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:46.949808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5c5c3-3d19-47ff-a3d7-fa1426f12528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:46.951271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5c5c3-3d19-47ff-a3d7-fa1426f12528 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:46.951707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9805a4-c959-42dc-aa20-08042406d4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-9b9805a4-c959-42dc-aa20-08042406d4fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:46.956978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:46.957863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 256/492] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:46.961413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9805a4-c959-42dc-aa20-08042406d4fe None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-06a5c5c3-3d19-47ff-a3d7-fa1426f12528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:46.975330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:46.976286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:46.977160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:46.977160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:46.977160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:46.977160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 237/493] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:46.977957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5c5c3-3d19-47ff-a3d7-fa1426f12528 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:47.085499 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9805a4-c959-42dc-aa20-08042406d4fe None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:47.097311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5c5c3-3d19-47ff-a3d7-fa1426f12528 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:47.124212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b847a-61fe-47ff-b16f-1fa7ae682b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:47.124852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b847a-61fe-47ff-b16f-1fa7ae682b03 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:47.125133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b847a-61fe-47ff-b16f-1fa7ae682b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:47.125406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b847a-61fe-47ff-b16f-1fa7ae682b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:47.126079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b847a-61fe-47ff-b16f-1fa7ae682b03 None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:47.126381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b847a-61fe-47ff-b16f-1fa7ae682b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:47.127782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b847a-61fe-47ff-b16f-1fa7ae682b03 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:47.136253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 257/494] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:10:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:47.137163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b847a-61fe-47ff-b16f-1fa7ae682b03 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:47.146130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211c6e2-1451-4911-83c5-b1014ca612fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:47.147638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c6e2-1451-4911-83c5-b1014ca612fd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:47.148102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c6e2-1451-4911-83c5-b1014ca612fd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:47.149020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c6e2-1451-4911-83c5-b1014ca612fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:47.165589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211c6e2-1451-4911-83c5-b1014ca612fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-7211c6e2-1451-4911-83c5-b1014ca612fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:47.170964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:47.171863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:47.172672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 238/495] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:47.173360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211c6e2-1451-4911-83c5-b1014ca612fd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:47.186347 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:47.197024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:47.262960 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b847a-61fe-47ff-b16f-1fa7ae682b03 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:47.289545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211c6e2-1451-4911-83c5-b1014ca612fd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:47.302794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d1d0f-acd8-4377-9b3f-3b06cce4af37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:47.303414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d1d0f-acd8-4377-9b3f-3b06cce4af37 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:47.303690 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d1d0f-acd8-4377-9b3f-3b06cce4af37 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:47.303967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d1d0f-acd8-4377-9b3f-3b06cce4af37 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:47.304625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d1d0f-acd8-4377-9b3f-3b06cce4af37 None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:47.305156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d1d0f-acd8-4377-9b3f-3b06cce4af37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:47.306670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d1d0f-acd8-4377-9b3f-3b06cce4af37 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:47.320086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 258/496] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:47.321040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d1d0f-acd8-4377-9b3f-3b06cce4af37 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:47.327494 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbca9e-c74e-4432-b9ed-3d26b2ce80ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:47.328125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbca9e-c74e-4432-b9ed-3d26b2ce80ec None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:47.328403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbca9e-c74e-4432-b9ed-3d26b2ce80ec None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:47.328677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbca9e-c74e-4432-b9ed-3d26b2ce80ec None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:47.329368 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbca9e-c74e-4432-b9ed-3d26b2ce80ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:47.329675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbca9e-c74e-4432-b9ed-3d26b2ce80ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:47.331054 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbca9e-c74e-4432-b9ed-3d26b2ce80ec None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:47.343726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 239/497] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:47.344587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbca9e-c74e-4432-b9ed-3d26b2ce80ec None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:47.432758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:47.434523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:47.436829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d1d0f-acd8-4377-9b3f-3b06cce4af37 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:47.460830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbca9e-c74e-4432-b9ed-3d26b2ce80ec None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:47.476108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f8fa5-b8e1-4f8a-9dc1-05c4230b42fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:47.476774 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f8fa5-b8e1-4f8a-9dc1-05c4230b42fe None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:47.477053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f8fa5-b8e1-4f8a-9dc1-05c4230b42fe None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:47.477328 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f8fa5-b8e1-4f8a-9dc1-05c4230b42fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:47.489128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f8fa5-b8e1-4f8a-9dc1-05c4230b42fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:47.490607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f8fa5-b8e1-4f8a-9dc1-05c4230b42fe None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:47.496216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc5a49-37b8-462a-aa19-fe2bbd9e2807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:47.496877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc5a49-37b8-462a-aa19-fe2bbd9e2807 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:47.497163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc5a49-37b8-462a-aa19-fe2bbd9e2807 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:47.497438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc5a49-37b8-462a-aa19-fe2bbd9e2807 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:47.498109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc5a49-37b8-462a-aa19-fe2bbd9e2807 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:47.498421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc5a49-37b8-462a-aa19-fe2bbd9e2807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:47.499828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc5a49-37b8-462a-aa19-fe2bbd9e2807 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-332f8fa5-b8e1-4f8a-9dc1-05c4230b42fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:47.505532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:47.506497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:47.507327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:47.507327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:47.507327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:47.507327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 259/498] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:47.507579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f8fa5-b8e1-4f8a-9dc1-05c4230b42fe None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:47.514286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 240/499] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:47.515207 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc5a49-37b8-462a-aa19-fe2bbd9e2807 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:47.621828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc5a49-37b8-462a-aa19-fe2bbd9e2807 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:47.623196 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f8fa5-b8e1-4f8a-9dc1-05c4230b42fe None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:47.660536 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d396f3-72a3-4025-8cac-7df72165f5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:47.661203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d396f3-72a3-4025-8cac-7df72165f5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:47.661475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d396f3-72a3-4025-8cac-7df72165f5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:47.661748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d396f3-72a3-4025-8cac-7df72165f5b9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:47.663245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df4027-759f-48ce-b322-dda16ba77219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:47.663892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df4027-759f-48ce-b322-dda16ba77219 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:47.664178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df4027-759f-48ce-b322-dda16ba77219 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:47.664452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df4027-759f-48ce-b322-dda16ba77219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:47.670116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d396f3-72a3-4025-8cac-7df72165f5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:47.671589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d396f3-72a3-4025-8cac-7df72165f5b9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:47.673759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:47.676204 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df4027-759f-48ce-b322-dda16ba77219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:47.677731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df4027-759f-48ce-b322-dda16ba77219 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f0d396f3-72a3-4025-8cac-7df72165f5b9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:10:47.688125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:47.689170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:47.690066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:47.690066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:47.690066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:10:47.690066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:10:47.690066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:10:47.690066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:10:47.690066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:10:47.690066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:10:47.690066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 18:10:47.690066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:47.690066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 241/500] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:47.690643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77272307-2a34-49e0-b5f4-356697fc599d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:47.690643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77272307-2a34-49e0-b5f4-356697fc599d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:47.695717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77272307-2a34-49e0-b5f4-356697fc599d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:47.695717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 242/501] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:47.695717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77272307-2a34-49e0-b5f4-356697fc599d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c8df4027-759f-48ce-b322-dda16ba77219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:47.695981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:47.697255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:47.698159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:47.698159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:47.698159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:47.698159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 260/502] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:47.698159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df4027-759f-48ce-b322-dda16ba77219 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:47.700542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:47.804101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77272307-2a34-49e0-b5f4-356697fc599d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:47.809900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df4027-759f-48ce-b322-dda16ba77219 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:47.842339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68469e1-1789-4b91-b743-beab768e2bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:47.842339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68469e1-1789-4b91-b743-beab768e2bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:47.842339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68469e1-1789-4b91-b743-beab768e2bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:47.845462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68469e1-1789-4b91-b743-beab768e2bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:47.845462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68469e1-1789-4b91-b743-beab768e2bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:47.845462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68469e1-1789-4b91-b743-beab768e2bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:47.845807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68469e1-1789-4b91-b743-beab768e2bc4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:47.847403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a6dae-3df7-4834-9a0d-2880bed15699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:47.848060 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a6dae-3df7-4834-9a0d-2880bed15699 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:47.848341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a6dae-3df7-4834-9a0d-2880bed15699 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:47.848651 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a6dae-3df7-4834-9a0d-2880bed15699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:47.861087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 243/503] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:47.862395 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68469e1-1789-4b91-b743-beab768e2bc4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:47.867176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a6dae-3df7-4834-9a0d-2880bed15699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:47.868707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a6dae-3df7-4834-9a0d-2880bed15699 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-2a5a6dae-3df7-4834-9a0d-2880bed15699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:47.885025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:47.886023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:47.886869 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:47.886869 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:47.886869 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:47.886869 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 261/504] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:47.887101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a6dae-3df7-4834-9a0d-2880bed15699 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:47.927807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:47.948553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:47.973146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68469e1-1789-4b91-b743-beab768e2bc4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:47.992583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a6dae-3df7-4834-9a0d-2880bed15699 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:48.007859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30298a66-dda9-4d23-830f-40334ba81685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:48.008513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30298a66-dda9-4d23-830f-40334ba81685 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:48.008776 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30298a66-dda9-4d23-830f-40334ba81685 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:48.009040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30298a66-dda9-4d23-830f-40334ba81685 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:48.009789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30298a66-dda9-4d23-830f-40334ba81685 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:48.010097 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30298a66-dda9-4d23-830f-40334ba81685 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:48.011556 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30298a66-dda9-4d23-830f-40334ba81685 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:48.030047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff788f7-2d56-4028-9e90-d6fe16d857b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:48.030659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff788f7-2d56-4028-9e90-d6fe16d857b7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:48.030940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff788f7-2d56-4028-9e90-d6fe16d857b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:48.031212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff788f7-2d56-4028-9e90-d6fe16d857b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:48.031863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff788f7-2d56-4028-9e90-d6fe16d857b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:48.032170 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff788f7-2d56-4028-9e90-d6fe16d857b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:48.033601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff788f7-2d56-4028-9e90-d6fe16d857b7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:48.045959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 262/505] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:48.047199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2b8f9-9a0d-4d18-ab1c-b68e4c5c12b1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:48.047466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2b8f9-9a0d-4d18-ab1c-b68e4c5c12b1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:48.047739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2b8f9-9a0d-4d18-ab1c-b68e4c5c12b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:48.052770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 244/506] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Aug 26 18:10:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:48.052770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30298a66-dda9-4d23-830f-40334ba81685 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:48.072061 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-77e2b8f9-9a0d-4d18-ab1c-b68e4c5c12b1 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:48.073317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-77e2b8f9-9a0d-4d18-ab1c-b68e4c5c12b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:48.143917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 263/507] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:48.144709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2b8f9-9a0d-4d18-ab1c-b68e4c5c12b1 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:48.156085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30298a66-dda9-4d23-830f-40334ba81685 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:48.173882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:48.192924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfe7a6-f9e5-4882-b160-30b87a0a913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:48.193567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfe7a6-f9e5-4882-b160-30b87a0a913c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:48.193847 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfe7a6-f9e5-4882-b160-30b87a0a913c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:48.194132 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfe7a6-f9e5-4882-b160-30b87a0a913c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:48.200470 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:48.201840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfe7a6-f9e5-4882-b160-30b87a0a913c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:48.203691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfe7a6-f9e5-4882-b160-30b87a0a913c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-facfe7a6-f9e5-4882-b160-30b87a0a913c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:10:48.216567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:48.218516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:48.220311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:48.220311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:48.220311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:10:48.220311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:10:48.220311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:10:48.220311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:10:48.220311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:10:48.220311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:10:48.220311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 18:10:48.220311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:48.220311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 245/508] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:48.220311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfe7a6-f9e5-4882-b160-30b87a0a913c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:48.272480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2b8f9-9a0d-4d18-ab1c-b68e4c5c12b1 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:48.313010 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4f51c-28da-4a11-b690-b0dca4168e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:48.313697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4f51c-28da-4a11-b690-b0dca4168e46 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:48.313940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4f51c-28da-4a11-b690-b0dca4168e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:48.314215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4f51c-28da-4a11-b690-b0dca4168e46 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:48.314869 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4f51c-28da-4a11-b690-b0dca4168e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:48.315164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4f51c-28da-4a11-b690-b0dca4168e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:48.316607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4f51c-28da-4a11-b690-b0dca4168e46 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:48.329575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 264/509] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:48.330426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4f51c-28da-4a11-b690-b0dca4168e46 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:48.342535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfe7a6-f9e5-4882-b160-30b87a0a913c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:48.383462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeeceed-5817-4d02-952d-b4ca5a5be9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:48.384619 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeeceed-5817-4d02-952d-b4ca5a5be9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:48.384941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeeceed-5817-4d02-952d-b4ca5a5be9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:48.385213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeeceed-5817-4d02-952d-b4ca5a5be9c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:48.394200 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeeceed-5817-4d02-952d-b4ca5a5be9c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:48.395904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeeceed-5817-4d02-952d-b4ca5a5be9c2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-edeeceed-5817-4d02-952d-b4ca5a5be9c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:10:48.409477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:48.411341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:48.413506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:48.413506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:48.413506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:10:48.413506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:10:48.413506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:10:48.413506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:10:48.413506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:10:48.413506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:10:48.413506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:10:48.413506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:48.413506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 246/510] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 26 18:10:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:48.413506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeeceed-5817-4d02-952d-b4ca5a5be9c2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:48.447861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4f51c-28da-4a11-b690-b0dca4168e46 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:48.451334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:48.456036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:48.483882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c4170-bcbb-4a46-9ca5-caa70f14543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:48.484498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c4170-bcbb-4a46-9ca5-caa70f14543a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:48.485140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c4170-bcbb-4a46-9ca5-caa70f14543a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:48.485140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c4170-bcbb-4a46-9ca5-caa70f14543a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:48.517987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeeceed-5817-4d02-952d-b4ca5a5be9c2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:48.552237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de9fb-1e65-488d-94b3-a4883c800489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:48.552887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de9fb-1e65-488d-94b3-a4883c800489 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:48.553170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de9fb-1e65-488d-94b3-a4883c800489 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:48.553453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de9fb-1e65-488d-94b3-a4883c800489 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:48.554190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de9fb-1e65-488d-94b3-a4883c800489 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:48.554498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de9fb-1e65-488d-94b3-a4883c800489 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:48.555950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de9fb-1e65-488d-94b3-a4883c800489 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:48.562092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c4170-bcbb-4a46-9ca5-caa70f14543a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:48.563574 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c4170-bcbb-4a46-9ca5-caa70f14543a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:48.573796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 247/511] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Aug 26 18:10:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:48.574803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de9fb-1e65-488d-94b3-a4883c800489 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:48.669109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 265/512] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:48.670453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c4170-bcbb-4a46-9ca5-caa70f14543a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:48.676452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:48.681120 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:48.684689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de9fb-1e65-488d-94b3-a4883c800489 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:48.725524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73025202-800f-43e7-8c76-cffaf84d7213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:48.726087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73025202-800f-43e7-8c76-cffaf84d7213 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:48.726364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73025202-800f-43e7-8c76-cffaf84d7213 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:48.726650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73025202-800f-43e7-8c76-cffaf84d7213 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:48.734119 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73025202-800f-43e7-8c76-cffaf84d7213 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:48.735592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73025202-800f-43e7-8c76-cffaf84d7213 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-73025202-800f-43e7-8c76-cffaf84d7213 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:10:48.747443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:48.748442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:48.749374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:48.749374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:48.749374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:10:48.749374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:10:48.749374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:10:48.749374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:10:48.749374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:10:48.749374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:10:48.749374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 18:10:48.749374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:48.749374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 248/513] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:48.749932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73025202-800f-43e7-8c76-cffaf84d7213 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:48.788961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c4170-bcbb-4a46-9ca5-caa70f14543a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:48.825005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae61b4-9e48-4419-9d0a-c69b39f633e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:48.825628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae61b4-9e48-4419-9d0a-c69b39f633e4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:48.825907 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae61b4-9e48-4419-9d0a-c69b39f633e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:48.826175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae61b4-9e48-4419-9d0a-c69b39f633e4 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:48.826904 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae61b4-9e48-4419-9d0a-c69b39f633e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:48.827209 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae61b4-9e48-4419-9d0a-c69b39f633e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:48.828664 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae61b4-9e48-4419-9d0a-c69b39f633e4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:48.854471 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73025202-800f-43e7-8c76-cffaf84d7213 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:48.866946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 266/514] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 26 18:10:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:48.867810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae61b4-9e48-4419-9d0a-c69b39f633e4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:48.891803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c56739-418c-4dda-86df-3854c2dd8553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:48.892444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c56739-418c-4dda-86df-3854c2dd8553 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:48.892748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c56739-418c-4dda-86df-3854c2dd8553 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:48.893014 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c56739-418c-4dda-86df-3854c2dd8553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:48.904072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c56739-418c-4dda-86df-3854c2dd8553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:48.905572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c56739-418c-4dda-86df-3854c2dd8553 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-60c56739-418c-4dda-86df-3854c2dd8553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:48.920216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:48.921326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:48.922412 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:48.922412 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:48.922412 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:48.925050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 249/515] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:48.925845 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c56739-418c-4dda-86df-3854c2dd8553 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:48.936144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:48.936367 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:48.974130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae61b4-9e48-4419-9d0a-c69b39f633e4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:49.013970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63fc2b-9de5-45de-9404-6419d7563ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:49.014489 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63fc2b-9de5-45de-9404-6419d7563ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:49.014763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63fc2b-9de5-45de-9404-6419d7563ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:49.015031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63fc2b-9de5-45de-9404-6419d7563ba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:49.035538 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c56739-418c-4dda-86df-3854c2dd8553 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:49.069225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b21f3-5a66-4b92-a316-6153553fba35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:49.069861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b21f3-5a66-4b92-a316-6153553fba35 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:49.070140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b21f3-5a66-4b92-a316-6153553fba35 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:49.070420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b21f3-5a66-4b92-a316-6153553fba35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:49.081001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b21f3-5a66-4b92-a316-6153553fba35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:49.082460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b21f3-5a66-4b92-a316-6153553fba35 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:49.086104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63fc2b-9de5-45de-9404-6419d7563ba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:49.087603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63fc2b-9de5-45de-9404-6419d7563ba6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-944b21f3-5a66-4b92-a316-6153553fba35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:49.096563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:49.097527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:49.098384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:49.098384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:49.098384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:49.098384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 250/516] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:49.098596 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b21f3-5a66-4b92-a316-6153553fba35 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:49.153567 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:49.155419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:49.194927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 267/517] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:49.195862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63fc2b-9de5-45de-9404-6419d7563ba6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:49.200065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b21f3-5a66-4b92-a316-6153553fba35 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:49.234819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52a092-f45f-4194-a897-722556b85357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:49.235425 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52a092-f45f-4194-a897-722556b85357 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:49.235697 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52a092-f45f-4194-a897-722556b85357 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:49.235966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52a092-f45f-4194-a897-722556b85357 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:49.236697 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52a092-f45f-4194-a897-722556b85357 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:49.237025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52a092-f45f-4194-a897-722556b85357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:49.238463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52a092-f45f-4194-a897-722556b85357 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:49.255022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 251/518] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Aug 26 18:10:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:49.255814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52a092-f45f-4194-a897-722556b85357 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:49.296984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63fc2b-9de5-45de-9404-6419d7563ba6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:49.331320 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faf3c6-e55b-421f-9fd6-d32416f99db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:49.331945 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faf3c6-e55b-421f-9fd6-d32416f99db3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:49.332225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faf3c6-e55b-421f-9fd6-d32416f99db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:49.332496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faf3c6-e55b-421f-9fd6-d32416f99db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:49.357948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52a092-f45f-4194-a897-722556b85357 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:49.365644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:49.375151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:49.392882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a519e7-84e5-4d2d-b4a9-4b7f5dfe5561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:49.393492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a519e7-84e5-4d2d-b4a9-4b7f5dfe5561 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:49.393765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a519e7-84e5-4d2d-b4a9-4b7f5dfe5561 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:49.394040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a519e7-84e5-4d2d-b4a9-4b7f5dfe5561 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:49.394683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a519e7-84e5-4d2d-b4a9-4b7f5dfe5561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:49.394980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a519e7-84e5-4d2d-b4a9-4b7f5dfe5561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:49.396353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a519e7-84e5-4d2d-b4a9-4b7f5dfe5561 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:49.404432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18faf3c6-e55b-421f-9fd6-d32416f99db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:49.406019 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18faf3c6-e55b-421f-9fd6-d32416f99db3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:49.408350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 252/519] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:49.409217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a519e7-84e5-4d2d-b4a9-4b7f5dfe5561 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:49.511251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 268/520] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:49.512291 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faf3c6-e55b-421f-9fd6-d32416f99db3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:49.512492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a519e7-84e5-4d2d-b4a9-4b7f5dfe5561 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:49.547162 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35d1ad-e006-4e54-92eb-dfd569e3b782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:49.547693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35d1ad-e006-4e54-92eb-dfd569e3b782 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:49.547970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35d1ad-e006-4e54-92eb-dfd569e3b782 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:49.548252 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35d1ad-e006-4e54-92eb-dfd569e3b782 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:49.548926 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35d1ad-e006-4e54-92eb-dfd569e3b782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:49.549226 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35d1ad-e006-4e54-92eb-dfd569e3b782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:49.550599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35d1ad-e006-4e54-92eb-dfd569e3b782 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:49.562389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 253/521] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:49.563237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35d1ad-e006-4e54-92eb-dfd569e3b782 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:49.580065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:49.602388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:49.630269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faf3c6-e55b-421f-9fd6-d32416f99db3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:49.668589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2b425-0afb-4130-8607-026f42333c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:49.669258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2b425-0afb-4130-8607-026f42333c24 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:49.669536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2b425-0afb-4130-8607-026f42333c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:49.669788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2b425-0afb-4130-8607-026f42333c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:49.676240 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35d1ad-e006-4e54-92eb-dfd569e3b782 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:49.680274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2b425-0afb-4130-8607-026f42333c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:49.681783 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2b425-0afb-4130-8607-026f42333c24 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-5fd2b425-0afb-4130-8607-026f42333c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:49.701890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:49.702891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:49.703728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:49.703728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:49.703728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:49.703728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 269/522] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:49.704892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2b425-0afb-4130-8607-026f42333c24 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:49.716041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea679d-154d-4fb0-a67d-36cb09ec6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:49.716739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea679d-154d-4fb0-a67d-36cb09ec6adc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:49.717050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea679d-154d-4fb0-a67d-36cb09ec6adc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:49.717318 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea679d-154d-4fb0-a67d-36cb09ec6adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:49.788987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea679d-154d-4fb0-a67d-36cb09ec6adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:49.790480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea679d-154d-4fb0-a67d-36cb09ec6adc None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:49.815303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2b425-0afb-4130-8607-026f42333c24 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:49.825307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:49.832340 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:49.851286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21320461-f86f-4d63-b3ae-3ddddcc44903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:49.851968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21320461-f86f-4d63-b3ae-3ddddcc44903 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:49.852182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21320461-f86f-4d63-b3ae-3ddddcc44903 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:49.852455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21320461-f86f-4d63-b3ae-3ddddcc44903 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:49.853146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21320461-f86f-4d63-b3ae-3ddddcc44903 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:49.854617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21320461-f86f-4d63-b3ae-3ddddcc44903 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:49.876558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 270/523] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:10:49 2022] POST /identity/v3/users => generated 247 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:10:49.877579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21320461-f86f-4d63-b3ae-3ddddcc44903 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:49.896548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 254/524] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:49.898492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea679d-154d-4fb0-a67d-36cb09ec6adc None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:50.032030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21320461-f86f-4d63-b3ae-3ddddcc44903 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:50.033835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea679d-154d-4fb0-a67d-36cb09ec6adc None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:50.077704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e93ee6-118e-4383-8132-6b10a94d566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:50.077893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322aeea-0fa4-4cd3-9381-7784404c1974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:50.080384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e93ee6-118e-4383-8132-6b10a94d566d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:50.080494 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322aeea-0fa4-4cd3-9381-7784404c1974 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:50.080569 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e93ee6-118e-4383-8132-6b10a94d566d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:50.080637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322aeea-0fa4-4cd3-9381-7784404c1974 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:50.080703 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e93ee6-118e-4383-8132-6b10a94d566d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:50.080849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322aeea-0fa4-4cd3-9381-7784404c1974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:50.081983 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:50.086541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322aeea-0fa4-4cd3-9381-7784404c1974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:50.088076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322aeea-0fa4-4cd3-9381-7784404c1974 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:50.091451 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e93ee6-118e-4383-8132-6b10a94d566d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:50.093228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e93ee6-118e-4383-8132-6b10a94d566d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-0322aeea-0fa4-4cd3-9381-7784404c1974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:10:50.103372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:50.104312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:50.109620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:10:50.109620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:10:50.109620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:10:50.109620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:10:50.109620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:10:50.109620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:10:50.109620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:50.109620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:50.109620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 255/525] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:50.109620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322aeea-0fa4-4cd3-9381-7784404c1974 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-f9e93ee6-118e-4383-8132-6b10a94d566d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:50.110719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:50.111633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:50.112460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:50.112460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:50.112460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:50.112460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 271/526] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:50.112460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e93ee6-118e-4383-8132-6b10a94d566d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:50.141172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:50.223355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e93ee6-118e-4383-8132-6b10a94d566d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:50.235998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322aeea-0fa4-4cd3-9381-7784404c1974 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:50.265474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48ee53-2607-4884-ac42-35dae8e69e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:50.266128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48ee53-2607-4884-ac42-35dae8e69e59 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:50.266421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48ee53-2607-4884-ac42-35dae8e69e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:50.266681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48ee53-2607-4884-ac42-35dae8e69e59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:50.279087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48ee53-2607-4884-ac42-35dae8e69e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:50.280584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48ee53-2607-4884-ac42-35dae8e69e59 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:50.288156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5f168-cc5f-403a-85a4-b448166e95fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:50.288750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5f168-cc5f-403a-85a4-b448166e95fe None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:50.289055 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5f168-cc5f-403a-85a4-b448166e95fe None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:50.289750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5f168-cc5f-403a-85a4-b448166e95fe None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:50.290420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5f168-cc5f-403a-85a4-b448166e95fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:50.290736 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5f168-cc5f-403a-85a4-b448166e95fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:50.292182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5f168-cc5f-403a-85a4-b448166e95fe None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-db48ee53-2607-4884-ac42-35dae8e69e59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:50.297259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:50.298295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:50.299128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:50.299128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:50.299128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:50.303669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 272/527] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:50.304630 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48ee53-2607-4884-ac42-35dae8e69e59 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:50.307543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 256/528] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:50.308417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5f168-cc5f-403a-85a4-b448166e95fe None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:50.379597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:50.398225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:50.423562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48ee53-2607-4884-ac42-35dae8e69e59 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:50.426610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5f168-cc5f-403a-85a4-b448166e95fe None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:50.459395 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235ba7f-ab13-49c6-b55e-1a30ff0b6614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:50.460101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235ba7f-ab13-49c6-b55e-1a30ff0b6614 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:50.460379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235ba7f-ab13-49c6-b55e-1a30ff0b6614 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:50.460689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235ba7f-ab13-49c6-b55e-1a30ff0b6614 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:50.461362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235ba7f-ab13-49c6-b55e-1a30ff0b6614 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:50.461701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235ba7f-ab13-49c6-b55e-1a30ff0b6614 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:50.463092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235ba7f-ab13-49c6-b55e-1a30ff0b6614 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:50.463689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211c75b-06de-4e20-a091-a00e3e472007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:50.464306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211c75b-06de-4e20-a091-a00e3e472007 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:50.464586 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211c75b-06de-4e20-a091-a00e3e472007 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:50.465044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211c75b-06de-4e20-a091-a00e3e472007 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:50.465783 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211c75b-06de-4e20-a091-a00e3e472007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:50.466091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211c75b-06de-4e20-a091-a00e3e472007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:50.467902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211c75b-06de-4e20-a091-a00e3e472007 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:50.485625 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 257/529] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:50.485625 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211c75b-06de-4e20-a091-a00e3e472007 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:50.486410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 273/530] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:50.487112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235ba7f-ab13-49c6-b55e-1a30ff0b6614 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:50.599611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211c75b-06de-4e20-a091-a00e3e472007 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:50.606403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235ba7f-ab13-49c6-b55e-1a30ff0b6614 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:50.616884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:50.637291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc65c26-8c48-47f1-ada9-bcb34de45f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:50.637712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc65c26-8c48-47f1-ada9-bcb34de45f77 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:50.637941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc65c26-8c48-47f1-ada9-bcb34de45f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:50.638218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc65c26-8c48-47f1-ada9-bcb34de45f77 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:50.638873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc65c26-8c48-47f1-ada9-bcb34de45f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:50.639172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc65c26-8c48-47f1-ada9-bcb34de45f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:50.640557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc65c26-8c48-47f1-ada9-bcb34de45f77 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:50.644646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad64ae5-bccf-422a-a680-b151611f7ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:50.645476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad64ae5-bccf-422a-a680-b151611f7ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:50.645898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad64ae5-bccf-422a-a680-b151611f7ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:50.646333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad64ae5-bccf-422a-a680-b151611f7ff6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:50.649608 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:50.658339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 258/531] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:50.658339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc65c26-8c48-47f1-ada9-bcb34de45f77 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:50.660520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad64ae5-bccf-422a-a680-b151611f7ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:50.662199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad64ae5-bccf-422a-a680-b151611f7ff6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-8ad64ae5-bccf-422a-a680-b151611f7ff6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:10:50.674794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:50.675882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:50.677080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:10:50.677080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:10:50.677080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:10:50.677080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:10:50.677080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:10:50.677080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:10:50.677080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:50.677080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:50.677080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 274/532] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:50.677080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad64ae5-bccf-422a-a680-b151611f7ff6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:50.774110 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc65c26-8c48-47f1-ada9-bcb34de45f77 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:50.789498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad64ae5-bccf-422a-a680-b151611f7ff6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:50.813097 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae4747-a731-4816-a267-76dec5dc4ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:50.813740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae4747-a731-4816-a267-76dec5dc4ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:50.814020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae4747-a731-4816-a267-76dec5dc4ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:50.814288 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae4747-a731-4816-a267-76dec5dc4ad1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:50.821624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae4747-a731-4816-a267-76dec5dc4ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:50.823203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae4747-a731-4816-a267-76dec5dc4ad1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:50.828300 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486ed2e-b0fb-4d4e-be7e-a7907bf27b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:50.828941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486ed2e-b0fb-4d4e-be7e-a7907bf27b66 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:50.829220 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486ed2e-b0fb-4d4e-be7e-a7907bf27b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:50.829492 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486ed2e-b0fb-4d4e-be7e-a7907bf27b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:50.830224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486ed2e-b0fb-4d4e-be7e-a7907bf27b66 None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=74ee7b50c34742ce896a734f3ef34a53) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:50.830532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486ed2e-b0fb-4d4e-be7e-a7907bf27b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:50.831990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486ed2e-b0fb-4d4e-be7e-a7907bf27b66 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-e1ae4747-a731-4816-a267-76dec5dc4ad1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:10:50.835806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:50.836633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:50.837539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:10:50.837539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:10:50.837539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:10:50.837539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:10:50.837539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:10:50.837539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:10:50.837539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:50.837539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:50.837539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 259/533] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:50.837998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae4747-a731-4816-a267-76dec5dc4ad1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:50.853086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 275/534] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:50 2022] GET /identity/v3/role_assignments?user.id=74ee7b50c34742ce896a734f3ef34a53&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:50.853086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486ed2e-b0fb-4d4e-be7e-a7907bf27b66 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:50.895314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:50.936696 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:50.977699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae4747-a731-4816-a267-76dec5dc4ad1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:50.998065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486ed2e-b0fb-4d4e-be7e-a7907bf27b66 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:51.029427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34518113-a065-4f3a-a821-2b8644da751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:51.030073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34518113-a065-4f3a-a821-2b8644da751a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:51.030354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34518113-a065-4f3a-a821-2b8644da751a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:51.030629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34518113-a065-4f3a-a821-2b8644da751a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:51.038735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34518113-a065-4f3a-a821-2b8644da751a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:51.040367 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34518113-a065-4f3a-a821-2b8644da751a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:51.046696 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafae31-aa0e-4280-a730-39ea7f7de75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:51.048418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafae31-aa0e-4280-a730-39ea7f7de75a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:51.049135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafae31-aa0e-4280-a730-39ea7f7de75a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:51.049794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafae31-aa0e-4280-a730-39ea7f7de75a None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:51.051082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafae31-aa0e-4280-a730-39ea7f7de75a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:51.051535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafae31-aa0e-4280-a730-39ea7f7de75a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-34518113-a065-4f3a-a821-2b8644da751a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:10:51.053604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:51.054768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:51.056095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:10:51.056095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:10:51.056095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:10:51.056095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:10:51.056095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:10:51.056095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:10:51.056095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:51.056095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:51.056905 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafae31-aa0e-4280-a730-39ea7f7de75a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:51.062264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 260/535] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:51.063307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34518113-a065-4f3a-a821-2b8644da751a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:51.073337 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 276/536] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:51.074449 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafae31-aa0e-4280-a730-39ea7f7de75a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:51.176203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:51.184998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34518113-a065-4f3a-a821-2b8644da751a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:51.192594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafae31-aa0e-4280-a730-39ea7f7de75a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:51.216013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:51.231686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6dbb9-8173-4e22-ae72-6b29983fc048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:51.232312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6dbb9-8173-4e22-ae72-6b29983fc048 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:51.232592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6dbb9-8173-4e22-ae72-6b29983fc048 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:51.232892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6dbb9-8173-4e22-ae72-6b29983fc048 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:51.233678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6dbb9-8173-4e22-ae72-6b29983fc048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:51.233992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6dbb9-8173-4e22-ae72-6b29983fc048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:51.234094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20c507-2748-4b4e-8ae5-44c29abb8120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:51.234904 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20c507-2748-4b4e-8ae5-44c29abb8120 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:51.235374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20c507-2748-4b4e-8ae5-44c29abb8120 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:51.235486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6dbb9-8173-4e22-ae72-6b29983fc048 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:51.235938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20c507-2748-4b4e-8ae5-44c29abb8120 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:51.236853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20c507-2748-4b4e-8ae5-44c29abb8120 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:51.237431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20c507-2748-4b4e-8ae5-44c29abb8120 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:51.239090 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20c507-2748-4b4e-8ae5-44c29abb8120 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:51.256933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 261/538] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:51.257141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6dbb9-8173-4e22-ae72-6b29983fc048 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:51.257464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 277/538] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:51.259166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20c507-2748-4b4e-8ae5-44c29abb8120 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:51.377216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20c507-2748-4b4e-8ae5-44c29abb8120 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:51.379488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6dbb9-8173-4e22-ae72-6b29983fc048 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:51.416642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22192429-0e86-4e9d-aff2-5a4dc8cd1f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:51.417672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192429-0e86-4e9d-aff2-5a4dc8cd1f3b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:51.418171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192429-0e86-4e9d-aff2-5a4dc8cd1f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:51.418719 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192429-0e86-4e9d-aff2-5a4dc8cd1f3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:51.419731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22192429-0e86-4e9d-aff2-5a4dc8cd1f3b None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=78487667b3334cf09fed51b697cbf759) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:51.420238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22192429-0e86-4e9d-aff2-5a4dc8cd1f3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:51.420591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1a034-dce2-46d0-98f3-f4ba5f780764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:51.421237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1a034-dce2-46d0-98f3-f4ba5f780764 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:51.421515 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1a034-dce2-46d0-98f3-f4ba5f780764 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:51.421791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1a034-dce2-46d0-98f3-f4ba5f780764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:51.422521 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1a034-dce2-46d0-98f3-f4ba5f780764 None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=fcfeeb3365ba420c9ff03e5aadee7f66) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:51.422832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1a034-dce2-46d0-98f3-f4ba5f780764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:51.423184 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22192429-0e86-4e9d-aff2-5a4dc8cd1f3b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:51.424279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1a034-dce2-46d0-98f3-f4ba5f780764 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:51.430752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 262/539] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:51 2022] GET /identity/v3/role_assignments?user.id=78487667b3334cf09fed51b697cbf759&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:51.436752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 278/540] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:51 2022] GET /identity/v3/role_assignments?user.id=fcfeeb3365ba420c9ff03e5aadee7f66&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:51.437002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22192429-0e86-4e9d-aff2-5a4dc8cd1f3b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:51.480245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:51.579422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22192429-0e86-4e9d-aff2-5a4dc8cd1f3b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:51.619943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd2c36-acb2-431e-a498-e4886e56c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:51.620606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd2c36-acb2-431e-a498-e4886e56c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:51.620872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd2c36-acb2-431e-a498-e4886e56c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:51.621143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd2c36-acb2-431e-a498-e4886e56c3b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:51.621934 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd2c36-acb2-431e-a498-e4886e56c3b9 None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=3791df34c6e442aaabd90d7f5c2f3a1a) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:51.622243 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd2c36-acb2-431e-a498-e4886e56c3b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:51.623699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd2c36-acb2-431e-a498-e4886e56c3b9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:51.630479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 263/541] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:51 2022] GET /identity/v3/role_assignments?user.id=3791df34c6e442aaabd90d7f5c2f3a1a&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:51.900977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d268e-3252-4f19-ad0e-f38e7605c137 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:51.901173 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d268e-3252-4f19-ad0e-f38e7605c137 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:51.901445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d268e-3252-4f19-ad0e-f38e7605c137 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:51.903253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 279/542] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:51.909505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef49610-00d0-4ffe-ad65-0b277bbf53db None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:51.909809 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef49610-00d0-4ffe-ad65-0b277bbf53db None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:51.910054 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef49610-00d0-4ffe-ad65-0b277bbf53db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:51.933614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-5ef49610-00d0-4ffe-ad65-0b277bbf53db None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:51.934992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5ef49610-00d0-4ffe-ad65-0b277bbf53db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:52.017107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 264/543] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:52.294072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d268e-3252-4f19-ad0e-f38e7605c137 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:52.354313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:52.426995 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d268e-3252-4f19-ad0e-f38e7605c137 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:52.474023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9392487-49f2-461a-b910-7855d718d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:52.474720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9392487-49f2-461a-b910-7855d718d55c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:52.475318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9392487-49f2-461a-b910-7855d718d55c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:52.475591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9392487-49f2-461a-b910-7855d718d55c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:52.493625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9392487-49f2-461a-b910-7855d718d55c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-a9392487-49f2-461a-b910-7855d718d55c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:52.498533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:52.499407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:52.500219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 280/544] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:52.505901 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef49610-00d0-4ffe-ad65-0b277bbf53db None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:52.522929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:52.609797 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef49610-00d0-4ffe-ad65-0b277bbf53db None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:52.645254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b80217-525b-4756-b8b8-4384f4f36daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:52.645872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b80217-525b-4756-b8b8-4384f4f36daa None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:52.646213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b80217-525b-4756-b8b8-4384f4f36daa None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:52.646491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b80217-525b-4756-b8b8-4384f4f36daa None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:52.647163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b80217-525b-4756-b8b8-4384f4f36daa None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:52.647466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b80217-525b-4756-b8b8-4384f4f36daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:52.648870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b80217-525b-4756-b8b8-4384f4f36daa None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:52.657683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 265/545] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:10:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:10:52.663472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9392487-49f2-461a-b910-7855d718d55c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:52.809360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9392487-49f2-461a-b910-7855d718d55c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:52.817970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:52.875504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77b266-740e-4db6-990c-d6ca6bc11b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:52.876062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77b266-740e-4db6-990c-d6ca6bc11b35 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:52.876338 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77b266-740e-4db6-990c-d6ca6bc11b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:52.876605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77b266-740e-4db6-990c-d6ca6bc11b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:52.891909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77b266-740e-4db6-990c-d6ca6bc11b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:52.893427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77b266-740e-4db6-990c-d6ca6bc11b35 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-0c77b266-740e-4db6-990c-d6ca6bc11b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:52.910235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:52.911205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:52.912057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:52.912057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:52.912057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:52.915769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 281/546] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:52.917133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b80217-525b-4756-b8b8-4384f4f36daa None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:53.089105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:53.104334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b80217-525b-4756-b8b8-4384f4f36daa None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:53.152249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75924a-9f4f-48eb-ac25-8964abd8f07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:53.152811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75924a-9f4f-48eb-ac25-8964abd8f07a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:53.153129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75924a-9f4f-48eb-ac25-8964abd8f07a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:53.153405 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75924a-9f4f-48eb-ac25-8964abd8f07a None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:53.154062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75924a-9f4f-48eb-ac25-8964abd8f07a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:53.154369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75924a-9f4f-48eb-ac25-8964abd8f07a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:53.155741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75924a-9f4f-48eb-ac25-8964abd8f07a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:53.173045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 266/547] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:53.173461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77b266-740e-4db6-990c-d6ca6bc11b35 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:53.193213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042821fe-0d36-4928-82ce-f53489bf6d0f None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:53.193552 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042821fe-0d36-4928-82ce-f53489bf6d0f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:53.193765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042821fe-0d36-4928-82ce-f53489bf6d0f None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:53.195385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 267/548] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:10:53.201933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e52d3-0a5d-4c8d-a6ed-5aac55fb552d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:53.202216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e52d3-0a5d-4c8d-a6ed-5aac55fb552d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:53.202503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e52d3-0a5d-4c8d-a6ed-5aac55fb552d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:53.234157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4f1e52d3-0a5d-4c8d-a6ed-5aac55fb552d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:53.235354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4f1e52d3-0a5d-4c8d-a6ed-5aac55fb552d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:53.346279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 268/549] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:53.359529 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77b266-740e-4db6-990c-d6ca6bc11b35 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:53.421391 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87803c-5878-4a1f-859e-1811acb89a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:53.422274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87803c-5878-4a1f-859e-1811acb89a90 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:53.422699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87803c-5878-4a1f-859e-1811acb89a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:53.423109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87803c-5878-4a1f-859e-1811acb89a90 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:53.436665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87803c-5878-4a1f-859e-1811acb89a90 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:53.438372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87803c-5878-4a1f-859e-1811acb89a90 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-5c87803c-5878-4a1f-859e-1811acb89a90 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:10:53.454318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:53.456035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:53.457393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:53.457393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:53.457393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:10:53.457393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:10:53.457393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:10:53.457393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:10:53.457393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:10:53.457393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:10:53.457393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 18:10:53.457393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:53.459236 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 282/550] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:10:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:53.464928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e52d3-0a5d-4c8d-a6ed-5aac55fb552d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:53.568270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:53.618214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e52d3-0a5d-4c8d-a6ed-5aac55fb552d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:53.627389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87803c-5878-4a1f-859e-1811acb89a90 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:53.662313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:53.665032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615cfb5-af1b-4c61-8329-c59f00066c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:53.667982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615cfb5-af1b-4c61-8329-c59f00066c7f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:53.667982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615cfb5-af1b-4c61-8329-c59f00066c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:53.667982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615cfb5-af1b-4c61-8329-c59f00066c7f None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:53.667982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615cfb5-af1b-4c61-8329-c59f00066c7f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:53.667982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615cfb5-af1b-4c61-8329-c59f00066c7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:53.669237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615cfb5-af1b-4c61-8329-c59f00066c7f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:53.691668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 269/551] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Aug 26 18:10:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:53.697677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615cfb5-af1b-4c61-8329-c59f00066c7f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:53.783399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87803c-5878-4a1f-859e-1811acb89a90 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:53.817760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305458-4403-4eb9-b959-74b3c8c11b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:53.818394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305458-4403-4eb9-b959-74b3c8c11b21 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:53.818668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305458-4403-4eb9-b959-74b3c8c11b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:53.818939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305458-4403-4eb9-b959-74b3c8c11b21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:53.829756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f305458-4403-4eb9-b959-74b3c8c11b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-9f305458-4403-4eb9-b959-74b3c8c11b21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:53.835720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:53.836643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:53.837626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 283/552] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:10:53.846164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305458-4403-4eb9-b959-74b3c8c11b21 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:53.891147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615cfb5-af1b-4c61-8329-c59f00066c7f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:53.916770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:53.928360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a2480-3ff4-4f18-b2c5-df9226488760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:53.929149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a2480-3ff4-4f18-b2c5-df9226488760 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:53.929627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a2480-3ff4-4f18-b2c5-df9226488760 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:53.929973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a2480-3ff4-4f18-b2c5-df9226488760 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:53.938051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:53.962699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305458-4403-4eb9-b959-74b3c8c11b21 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:53.997880 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f93293-bed7-4f2e-9488-b39e18ea8420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:53.998480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f93293-bed7-4f2e-9488-b39e18ea8420 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:53.998760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f93293-bed7-4f2e-9488-b39e18ea8420 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:53.999027 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f93293-bed7-4f2e-9488-b39e18ea8420 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:53.999684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f93293-bed7-4f2e-9488-b39e18ea8420 None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:53.999983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f93293-bed7-4f2e-9488-b39e18ea8420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:54.001417 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f93293-bed7-4f2e-9488-b39e18ea8420 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:54.004629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a2480-3ff4-4f18-b2c5-df9226488760 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:54.006109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a2480-3ff4-4f18-b2c5-df9226488760 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:54.009457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 284/553] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:10:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:54.010788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e0ef1-3be7-4f68-bab4-6076ef43c2f7 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.011071 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e0ef1-3be7-4f68-bab4-6076ef43c2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.011336 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e0ef1-3be7-4f68-bab4-6076ef43c2f7 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.013014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 285/554] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:54.013689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43029915-289f-4c98-bd0f-fbbc83337ef1 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.014114 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43029915-289f-4c98-bd0f-fbbc83337ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.014374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43029915-289f-4c98-bd0f-fbbc83337ef1 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.017074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 286/555] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:54.017074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43029915-289f-4c98-bd0f-fbbc83337ef1 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:54.125032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 270/556] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:10:54.126385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11dee0-2749-47ae-a42a-6433a7c47eb8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.126666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11dee0-2749-47ae-a42a-6433a7c47eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.126964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11dee0-2749-47ae-a42a-6433a7c47eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.145734 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cf11dee0-2749-47ae-a42a-6433a7c47eb8 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:54.146945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cf11dee0-2749-47ae-a42a-6433a7c47eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:54.149580 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43029915-289f-4c98-bd0f-fbbc83337ef1 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:54.167838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:54.186704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19449791-aa33-4f43-8303-1742b81bc502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:54.187432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19449791-aa33-4f43-8303-1742b81bc502 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.187767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19449791-aa33-4f43-8303-1742b81bc502 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.188102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19449791-aa33-4f43-8303-1742b81bc502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.195604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:54.200210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19449791-aa33-4f43-8303-1742b81bc502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:54.202054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19449791-aa33-4f43-8303-1742b81bc502 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-19449791-aa33-4f43-8303-1742b81bc502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:54.218077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:54.219028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:54.219893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:54.219893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:54.219893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:54.219893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 287/557] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:54.220781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9ebbd-73f4-46c9-98fe-e6f2fd1fd8ee None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.220781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9ebbd-73f4-46c9-98fe-e6f2fd1fd8ee None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.220938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9ebbd-73f4-46c9-98fe-e6f2fd1fd8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.228727 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 271/558] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:54.228727 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11dee0-2749-47ae-a42a-6433a7c47eb8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:54.248450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-38f9ebbd-73f4-46c9-98fe-e6f2fd1fd8ee None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:54.249684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-38f9ebbd-73f4-46c9-98fe-e6f2fd1fd8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:54.320757 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 288/559] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:54.331711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11dee0-2749-47ae-a42a-6433a7c47eb8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:54.334060 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0788f7-593c-4cb4-978c-92b1ed9fadd3 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.334605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0788f7-593c-4cb4-978c-92b1ed9fadd3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.334605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0788f7-593c-4cb4-978c-92b1ed9fadd3 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.335909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 289/560] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:54 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:54.336807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0788f7-593c-4cb4-978c-92b1ed9fadd3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:54.373732 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c067c-8a1f-4036-ba91-9ff82678427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:54.374395 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c067c-8a1f-4036-ba91-9ff82678427b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.374676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c067c-8a1f-4036-ba91-9ff82678427b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.374995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c067c-8a1f-4036-ba91-9ff82678427b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.386136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c067c-8a1f-4036-ba91-9ff82678427b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:54.387888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c067c-8a1f-4036-ba91-9ff82678427b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b78c067c-8a1f-4036-ba91-9ff82678427b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:54.403709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:54.404694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:54.405627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:54.405627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:54.405627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:54.405627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 272/561] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:54.406269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a33f49-94a2-440c-aa67-ba5d64d540fa None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.406692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a33f49-94a2-440c-aa67-ba5d64d540fa None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.406970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a33f49-94a2-440c-aa67-ba5d64d540fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.420969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:54.427062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-64a33f49-94a2-440c-aa67-ba5d64d540fa None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:54.428284 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-64a33f49-94a2-440c-aa67-ba5d64d540fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:54.479614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0788f7-593c-4cb4-978c-92b1ed9fadd3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:54.508261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:54.508956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 273/562] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:54.509872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a33f49-94a2-440c-aa67-ba5d64d540fa None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:54.537706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00195d6e-f03c-4baa-8dd6-9b2dffd5eddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:54.538895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00195d6e-f03c-4baa-8dd6-9b2dffd5eddd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.539379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00195d6e-f03c-4baa-8dd6-9b2dffd5eddd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.539880 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00195d6e-f03c-4baa-8dd6-9b2dffd5eddd None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.540920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00195d6e-f03c-4baa-8dd6-9b2dffd5eddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:54.541423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00195d6e-f03c-4baa-8dd6-9b2dffd5eddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:54.543197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00195d6e-f03c-4baa-8dd6-9b2dffd5eddd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:54.556914 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 290/563] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:54.558088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00195d6e-f03c-4baa-8dd6-9b2dffd5eddd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:54.613935 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a33f49-94a2-440c-aa67-ba5d64d540fa None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:54.652318 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0b2dd-67f7-4924-bf0d-3aaae2941898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:54.653567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0b2dd-67f7-4924-bf0d-3aaae2941898 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.653862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0b2dd-67f7-4924-bf0d-3aaae2941898 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.654345 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0b2dd-67f7-4924-bf0d-3aaae2941898 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.655116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0b2dd-67f7-4924-bf0d-3aaae2941898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:54.655489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0b2dd-67f7-4924-bf0d-3aaae2941898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:54.657594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0b2dd-67f7-4924-bf0d-3aaae2941898 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:54.660445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:54.668078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00195d6e-f03c-4baa-8dd6-9b2dffd5eddd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:54.680175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 274/564] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:54.680175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0b2dd-67f7-4924-bf0d-3aaae2941898 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:54.703022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eaec59-15dd-4a66-a69b-2bc73d6d13d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:54.703700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaec59-15dd-4a66-a69b-2bc73d6d13d9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.703975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaec59-15dd-4a66-a69b-2bc73d6d13d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.704240 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaec59-15dd-4a66-a69b-2bc73d6d13d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.717444 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eaec59-15dd-4a66-a69b-2bc73d6d13d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-53eaec59-15dd-4a66-a69b-2bc73d6d13d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:54.722937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:54.723851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:54.724776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 291/565] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:54.725782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eaec59-15dd-4a66-a69b-2bc73d6d13d9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:54.776890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:54.794074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0b2dd-67f7-4924-bf0d-3aaae2941898 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:54.828699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4483f-0fbf-4abb-8a7e-1e8fe691d015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:54.829354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4483f-0fbf-4abb-8a7e-1e8fe691d015 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.829632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4483f-0fbf-4abb-8a7e-1e8fe691d015 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.829875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4483f-0fbf-4abb-8a7e-1e8fe691d015 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.837239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eaec59-15dd-4a66-a69b-2bc73d6d13d9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:54.837365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4483f-0fbf-4abb-8a7e-1e8fe691d015 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:54.838734 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4483f-0fbf-4abb-8a7e-1e8fe691d015 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-48b4483f-0fbf-4abb-8a7e-1e8fe691d015 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:10:54.850975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:54.851932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:54.853165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:54.853165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:54.853165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:10:54.853165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:10:54.853165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:10:54.853165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:10:54.853165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:10:54.853165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:10:54.853165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 18:10:54.853165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:54.853165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 275/566] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:54.853165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4483f-0fbf-4abb-8a7e-1e8fe691d015 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:54.876701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f578eba-16a7-474f-8413-e0960902c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:54.877369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f578eba-16a7-474f-8413-e0960902c4da None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.877649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f578eba-16a7-474f-8413-e0960902c4da None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.877921 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f578eba-16a7-474f-8413-e0960902c4da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.887979 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f578eba-16a7-474f-8413-e0960902c4da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1f578eba-16a7-474f-8413-e0960902c4da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:54.893167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:54.894083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 292/567] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:54.897673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f578eba-16a7-474f-8413-e0960902c4da None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:54.909391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:54.952402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4483f-0fbf-4abb-8a7e-1e8fe691d015 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:54.985812 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f31dd8-f593-427a-97d9-f0ea89d2b94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:54.986435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f31dd8-f593-427a-97d9-f0ea89d2b94b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:54.986709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f31dd8-f593-427a-97d9-f0ea89d2b94b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:54.986981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f31dd8-f593-427a-97d9-f0ea89d2b94b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:54.993258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:54.993376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f31dd8-f593-427a-97d9-f0ea89d2b94b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:54.994794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f31dd8-f593-427a-97d9-f0ea89d2b94b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:54.996238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f578eba-16a7-474f-8413-e0960902c4da None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-76f31dd8-f593-427a-97d9-f0ea89d2b94b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:10:55.006140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:55.007079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:55.007949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:10:55.007949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:10:55.007949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:10:55.007949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:10:55.007949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:10:55.007949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:10:55.007949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:55.007949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:55.007949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 276/568] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:55.007949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f31dd8-f593-427a-97d9-f0ea89d2b94b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:55.035946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf54fc9-03e7-46e4-9952-0dcdbf5cb8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.036785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf54fc9-03e7-46e4-9952-0dcdbf5cb8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.037260 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf54fc9-03e7-46e4-9952-0dcdbf5cb8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.037666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf54fc9-03e7-46e4-9952-0dcdbf5cb8c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.038680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf54fc9-03e7-46e4-9952-0dcdbf5cb8c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:55.039169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf54fc9-03e7-46e4-9952-0dcdbf5cb8c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:55.041350 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf54fc9-03e7-46e4-9952-0dcdbf5cb8c4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:55.052263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 293/569] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:10:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:55.053101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf54fc9-03e7-46e4-9952-0dcdbf5cb8c4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:55.137219 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f31dd8-f593-427a-97d9-f0ea89d2b94b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.153714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf54fc9-03e7-46e4-9952-0dcdbf5cb8c4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.159125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:55.178656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea30d2-3bd5-454f-b5d6-d7b6aaa8d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.179299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea30d2-3bd5-454f-b5d6-d7b6aaa8d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.179577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea30d2-3bd5-454f-b5d6-d7b6aaa8d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.179851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea30d2-3bd5-454f-b5d6-d7b6aaa8d9b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.186823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db3826-c834-455d-8307-f14548735420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.187434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db3826-c834-455d-8307-f14548735420 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.187711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db3826-c834-455d-8307-f14548735420 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.187984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db3826-c834-455d-8307-f14548735420 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.188707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db3826-c834-455d-8307-f14548735420 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:55.189049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db3826-c834-455d-8307-f14548735420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:55.190497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db3826-c834-455d-8307-f14548735420 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:55.190814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea30d2-3bd5-454f-b5d6-d7b6aaa8d9b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-80ea30d2-3bd5-454f-b5d6-d7b6aaa8d9b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:55.196010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:55.196981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:55.197796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 277/570] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:55.198490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea30d2-3bd5-454f-b5d6-d7b6aaa8d9b0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:55.211742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 294/571] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Aug 26 18:10:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:55.212586 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db3826-c834-455d-8307-f14548735420 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:55.235547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:55.308653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea30d2-3bd5-454f-b5d6-d7b6aaa8d9b0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.313333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db3826-c834-455d-8307-f14548735420 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.342136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b18ea8-e73a-42c2-8af6-6971ef641d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.343048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b18ea8-e73a-42c2-8af6-6971ef641d7d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.343326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b18ea8-e73a-42c2-8af6-6971ef641d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.343594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b18ea8-e73a-42c2-8af6-6971ef641d7d None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.344255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b18ea8-e73a-42c2-8af6-6971ef641d7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:55.344558 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b18ea8-e73a-42c2-8af6-6971ef641d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:55.345957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b18ea8-e73a-42c2-8af6-6971ef641d7d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:55.347550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9d036-9904-4e91-af60-657b14a51a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.348190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9d036-9904-4e91-af60-657b14a51a2c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.348464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9d036-9904-4e91-af60-657b14a51a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.348812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9d036-9904-4e91-af60-657b14a51a2c None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.349495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9d036-9904-4e91-af60-657b14a51a2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:55.349797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9d036-9904-4e91-af60-657b14a51a2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:55.351550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9d036-9904-4e91-af60-657b14a51a2c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:55.354214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 278/572] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:10:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:55.354875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b18ea8-e73a-42c2-8af6-6971ef641d7d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:55.366414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 295/573] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:10:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:55.367197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9d036-9904-4e91-af60-657b14a51a2c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:55.394522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:55.452251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:55.455852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b18ea8-e73a-42c2-8af6-6971ef641d7d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.472218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9d036-9904-4e91-af60-657b14a51a2c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.490653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e82ed-74d2-40fd-bf15-ee4df41bcd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.491277 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e82ed-74d2-40fd-bf15-ee4df41bcd3a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.491553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e82ed-74d2-40fd-bf15-ee4df41bcd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.491821 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e82ed-74d2-40fd-bf15-ee4df41bcd3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.501966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e82ed-74d2-40fd-bf15-ee4df41bcd3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:55.503414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e82ed-74d2-40fd-bf15-ee4df41bcd3a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:55.507040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102b1d2-926a-4e78-9819-a7b6552b0705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.507658 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102b1d2-926a-4e78-9819-a7b6552b0705 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.507932 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102b1d2-926a-4e78-9819-a7b6552b0705 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.508205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102b1d2-926a-4e78-9819-a7b6552b0705 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.508904 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102b1d2-926a-4e78-9819-a7b6552b0705 None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:55.509210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102b1d2-926a-4e78-9819-a7b6552b0705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:55.510575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102b1d2-926a-4e78-9819-a7b6552b0705 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-701e82ed-74d2-40fd-bf15-ee4df41bcd3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:55.518061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:55.518992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:55.519865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:55.519865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:55.519865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:55.521002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 296/574] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:10:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:55.521831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102b1d2-926a-4e78-9819-a7b6552b0705 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:55.523774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 279/575] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:55.524459 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e82ed-74d2-40fd-bf15-ee4df41bcd3a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:55.614253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:55.619692 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102b1d2-926a-4e78-9819-a7b6552b0705 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.624403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e82ed-74d2-40fd-bf15-ee4df41bcd3a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.657707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb98fa6-372a-4b87-a265-62fb9974e035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.658184 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a28aea-4bad-425e-8291-0f1b2481a371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.658344 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb98fa6-372a-4b87-a265-62fb9974e035 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.658620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb98fa6-372a-4b87-a265-62fb9974e035 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.658819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a28aea-4bad-425e-8291-0f1b2481a371 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.658941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb98fa6-372a-4b87-a265-62fb9974e035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.659101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a28aea-4bad-425e-8291-0f1b2481a371 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.659369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a28aea-4bad-425e-8291-0f1b2481a371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.669216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb98fa6-372a-4b87-a265-62fb9974e035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:55.669611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a28aea-4bad-425e-8291-0f1b2481a371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:55.670697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb98fa6-372a-4b87-a265-62fb9974e035 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:55.671033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a28aea-4bad-425e-8291-0f1b2481a371 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:55.672414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a6a28aea-4bad-425e-8291-0f1b2481a371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:55.685644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:55.686789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:55.687865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:55.687865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:55.687865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-cdb98fa6-372a-4b87-a265-62fb9974e035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:55.688080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:55.689099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:55.690186 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:55.690186 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:55.690186 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:55.690524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 297/576] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:55.691335 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb98fa6-372a-4b87-a265-62fb9974e035 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:55.691737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 280/577] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:55.692582 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a28aea-4bad-425e-8291-0f1b2481a371 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:55.789924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a28aea-4bad-425e-8291-0f1b2481a371 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.794067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb98fa6-372a-4b87-a265-62fb9974e035 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.822761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560f861-dfee-4db8-b0e8-89fe28d879df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.823362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560f861-dfee-4db8-b0e8-89fe28d879df None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.823637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560f861-dfee-4db8-b0e8-89fe28d879df None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.823904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560f861-dfee-4db8-b0e8-89fe28d879df None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.824542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560f861-dfee-4db8-b0e8-89fe28d879df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:55.824870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560f861-dfee-4db8-b0e8-89fe28d879df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:55.826273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560f861-dfee-4db8-b0e8-89fe28d879df None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:55.827241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f6c2-2e4b-4890-933e-ebc755bf1a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.827854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f6c2-2e4b-4890-933e-ebc755bf1a75 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.828132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f6c2-2e4b-4890-933e-ebc755bf1a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.828407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f6c2-2e4b-4890-933e-ebc755bf1a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.829171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2f6c2-2e4b-4890-933e-ebc755bf1a75 None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=98c92b2c982a4780884365a7a7ec6514) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:55.829482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2f6c2-2e4b-4890-933e-ebc755bf1a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:55.830926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2f6c2-2e4b-4890-933e-ebc755bf1a75 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:55.836669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 298/578] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:10:55 2022] GET /identity/v3/role_assignments?user.id=98c92b2c982a4780884365a7a7ec6514&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:55.837372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f6c2-2e4b-4890-933e-ebc755bf1a75 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:55.837781 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 281/579] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:55.838557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560f861-dfee-4db8-b0e8-89fe28d879df None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:55.842880 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:55.910140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:55.957485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560f861-dfee-4db8-b0e8-89fe28d879df None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.960675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f6c2-2e4b-4890-933e-ebc755bf1a75 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:55.997185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c98db1-197b-4e39-8f8e-b7a92800cc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.997570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fbce6-97b3-4723-bcff-8d764b38fd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:55.997794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c98db1-197b-4e39-8f8e-b7a92800cc96 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.998068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c98db1-197b-4e39-8f8e-b7a92800cc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.998188 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fbce6-97b3-4723-bcff-8d764b38fd05 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:55.998347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c98db1-197b-4e39-8f8e-b7a92800cc96 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.998454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fbce6-97b3-4723-bcff-8d764b38fd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:55.998671 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fbce6-97b3-4723-bcff-8d764b38fd05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:55.999037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c98db1-197b-4e39-8f8e-b7a92800cc96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:55.999342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c98db1-197b-4e39-8f8e-b7a92800cc96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:56.000708 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c98db1-197b-4e39-8f8e-b7a92800cc96 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:56.010278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fbce6-97b3-4723-bcff-8d764b38fd05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:56.011749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fbce6-97b3-4723-bcff-8d764b38fd05 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:56.017126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 282/580] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:56.017126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c98db1-197b-4e39-8f8e-b7a92800cc96 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-932fbce6-97b3-4723-bcff-8d764b38fd05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:56.031589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:56.032759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:56.033953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:56.033953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:56.033953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:56.037466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 299/581] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:56.038314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fbce6-97b3-4723-bcff-8d764b38fd05 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:56.087375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:56.136331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c98db1-197b-4e39-8f8e-b7a92800cc96 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:56.146716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fbce6-97b3-4723-bcff-8d764b38fd05 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:56.157239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:56.173977 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e788d8-e509-4eb1-8e6a-061ac4f57cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:56.174581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e788d8-e509-4eb1-8e6a-061ac4f57cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:56.174871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e788d8-e509-4eb1-8e6a-061ac4f57cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:56.175145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e788d8-e509-4eb1-8e6a-061ac4f57cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:56.175892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e788d8-e509-4eb1-8e6a-061ac4f57cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:56.176214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e788d8-e509-4eb1-8e6a-061ac4f57cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:56.177682 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e788d8-e509-4eb1-8e6a-061ac4f57cd1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:56.181251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d877379-f426-4479-b4a7-0ccc44981347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:56.181884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877379-f426-4479-b4a7-0ccc44981347 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:56.182163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877379-f426-4479-b4a7-0ccc44981347 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:56.182434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877379-f426-4479-b4a7-0ccc44981347 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:56.194908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 283/582] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:56.195072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d877379-f426-4479-b4a7-0ccc44981347 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:56.195190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e788d8-e509-4eb1-8e6a-061ac4f57cd1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:56.195279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d877379-f426-4479-b4a7-0ccc44981347 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3d877379-f426-4479-b4a7-0ccc44981347 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:10:56.206725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:56.207689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:56.209282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:56.209282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:56.209282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:10:56.209282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:10:56.209282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:10:56.209282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:10:56.209282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:10:56.209282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:10:56.209282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 18:10:56.209282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:56.209282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 300/583] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:10:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:56.209282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d877379-f426-4479-b4a7-0ccc44981347 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:56.309078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e788d8-e509-4eb1-8e6a-061ac4f57cd1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:56.313023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d877379-f426-4479-b4a7-0ccc44981347 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:56.333208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:56.346936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453fe79-15f5-4251-84b3-390f1385240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:56.347576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453fe79-15f5-4251-84b3-390f1385240f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:56.347680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c864864-f6e5-4423-83b2-8b5da6426c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:56.347851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453fe79-15f5-4251-84b3-390f1385240f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:56.348121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453fe79-15f5-4251-84b3-390f1385240f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:56.348227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c864864-f6e5-4423-83b2-8b5da6426c03 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:56.348471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c864864-f6e5-4423-83b2-8b5da6426c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:56.348761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c864864-f6e5-4423-83b2-8b5da6426c03 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:56.349401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c864864-f6e5-4423-83b2-8b5da6426c03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:56.349700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c864864-f6e5-4423-83b2-8b5da6426c03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:56.351389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c864864-f6e5-4423-83b2-8b5da6426c03 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:56.355477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453fe79-15f5-4251-84b3-390f1385240f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:56.356981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453fe79-15f5-4251-84b3-390f1385240f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:56.367953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 301/584] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:56.367953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c864864-f6e5-4423-83b2-8b5da6426c03 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-3453fe79-15f5-4251-84b3-390f1385240f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:10:56.368849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:56.369683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:56.370543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:10:56.370543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:10:56.370543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:10:56.370543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:10:56.370543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:10:56.370543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:10:56.370543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:56.370543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:56.370543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 284/585] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:56.371014 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453fe79-15f5-4251-84b3-390f1385240f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:56.405178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:56.477305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c864864-f6e5-4423-83b2-8b5da6426c03 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:56.479780 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453fe79-15f5-4251-84b3-390f1385240f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:56.513908 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83ba70-52bf-4dbb-92df-4d15a8ced14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:56.514560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ba70-52bf-4dbb-92df-4d15a8ced14e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:56.514798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ba70-52bf-4dbb-92df-4d15a8ced14e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:56.515079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ba70-52bf-4dbb-92df-4d15a8ced14e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:56.523751 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83ba70-52bf-4dbb-92df-4d15a8ced14e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:56.525244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83ba70-52bf-4dbb-92df-4d15a8ced14e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:56.525649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a608b7-abe8-444c-abd9-af42db60b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:56.526433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a608b7-abe8-444c-abd9-af42db60b63e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:56.526991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a608b7-abe8-444c-abd9-af42db60b63e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:56.528069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a608b7-abe8-444c-abd9-af42db60b63e None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:56.528968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a608b7-abe8-444c-abd9-af42db60b63e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:56.529413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a608b7-abe8-444c-abd9-af42db60b63e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:56.530974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a608b7-abe8-444c-abd9-af42db60b63e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1e83ba70-52bf-4dbb-92df-4d15a8ced14e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:10:56.536825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:56.537901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:56.539091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:56.539091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:56.539091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:10:56.539091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:10:56.539091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:10:56.539091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:10:56.539091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:10:56.539091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:10:56.539091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 18:10:56.539091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:56.542428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 302/586] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:56.543240 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83ba70-52bf-4dbb-92df-4d15a8ced14e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:56.557535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 285/587] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Aug 26 18:10:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:56.557535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a608b7-abe8-444c-abd9-af42db60b63e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:56.600259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:56.639154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:56.649757 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83ba70-52bf-4dbb-92df-4d15a8ced14e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:56.668377 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a608b7-abe8-444c-abd9-af42db60b63e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:56.683926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520fa09-6e2c-4e73-b7f4-937c0d0d122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:56.684975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520fa09-6e2c-4e73-b7f4-937c0d0d122e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:56.685432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520fa09-6e2c-4e73-b7f4-937c0d0d122e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:56.685841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520fa09-6e2c-4e73-b7f4-937c0d0d122e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:56.693980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520fa09-6e2c-4e73-b7f4-937c0d0d122e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:56.695667 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520fa09-6e2c-4e73-b7f4-937c0d0d122e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:56.704771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d252c0-4b88-42f9-bc2b-a02a3ce00cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:56.705401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d252c0-4b88-42f9-bc2b-a02a3ce00cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:56.705661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d252c0-4b88-42f9-bc2b-a02a3ce00cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:56.705924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d252c0-4b88-42f9-bc2b-a02a3ce00cc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:56.706607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d252c0-4b88-42f9-bc2b-a02a3ce00cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:56.706910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d252c0-4b88-42f9-bc2b-a02a3ce00cc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-7520fa09-6e2c-4e73-b7f4-937c0d0d122e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:10:56.707978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:56.709108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:56.710140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:56.710140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:56.710140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:10:56.710140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:10:56.710140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:10:56.710140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:10:56.710140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:10:56.710140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:10:56.710140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:10:56.710140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:56.710683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d252c0-4b88-42f9-bc2b-a02a3ce00cc1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:56.710763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 303/588] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 26 18:10:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:56.710763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520fa09-6e2c-4e73-b7f4-937c0d0d122e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:56.729626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 286/589] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:10:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:56.729626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d252c0-4b88-42f9-bc2b-a02a3ce00cc1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:56.816568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520fa09-6e2c-4e73-b7f4-937c0d0d122e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:56.834164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:56.837761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d252c0-4b88-42f9-bc2b-a02a3ce00cc1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:56.856155 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a6b58-272d-4a23-b4e9-21a14d5c2060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:56.856827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a6b58-272d-4a23-b4e9-21a14d5c2060 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:56.857116 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a6b58-272d-4a23-b4e9-21a14d5c2060 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:56.857392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a6b58-272d-4a23-b4e9-21a14d5c2060 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:56.858128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a6b58-272d-4a23-b4e9-21a14d5c2060 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:56.858438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a6b58-272d-4a23-b4e9-21a14d5c2060 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:56.859920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a6b58-272d-4a23-b4e9-21a14d5c2060 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:56.876109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51316c-63a0-4bcb-b57e-033b0859a1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:56.877153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51316c-63a0-4bcb-b57e-033b0859a1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:56.877605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51316c-63a0-4bcb-b57e-033b0859a1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:56.877803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 304/590] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Aug 26 18:10:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:56.878201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51316c-63a0-4bcb-b57e-033b0859a1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:56.878667 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a6b58-272d-4a23-b4e9-21a14d5c2060 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:56.894321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:56.896963 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51316c-63a0-4bcb-b57e-033b0859a1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:56.898687 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51316c-63a0-4bcb-b57e-033b0859a1d3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-8b51316c-63a0-4bcb-b57e-033b0859a1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:56.913194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:56.914330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:56.915417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:56.915417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:56.915417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:56.916813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 287/591] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:56.917688 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51316c-63a0-4bcb-b57e-033b0859a1d3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:56.991221 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a6b58-272d-4a23-b4e9-21a14d5c2060 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:57.020791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51316c-63a0-4bcb-b57e-033b0859a1d3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:57.028333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45296174-d07b-488e-9f5a-5f7bc5455a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:57.028990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45296174-d07b-488e-9f5a-5f7bc5455a9d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:57.029258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45296174-d07b-488e-9f5a-5f7bc5455a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:57.029522 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45296174-d07b-488e-9f5a-5f7bc5455a9d None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:57.030248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45296174-d07b-488e-9f5a-5f7bc5455a9d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:57.030540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45296174-d07b-488e-9f5a-5f7bc5455a9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:57.031978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45296174-d07b-488e-9f5a-5f7bc5455a9d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:57.053613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 305/592] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 26 18:10:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:57.054531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45296174-d07b-488e-9f5a-5f7bc5455a9d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:57.059743 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62644f67-1b8f-49d1-9bdb-6b2a0eb886d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:57.060414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62644f67-1b8f-49d1-9bdb-6b2a0eb886d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:57.060691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62644f67-1b8f-49d1-9bdb-6b2a0eb886d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:57.061055 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62644f67-1b8f-49d1-9bdb-6b2a0eb886d3 None admin] PATH_INFO: `/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/74ee7b50c34742ce896a734f3ef34a53/roles/5a08ee803b2e44e280fc0c2c4941df8b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:57.076910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62644f67-1b8f-49d1-9bdb-6b2a0eb886d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2803c5ec5ecf4223836ddf75397cc095, user_id=74ee7b50c34742ce896a734f3ef34a53, role_id=5a08ee803b2e44e280fc0c2c4941df8b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:57.078369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62644f67-1b8f-49d1-9bdb-6b2a0eb886d3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:57.092351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 288/593] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:10:56 2022] PUT /identity/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/74ee7b50c34742ce896a734f3ef34a53/roles/5a08ee803b2e44e280fc0c2c4941df8b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:57.093503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62644f67-1b8f-49d1-9bdb-6b2a0eb886d3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:57.096336 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:57.150988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:57.202830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45296174-d07b-488e-9f5a-5f7bc5455a9d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:57.220841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62644f67-1b8f-49d1-9bdb-6b2a0eb886d3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:57.251742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb65d0-14f2-47b7-a9de-03347945ea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:57.252456 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb65d0-14f2-47b7-a9de-03347945ea5e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:57.252882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb65d0-14f2-47b7-a9de-03347945ea5e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:57.253154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb65d0-14f2-47b7-a9de-03347945ea5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:57.266179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb65d0-14f2-47b7-a9de-03347945ea5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:57.266707 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2f5a5-9e58-4dc5-97b9-42399ef524d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:57.267327 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2f5a5-9e58-4dc5-97b9-42399ef524d2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:57.267605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2f5a5-9e58-4dc5-97b9-42399ef524d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:57.267701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb65d0-14f2-47b7-a9de-03347945ea5e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:57.267875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2f5a5-9e58-4dc5-97b9-42399ef524d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:57.268522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2f5a5-9e58-4dc5-97b9-42399ef524d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:57.270018 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2f5a5-9e58-4dc5-97b9-42399ef524d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:57.272360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2f5a5-9e58-4dc5-97b9-42399ef524d2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:57.284089 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 289/594] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:57.285520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2f5a5-9e58-4dc5-97b9-42399ef524d2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-45fb65d0-14f2-47b7-a9de-03347945ea5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:57.289183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:57.290164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:57.291044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:57.291044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:57.291044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:57.291044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 306/595] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:57.291269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb65d0-14f2-47b7-a9de-03347945ea5e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:57.355280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:57.395643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2f5a5-9e58-4dc5-97b9-42399ef524d2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:57.404255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb65d0-14f2-47b7-a9de-03347945ea5e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:57.431475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6707f-00e5-48a2-8494-16de741518eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:57.432114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6707f-00e5-48a2-8494-16de741518eb None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:57.432391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6707f-00e5-48a2-8494-16de741518eb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:57.432659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6707f-00e5-48a2-8494-16de741518eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:57.433200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:57.442682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb8f84-6915-40ac-87de-193cc5f97d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:57.443292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb8f84-6915-40ac-87de-193cc5f97d3e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:57.443696 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb8f84-6915-40ac-87de-193cc5f97d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:57.444067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb8f84-6915-40ac-87de-193cc5f97d3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:57.445435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6707f-00e5-48a2-8494-16de741518eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:57.447246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6707f-00e5-48a2-8494-16de741518eb None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:57.452307 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb8f84-6915-40ac-87de-193cc5f97d3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:57.453941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb8f84-6915-40ac-87de-193cc5f97d3e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b0b6707f-00e5-48a2-8494-16de741518eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:57.463651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:57.464685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:57.466176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:57.466176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:57.466176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-01cb8f84-6915-40ac-87de-193cc5f97d3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:10:57.468094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:57.468967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:57.470371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:10:57.470371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:10:57.470371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:10:57.470371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:10:57.470371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:10:57.470371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:10:57.470371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:57.470371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:57.471006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 290/596] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:57.471986 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6707f-00e5-48a2-8494-16de741518eb None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:57.478532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 307/597] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:57.479619 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb8f84-6915-40ac-87de-193cc5f97d3e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:57.603259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6707f-00e5-48a2-8494-16de741518eb None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:57.604751 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb8f84-6915-40ac-87de-193cc5f97d3e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:57.621897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:57.642746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1111f1c-5139-44ea-a7e1-8c757dc80a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:57.643664 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1111f1c-5139-44ea-a7e1-8c757dc80a02 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:57.644113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1111f1c-5139-44ea-a7e1-8c757dc80a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:57.644551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1111f1c-5139-44ea-a7e1-8c757dc80a02 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:57.645411 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1111f1c-5139-44ea-a7e1-8c757dc80a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:57.645929 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1111f1c-5139-44ea-a7e1-8c757dc80a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:57.647547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1111f1c-5139-44ea-a7e1-8c757dc80a02 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:57.651057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64643e-1018-4870-add0-b98dc0cc1b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:57.651679 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64643e-1018-4870-add0-b98dc0cc1b9b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:57.651964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64643e-1018-4870-add0-b98dc0cc1b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:57.652241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64643e-1018-4870-add0-b98dc0cc1b9b None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:57.652950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64643e-1018-4870-add0-b98dc0cc1b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:57.653291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64643e-1018-4870-add0-b98dc0cc1b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:57.654656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64643e-1018-4870-add0-b98dc0cc1b9b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:57.663492 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 308/598] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:57.664801 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1111f1c-5139-44ea-a7e1-8c757dc80a02 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:57.678949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 291/599] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:57.678949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64643e-1018-4870-add0-b98dc0cc1b9b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:57.715218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:57.778049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1111f1c-5139-44ea-a7e1-8c757dc80a02 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:57.788034 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64643e-1018-4870-add0-b98dc0cc1b9b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:57.813115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fc37f-7dde-4222-8ed9-419bdd279175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:57.813696 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fc37f-7dde-4222-8ed9-419bdd279175 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:57.813986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fc37f-7dde-4222-8ed9-419bdd279175 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:57.814290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fc37f-7dde-4222-8ed9-419bdd279175 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:57.815010 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fc37f-7dde-4222-8ed9-419bdd279175 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:57.815283 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fc37f-7dde-4222-8ed9-419bdd279175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:57.816746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fc37f-7dde-4222-8ed9-419bdd279175 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:57.827001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5214c20-504a-4793-adfe-1033f3acfc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:57.827912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5214c20-504a-4793-adfe-1033f3acfc15 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:57.828408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5214c20-504a-4793-adfe-1033f3acfc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:57.828586 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 309/600] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:10:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:57.829062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5214c20-504a-4793-adfe-1033f3acfc15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:57.829384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fc37f-7dde-4222-8ed9-419bdd279175 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:57.840421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5214c20-504a-4793-adfe-1033f3acfc15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:57.841965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5214c20-504a-4793-adfe-1033f3acfc15 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b5214c20-504a-4793-adfe-1033f3acfc15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:10:57.853759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:57.854653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:57.855542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:10:57.855542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:10:57.855542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:10:57.855542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:10:57.855542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:10:57.855542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:10:57.855542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:57.855542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:57.855542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 292/601] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:57.856794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa781f08-bedc-4aa2-971c-d0dbf2a2a2b2 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:57.856794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa781f08-bedc-4aa2-971c-d0dbf2a2a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:57.856957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa781f08-bedc-4aa2-971c-d0dbf2a2a2b2 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:57.862398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 293/602] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:10:57.862398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa781f08-bedc-4aa2-971c-d0dbf2a2a2b2 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:57.896702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:57.942464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:57.946166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fc37f-7dde-4222-8ed9-419bdd279175 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:57.972623 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa781f08-bedc-4aa2-971c-d0dbf2a2a2b2 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:57.981416 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daff479-7455-48bc-9f9e-55f37dde3596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:57.982056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daff479-7455-48bc-9f9e-55f37dde3596 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:57.982338 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daff479-7455-48bc-9f9e-55f37dde3596 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:57.982975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daff479-7455-48bc-9f9e-55f37dde3596 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:57.990284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daff479-7455-48bc-9f9e-55f37dde3596 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:57.991748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daff479-7455-48bc-9f9e-55f37dde3596 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-6daff479-7455-48bc-9f9e-55f37dde3596 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:10:58.003314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:58.004199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:58.005106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:10:58.005106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:10:58.005106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:10:58.005106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:10:58.005106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:10:58.005106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:10:58.005106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:10:58.005106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:58.005106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 310/603] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:58.005599 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daff479-7455-48bc-9f9e-55f37dde3596 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:58.013228 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d3e87-5c3a-47d1-9114-c931d35868c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:58.013894 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d3e87-5c3a-47d1-9114-c931d35868c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:58.014283 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d3e87-5c3a-47d1-9114-c931d35868c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:58.014562 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d3e87-5c3a-47d1-9114-c931d35868c5 None admin] PATH_INFO: `/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/fcfeeb3365ba420c9ff03e5aadee7f66/roles/5a08ee803b2e44e280fc0c2c4941df8b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:58.031149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d3e87-5c3a-47d1-9114-c931d35868c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2803c5ec5ecf4223836ddf75397cc095, user_id=fcfeeb3365ba420c9ff03e5aadee7f66, role_id=5a08ee803b2e44e280fc0c2c4941df8b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:58.032680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d3e87-5c3a-47d1-9114-c931d35868c5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:58.048101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 294/604] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:10:57 2022] PUT /identity/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/fcfeeb3365ba420c9ff03e5aadee7f66/roles/5a08ee803b2e44e280fc0c2c4941df8b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:58.049327 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3707f-8d86-4089-93bd-fa6a652ba62e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:58.049616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3707f-8d86-4089-93bd-fa6a652ba62e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:58.049889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3707f-8d86-4089-93bd-fa6a652ba62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:58.069372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-25e3707f-8d86-4089-93bd-fa6a652ba62e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:58.070655 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-25e3707f-8d86-4089-93bd-fa6a652ba62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:58.148058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daff479-7455-48bc-9f9e-55f37dde3596 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:58.170889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 295/605] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:10:58.172123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3707f-8d86-4089-93bd-fa6a652ba62e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:58.189701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:58.205050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbe455-3ac4-47ad-89e0-1293b2adef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:58.205834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbe455-3ac4-47ad-89e0-1293b2adef9b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:58.206121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbe455-3ac4-47ad-89e0-1293b2adef9b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:58.206393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbe455-3ac4-47ad-89e0-1293b2adef9b None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:58.207122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbe455-3ac4-47ad-89e0-1293b2adef9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:58.207404 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbe455-3ac4-47ad-89e0-1293b2adef9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:58.208968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbe455-3ac4-47ad-89e0-1293b2adef9b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:58.224313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 311/606] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:58.233940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbe455-3ac4-47ad-89e0-1293b2adef9b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:58.258743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:58.312198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3707f-8d86-4089-93bd-fa6a652ba62e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:58.363162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbe455-3ac4-47ad-89e0-1293b2adef9b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:58.367374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d4e2b-c403-4e01-85ff-96fe3db68ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:58.368149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d4e2b-c403-4e01-85ff-96fe3db68ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:58.368526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d4e2b-c403-4e01-85ff-96fe3db68ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:58.368997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d4e2b-c403-4e01-85ff-96fe3db68ed1 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:58.374566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d4e2b-c403-4e01-85ff-96fe3db68ed1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:58.374996 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d4e2b-c403-4e01-85ff-96fe3db68ed1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:58.376560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d4e2b-c403-4e01-85ff-96fe3db68ed1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:58.402965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 296/607] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:58.407810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d4e2b-c403-4e01-85ff-96fe3db68ed1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:58.437643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da841620-d64e-4643-b503-9f3fe9e9ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:58.439765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da841620-d64e-4643-b503-9f3fe9e9ec0e None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:58.441703 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da841620-d64e-4643-b503-9f3fe9e9ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:58.442105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da841620-d64e-4643-b503-9f3fe9e9ec0e None admin] PATH_INFO: `/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/3791df34c6e442aaabd90d7f5c2f3a1a/roles/5a08ee803b2e44e280fc0c2c4941df8b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:58.478832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da841620-d64e-4643-b503-9f3fe9e9ec0e None admin] RBAC: Authorizing `identity:create_grant(project_id=2803c5ec5ecf4223836ddf75397cc095, user_id=3791df34c6e442aaabd90d7f5c2f3a1a, role_id=5a08ee803b2e44e280fc0c2c4941df8b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:58.480594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da841620-d64e-4643-b503-9f3fe9e9ec0e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:58.503227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 312/608] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:10:58 2022] PUT /identity/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/3791df34c6e442aaabd90d7f5c2f3a1a/roles/5a08ee803b2e44e280fc0c2c4941df8b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:58.526163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da841620-d64e-4643-b503-9f3fe9e9ec0e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:58.531959 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:58.607328 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:58.623183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d4e2b-c403-4e01-85ff-96fe3db68ed1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:58.653619 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da841620-d64e-4643-b503-9f3fe9e9ec0e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:58.678073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d555a-17a1-4566-8dfc-e91b7ab514da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:58.678764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d555a-17a1-4566-8dfc-e91b7ab514da None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:58.679044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d555a-17a1-4566-8dfc-e91b7ab514da None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:58.679594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d555a-17a1-4566-8dfc-e91b7ab514da None admin] PATH_INFO: `/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/78487667b3334cf09fed51b697cbf759/roles/5a08ee803b2e44e280fc0c2c4941df8b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:58.696207 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d555a-17a1-4566-8dfc-e91b7ab514da None admin] RBAC: Authorizing `identity:create_grant(project_id=2803c5ec5ecf4223836ddf75397cc095, user_id=78487667b3334cf09fed51b697cbf759, role_id=5a08ee803b2e44e280fc0c2c4941df8b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:58.697881 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d555a-17a1-4566-8dfc-e91b7ab514da None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:58.716543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 297/609] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:10:58 2022] PUT /identity/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/78487667b3334cf09fed51b697cbf759/roles/5a08ee803b2e44e280fc0c2c4941df8b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:10:58.742758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c66b25-5735-4ffc-b133-5a781cddbef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:58.743548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c66b25-5735-4ffc-b133-5a781cddbef0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:58.743915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c66b25-5735-4ffc-b133-5a781cddbef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:58.744245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c66b25-5735-4ffc-b133-5a781cddbef0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:58.756926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c66b25-5735-4ffc-b133-5a781cddbef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-83c66b25-5735-4ffc-b133-5a781cddbef0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:10:58.762228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:58.763455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:58.764498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:58.764498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:58.764498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:58.764498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:58.764498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:10:58.764498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:10:58.764498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:10:58.764498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:10:58.764498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:10:58.764498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:10:58.764498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:10:58.764498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:58.765403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 313/610] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:10:58.771072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d555a-17a1-4566-8dfc-e91b7ab514da None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:58.890485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d555a-17a1-4566-8dfc-e91b7ab514da None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:58.917052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:58.930067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6bbb-4896-4317-a52d-162d36758f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:58.930773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6bbb-4896-4317-a52d-162d36758f90 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:58.931116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6bbb-4896-4317-a52d-162d36758f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:58.931451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6bbb-4896-4317-a52d-162d36758f90 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:58.932192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff6bbb-4896-4317-a52d-162d36758f90 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:58.932561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff6bbb-4896-4317-a52d-162d36758f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:58.934084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff6bbb-4896-4317-a52d-162d36758f90 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:58.943973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 298/611] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:10:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:58.949478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c66b25-5735-4ffc-b133-5a781cddbef0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:59.080628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c66b25-5735-4ffc-b133-5a781cddbef0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:59.113793 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:59.123472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca8744-990b-4319-97ac-e948ff298aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:59.124116 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca8744-990b-4319-97ac-e948ff298aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:59.124395 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca8744-990b-4319-97ac-e948ff298aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:59.124668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca8744-990b-4319-97ac-e948ff298aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:59.135487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca8744-990b-4319-97ac-e948ff298aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:59.137009 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca8744-990b-4319-97ac-e948ff298aa7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-d7ca8744-990b-4319-97ac-e948ff298aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:10:59.152094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:59.153068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:10:59.153970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:10:59.153970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:10:59.153970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:10:59.153970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 314/612] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:10:59.161997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6bbb-4896-4317-a52d-162d36758f90 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:59.285359 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6bbb-4896-4317-a52d-162d36758f90 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:59.307705 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf52c7d-5e9e-4870-b799-93fe17a7f6ea None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:59.308011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf52c7d-5e9e-4870-b799-93fe17a7f6ea None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:59.308258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf52c7d-5e9e-4870-b799-93fe17a7f6ea None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:59.310002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 315/613] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:10:59.317690 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d202ee3-c3fb-4897-a415-858412ea7f33 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:59.317968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d202ee3-c3fb-4897-a415-858412ea7f33 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:59.318241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d202ee3-c3fb-4897-a415-858412ea7f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:59.342280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2d202ee3-c3fb-4897-a415-858412ea7f33 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:10:59.343507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2d202ee3-c3fb-4897-a415-858412ea7f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:10:59.353066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05fcd9-92ce-41b9-a8ba-0f6b78583e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:59.353688 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05fcd9-92ce-41b9-a8ba-0f6b78583e9d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:59.353968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05fcd9-92ce-41b9-a8ba-0f6b78583e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:59.354243 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05fcd9-92ce-41b9-a8ba-0f6b78583e9d None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:59.354892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05fcd9-92ce-41b9-a8ba-0f6b78583e9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:59.355195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05fcd9-92ce-41b9-a8ba-0f6b78583e9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:59.356611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05fcd9-92ce-41b9-a8ba-0f6b78583e9d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:59.378154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 299/614] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:59.383423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05fcd9-92ce-41b9-a8ba-0f6b78583e9d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:59.459200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 316/615] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:10:59.471665 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:59.551234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05fcd9-92ce-41b9-a8ba-0f6b78583e9d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:59.605378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad65c26-ac47-453e-8d5e-96d3eeb3c11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:59.606019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad65c26-ac47-453e-8d5e-96d3eeb3c11b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:59.606334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad65c26-ac47-453e-8d5e-96d3eeb3c11b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:59.606612 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad65c26-ac47-453e-8d5e-96d3eeb3c11b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:59.613665 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad65c26-ac47-453e-8d5e-96d3eeb3c11b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:59.615124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad65c26-ac47-453e-8d5e-96d3eeb3c11b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-cad65c26-ac47-453e-8d5e-96d3eeb3c11b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:10:59.638106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:10:59.639270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:10:59.640329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:10:59.640329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:10:59.640329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:10:59.640329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:10:59.640329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:10:59.640329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:10:59.640329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:10:59.640329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:10:59.640329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 18:10:59.640329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:10:59.640329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 300/616] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:10:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:10:59.645241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d202ee3-c3fb-4897-a415-858412ea7f33 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:59.824944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad65c26-ac47-453e-8d5e-96d3eeb3c11b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:10:59.850677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d202ee3-c3fb-4897-a415-858412ea7f33 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:10:59.871248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:10:59.914243 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcead2b-0463-4eee-9348-5e316d61d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:10:59.914867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcead2b-0463-4eee-9348-5e316d61d530 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:10:59.915143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcead2b-0463-4eee-9348-5e316d61d530 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:10:59.915415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcead2b-0463-4eee-9348-5e316d61d530 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:10:59.916147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcead2b-0463-4eee-9348-5e316d61d530 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:10:59.916451 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcead2b-0463-4eee-9348-5e316d61d530 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:10:59.917932 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcead2b-0463-4eee-9348-5e316d61d530 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:10:59.957698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 317/617] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Aug 26 18:10:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:10:59.961956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcead2b-0463-4eee-9348-5e316d61d530 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:00.032259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad65c26-ac47-453e-8d5e-96d3eeb3c11b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:00.042902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:00.094259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0940-1bc1-4ee4-9bdc-364f087d5950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:00.094816 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0940-1bc1-4ee4-9bdc-364f087d5950 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:00.095095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0940-1bc1-4ee4-9bdc-364f087d5950 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:00.095366 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0940-1bc1-4ee4-9bdc-364f087d5950 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:00.114216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d0940-1bc1-4ee4-9bdc-364f087d5950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-5d2d0940-1bc1-4ee4-9bdc-364f087d5950 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:00.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:00.120696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:00.121765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:00.121765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:00.121765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:00.121765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:00.121765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:00.121765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:00.121765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:00.121765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:00.121765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:00.121765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:00.121765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:00.121765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:00.127857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 301/618] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:10:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:00.129773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0940-1bc1-4ee4-9bdc-364f087d5950 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:00.134804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcead2b-0463-4eee-9348-5e316d61d530 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:00.189210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe8667-0a89-4b69-b5e9-31ad391005b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:00.189849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe8667-0a89-4b69-b5e9-31ad391005b4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:00.190127 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe8667-0a89-4b69-b5e9-31ad391005b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:00.190398 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe8667-0a89-4b69-b5e9-31ad391005b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:00.208388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe8667-0a89-4b69-b5e9-31ad391005b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:00.210047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe8667-0a89-4b69-b5e9-31ad391005b4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-65fe8667-0a89-4b69-b5e9-31ad391005b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:00.236174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:00.237358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:00.238234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:00.238234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:00.238234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:00.243486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 318/619] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:00.247486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe8667-0a89-4b69-b5e9-31ad391005b4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:00.291362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:00.296526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0940-1bc1-4ee4-9bdc-364f087d5950 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:00.330451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e861a7-f892-46ca-8e69-c6c16f0d3b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:00.331439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e861a7-f892-46ca-8e69-c6c16f0d3b4d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:00.331920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e861a7-f892-46ca-8e69-c6c16f0d3b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:00.332380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e861a7-f892-46ca-8e69-c6c16f0d3b4d None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:00.333296 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e861a7-f892-46ca-8e69-c6c16f0d3b4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:00.333695 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e861a7-f892-46ca-8e69-c6c16f0d3b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:00.335246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e861a7-f892-46ca-8e69-c6c16f0d3b4d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:00.348828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 302/620] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:11:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:00.348828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50faf44-65fd-4826-ab82-56e16bd0e4fc None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:00.348828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50faf44-65fd-4826-ab82-56e16bd0e4fc None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:00.348828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50faf44-65fd-4826-ab82-56e16bd0e4fc None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:00.348828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 303/621] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:00.349856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50faf44-65fd-4826-ab82-56e16bd0e4fc None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:00.379325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:00.408865 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe8667-0a89-4b69-b5e9-31ad391005b4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:00.446550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9bc7b-4df6-4901-a0d7-7be8b683be44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:00.447586 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9bc7b-4df6-4901-a0d7-7be8b683be44 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:00.448083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9bc7b-4df6-4901-a0d7-7be8b683be44 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:00.448494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9bc7b-4df6-4901-a0d7-7be8b683be44 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:00.449316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9bc7b-4df6-4901-a0d7-7be8b683be44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:00.449756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9bc7b-4df6-4901-a0d7-7be8b683be44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:00.451649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9bc7b-4df6-4901-a0d7-7be8b683be44 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:00.458137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50faf44-65fd-4826-ab82-56e16bd0e4fc None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:00.465607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 319/622] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:00.467235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6070f-4e40-4e29-b182-47d514b4a267 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:00.467697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6070f-4e40-4e29-b182-47d514b4a267 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:00.468271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6070f-4e40-4e29-b182-47d514b4a267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:00.489142 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e7a6070f-4e40-4e29-b182-47d514b4a267 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:00.490782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e7a6070f-4e40-4e29-b182-47d514b4a267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:00.493765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa2a56-733e-491f-b5d7-3c7d8b6fe113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:00.494486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa2a56-733e-491f-b5d7-3c7d8b6fe113 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:00.494858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa2a56-733e-491f-b5d7-3c7d8b6fe113 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:00.495191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa2a56-733e-491f-b5d7-3c7d8b6fe113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:00.505985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa2a56-733e-491f-b5d7-3c7d8b6fe113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:00.507547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa2a56-733e-491f-b5d7-3c7d8b6fe113 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-52fa2a56-733e-491f-b5d7-3c7d8b6fe113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:00.522877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:00.523916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:00.525153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:00.525153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:00.525153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:00.528952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 304/623] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:00.529895 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa2a56-733e-491f-b5d7-3c7d8b6fe113 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:00.588753 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 320/624] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:11:00.588753 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6070f-4e40-4e29-b182-47d514b4a267 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:00.598143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:00.659577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:00.701005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6070f-4e40-4e29-b182-47d514b4a267 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:00.706024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa2a56-733e-491f-b5d7-3c7d8b6fe113 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:00.740165 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd337-0c01-4f28-8067-7809aa210f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:00.740913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd337-0c01-4f28-8067-7809aa210f6d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:00.741357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd337-0c01-4f28-8067-7809aa210f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:00.741712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd337-0c01-4f28-8067-7809aa210f6d None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:00.742420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cd337-0c01-4f28-8067-7809aa210f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:00.742786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cd337-0c01-4f28-8067-7809aa210f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:00.748750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cd337-0c01-4f28-8067-7809aa210f6d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:00.758715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 321/625] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:00.764540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd337-0c01-4f28-8067-7809aa210f6d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:00.785428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beb36a-6b97-4998-8d9a-af814e8e51b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:00.786409 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beb36a-6b97-4998-8d9a-af814e8e51b6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:00.786942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beb36a-6b97-4998-8d9a-af814e8e51b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:00.787390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beb36a-6b97-4998-8d9a-af814e8e51b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:00.801889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40beb36a-6b97-4998-8d9a-af814e8e51b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:00.803685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40beb36a-6b97-4998-8d9a-af814e8e51b6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-40beb36a-6b97-4998-8d9a-af814e8e51b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:00.826846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:00.828251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:00.829206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:00.829206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:00.829206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:00.829206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:00.829206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:00.829206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:00.829206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:00.829206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:00.831627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 305/626] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:00.837018 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beb36a-6b97-4998-8d9a-af814e8e51b6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:00.855432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:00.904245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd337-0c01-4f28-8067-7809aa210f6d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:00.941154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747353f7-713e-4b6e-8a4c-b0a7b3c101fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:00.941796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747353f7-713e-4b6e-8a4c-b0a7b3c101fa None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:00.942074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747353f7-713e-4b6e-8a4c-b0a7b3c101fa None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:00.942347 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747353f7-713e-4b6e-8a4c-b0a7b3c101fa None admin] PATH_INFO: `/v3/users/glance` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:00.949953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747353f7-713e-4b6e-8a4c-b0a7b3c101fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:00.951445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747353f7-713e-4b6e-8a4c-b0a7b3c101fa None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-747353f7-713e-4b6e-8a4c-b0a7b3c101fa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:00.966092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:00.967073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:00.968013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:00.968013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:00.968013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:00.968013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:00.968013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:00.968013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:00.968013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:00.968013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:00.968013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 18:11:00.968013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:00.968013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 322/627] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:11:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:00.968631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beb36a-6b97-4998-8d9a-af814e8e51b6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:00.969225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c175246-2b98-4b65-9e53-53e75dc69f86 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:00.969434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c175246-2b98-4b65-9e53-53e75dc69f86 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:00.969704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c175246-2b98-4b65-9e53-53e75dc69f86 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:00.972831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 323/628] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:00.974116 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90341-2ce9-4834-85ae-f0375a9304d9 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:00.974570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90341-2ce9-4834-85ae-f0375a9304d9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:00.975009 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90341-2ce9-4834-85ae-f0375a9304d9 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:00.976850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 324/629] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:00.977738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90341-2ce9-4834-85ae-f0375a9304d9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:01.008097 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172b45-1b5c-4f36-92c0-a48f53f14b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:01.008739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172b45-1b5c-4f36-92c0-a48f53f14b36 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:01.009021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172b45-1b5c-4f36-92c0-a48f53f14b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:01.009290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172b45-1b5c-4f36-92c0-a48f53f14b36 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:01.009982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172b45-1b5c-4f36-92c0-a48f53f14b36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:01.010284 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172b45-1b5c-4f36-92c0-a48f53f14b36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:01.011711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172b45-1b5c-4f36-92c0-a48f53f14b36 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:01.020511 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:01.024280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 306/630] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:01.025541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be2100-167c-4b0f-8072-23fc6d6fbca6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:01.025963 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be2100-167c-4b0f-8072-23fc6d6fbca6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:01.026083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be2100-167c-4b0f-8072-23fc6d6fbca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:01.043535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b8be2100-167c-4b0f-8072-23fc6d6fbca6 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:01.044775 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b8be2100-167c-4b0f-8072-23fc6d6fbca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:01.082239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90341-2ce9-4834-85ae-f0375a9304d9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:01.110855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 307/631] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:11:01.111469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:01.112223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0449b72-02e2-446e-b648-0c41cc870dae None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:01.112407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0449b72-02e2-446e-b648-0c41cc870dae None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:01.112734 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0449b72-02e2-446e-b648-0c41cc870dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:01.123642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3db69-cc3b-4b45-838d-641492c0bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:01.124262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3db69-cc3b-4b45-838d-641492c0bf1e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:01.124534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3db69-cc3b-4b45-838d-641492c0bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:01.124841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3db69-cc3b-4b45-838d-641492c0bf1e None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:01.125572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3db69-cc3b-4b45-838d-641492c0bf1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:01.125890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3db69-cc3b-4b45-838d-641492c0bf1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:01.127326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3db69-cc3b-4b45-838d-641492c0bf1e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:01.131636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c0449b72-02e2-446e-b648-0c41cc870dae None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:01.132840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c0449b72-02e2-446e-b648-0c41cc870dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:01.145386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 325/632] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Aug 26 18:11:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:01.146202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3db69-cc3b-4b45-838d-641492c0bf1e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:01.209553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 308/633] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:11:01.210233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0449b72-02e2-446e-b648-0c41cc870dae None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:01.259385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3db69-cc3b-4b45-838d-641492c0bf1e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:01.287740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:01.303106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28117e-24d4-48a6-8b12-f85e8f527022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:01.303746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28117e-24d4-48a6-8b12-f85e8f527022 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:01.304022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28117e-24d4-48a6-8b12-f85e8f527022 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:01.304290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28117e-24d4-48a6-8b12-f85e8f527022 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:01.316866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28117e-24d4-48a6-8b12-f85e8f527022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-6f28117e-24d4-48a6-8b12-f85e8f527022 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:01.322516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:01.323458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:01.324303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 326/634] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:11:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:01.325193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28117e-24d4-48a6-8b12-f85e8f527022 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:01.337811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0449b72-02e2-446e-b648-0c41cc870dae None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:01.373734 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da4c83-ed08-40c6-8bb6-74940a70d6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:01.374868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da4c83-ed08-40c6-8bb6-74940a70d6b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:01.375344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da4c83-ed08-40c6-8bb6-74940a70d6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:01.375621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da4c83-ed08-40c6-8bb6-74940a70d6b0 None admin] PATH_INFO: `/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/98c92b2c982a4780884365a7a7ec6514/roles/5a08ee803b2e44e280fc0c2c4941df8b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:01.382516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:01.392737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da4c83-ed08-40c6-8bb6-74940a70d6b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2803c5ec5ecf4223836ddf75397cc095, user_id=98c92b2c982a4780884365a7a7ec6514, role_id=5a08ee803b2e44e280fc0c2c4941df8b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:01.394211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da4c83-ed08-40c6-8bb6-74940a70d6b0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:01.408763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 309/635] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:11:01 2022] PUT /identity/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/98c92b2c982a4780884365a7a7ec6514/roles/5a08ee803b2e44e280fc0c2c4941df8b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:11:01.409673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da4c83-ed08-40c6-8bb6-74940a70d6b0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:01.437702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28117e-24d4-48a6-8b12-f85e8f527022 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:01.478830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdbc89-ea6e-4856-a8c7-5802891d3f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:01.479524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdbc89-ea6e-4856-a8c7-5802891d3f50 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:01.479857 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdbc89-ea6e-4856-a8c7-5802891d3f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:01.480133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdbc89-ea6e-4856-a8c7-5802891d3f50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:01.549197 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da4c83-ed08-40c6-8bb6-74940a70d6b0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:01.562968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:01.564842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdbc89-ea6e-4856-a8c7-5802891d3f50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:01.566549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdbc89-ea6e-4856-a8c7-5802891d3f50 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:01.599420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8838fd0-deec-4095-bd6f-cfd913159ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:01.600618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838fd0-deec-4095-bd6f-cfd913159ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:01.601118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838fd0-deec-4095-bd6f-cfd913159ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:01.601531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838fd0-deec-4095-bd6f-cfd913159ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:01.603449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8838fd0-deec-4095-bd6f-cfd913159ab5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:01.603894 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8838fd0-deec-4095-bd6f-cfd913159ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:01.606129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8838fd0-deec-4095-bd6f-cfd913159ab5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:01.615318 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 310/636] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:11:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:01.616162 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8838fd0-deec-4095-bd6f-cfd913159ab5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:01.622996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:01.677112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 327/637] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:11:01.678374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdbc89-ea6e-4856-a8c7-5802891d3f50 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:01.729113 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8838fd0-deec-4095-bd6f-cfd913159ab5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:01.764180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1590f20-059c-4454-95df-75b85c7625cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:01.764871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1590f20-059c-4454-95df-75b85c7625cc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:01.765145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1590f20-059c-4454-95df-75b85c7625cc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:01.765413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1590f20-059c-4454-95df-75b85c7625cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:01.775832 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1590f20-059c-4454-95df-75b85c7625cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-e1590f20-059c-4454-95df-75b85c7625cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:01.781100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:01.782009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:01.782834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 311/638] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:11:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:01.783520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1590f20-059c-4454-95df-75b85c7625cc None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:01.787323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdbc89-ea6e-4856-a8c7-5802891d3f50 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:01.821420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:01.824108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203ff92-e72d-4fb4-84d2-5c9dec4bb265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:01.825044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203ff92-e72d-4fb4-84d2-5c9dec4bb265 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:01.825322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203ff92-e72d-4fb4-84d2-5c9dec4bb265 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:01.825588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203ff92-e72d-4fb4-84d2-5c9dec4bb265 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:01.835926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203ff92-e72d-4fb4-84d2-5c9dec4bb265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-2203ff92-e72d-4fb4-84d2-5c9dec4bb265 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:01.840959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:01.842072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:01.843103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:01.843103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:01.843103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:01.843103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:01.843103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:01.843103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:01.843103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:01.843103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:01.843103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:01.843103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:01.843103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:01.843103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:01.847285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 328/639] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:11:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:01.848649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203ff92-e72d-4fb4-84d2-5c9dec4bb265 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:01.861080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:01.904822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1590f20-059c-4454-95df-75b85c7625cc None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:01.942798 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51326a-1016-467c-82ee-a750c5e0c1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:01.943767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51326a-1016-467c-82ee-a750c5e0c1cc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:01.944198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51326a-1016-467c-82ee-a750c5e0c1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:01.944611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51326a-1016-467c-82ee-a750c5e0c1cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:01.960256 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51326a-1016-467c-82ee-a750c5e0c1cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:01.962561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51326a-1016-467c-82ee-a750c5e0c1cc None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:01.967854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203ff92-e72d-4fb4-84d2-5c9dec4bb265 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-4b51326a-1016-467c-82ee-a750c5e0c1cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:01.980953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:01.982012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:01.987723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:01.987723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:01.987723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:01.987723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 312/640] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:01.987723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51326a-1016-467c-82ee-a750c5e0c1cc None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:02.006567 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956b8f2-5011-4e1c-b20c-156f95965dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:02.007198 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956b8f2-5011-4e1c-b20c-156f95965dfa None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:02.007506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956b8f2-5011-4e1c-b20c-156f95965dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:02.007781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956b8f2-5011-4e1c-b20c-156f95965dfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:02.018112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956b8f2-5011-4e1c-b20c-156f95965dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:02.019594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956b8f2-5011-4e1c-b20c-156f95965dfa None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-4956b8f2-5011-4e1c-b20c-156f95965dfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:02.035782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:02.036859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:02.037765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:02.037765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:02.037765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:02.037765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 329/641] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:02.037765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956b8f2-5011-4e1c-b20c-156f95965dfa None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:02.085796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:02.103253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51326a-1016-467c-82ee-a750c5e0c1cc None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:02.107374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:02.140909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b4913-0d4f-4982-897b-ed2caa6efb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:02.141523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b4913-0d4f-4982-897b-ed2caa6efb63 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:02.141803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b4913-0d4f-4982-897b-ed2caa6efb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:02.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b4913-0d4f-4982-897b-ed2caa6efb63 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:02.142735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b4913-0d4f-4982-897b-ed2caa6efb63 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:02.143039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b4913-0d4f-4982-897b-ed2caa6efb63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:02.144498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b4913-0d4f-4982-897b-ed2caa6efb63 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:02.151550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956b8f2-5011-4e1c-b20c-156f95965dfa None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:02.152629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 313/642] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:11:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:02.157812 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b4913-0d4f-4982-897b-ed2caa6efb63 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:02.189364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aaf82-3ec9-4a50-b978-805ca17775c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:02.190073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aaf82-3ec9-4a50-b978-805ca17775c8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:02.190270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aaf82-3ec9-4a50-b978-805ca17775c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:02.190514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aaf82-3ec9-4a50-b978-805ca17775c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:02.191174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6aaf82-3ec9-4a50-b978-805ca17775c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:02.191477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6aaf82-3ec9-4a50-b978-805ca17775c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:02.192882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6aaf82-3ec9-4a50-b978-805ca17775c8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:02.205495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 330/643] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:11:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:02.205495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aaf82-3ec9-4a50-b978-805ca17775c8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:02.266051 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b4913-0d4f-4982-897b-ed2caa6efb63 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:02.305718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aaf82-3ec9-4a50-b978-805ca17775c8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:02.307415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479d737-1e57-47c4-aec7-b174e62252ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:02.308516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479d737-1e57-47c4-aec7-b174e62252ad None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:02.309371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479d737-1e57-47c4-aec7-b174e62252ad None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:02.309647 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479d737-1e57-47c4-aec7-b174e62252ad None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:02.310743 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479d737-1e57-47c4-aec7-b174e62252ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:02.311243 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479d737-1e57-47c4-aec7-b174e62252ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:02.313600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479d737-1e57-47c4-aec7-b174e62252ad None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:02.327478 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 314/644] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:02.328333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479d737-1e57-47c4-aec7-b174e62252ad None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:02.338991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:02.340941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:02.356532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9f327-53f1-40f3-adec-c49ea99c6e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:02.357299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9f327-53f1-40f3-adec-c49ea99c6e78 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:02.357577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9f327-53f1-40f3-adec-c49ea99c6e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:02.357843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9f327-53f1-40f3-adec-c49ea99c6e78 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:02.358495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9f327-53f1-40f3-adec-c49ea99c6e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:02.358816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9f327-53f1-40f3-adec-c49ea99c6e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:02.360193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9f327-53f1-40f3-adec-c49ea99c6e78 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:02.377395 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 331/645] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:02.377395 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9f327-53f1-40f3-adec-c49ea99c6e78 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:02.440645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479d737-1e57-47c4-aec7-b174e62252ad None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:02.476939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c0a3e-3b8b-4af3-827a-f88cf2621f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:02.477566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c0a3e-3b8b-4af3-827a-f88cf2621f92 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:02.477844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c0a3e-3b8b-4af3-827a-f88cf2621f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:02.478110 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c0a3e-3b8b-4af3-827a-f88cf2621f92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:02.484708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9f327-53f1-40f3-adec-c49ea99c6e78 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:02.488522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c0a3e-3b8b-4af3-827a-f88cf2621f92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:02.490107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c0a3e-3b8b-4af3-827a-f88cf2621f92 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-506c0a3e-3b8b-4af3-827a-f88cf2621f92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:02.506527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:02.507540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:02.508606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:02.508606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:02.508606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:02.510066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 315/646] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:02.510949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c0a3e-3b8b-4af3-827a-f88cf2621f92 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:02.534485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f5579-32c1-4100-9e5b-81028db5f7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:02.535240 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f5579-32c1-4100-9e5b-81028db5f7ee None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:02.535516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f5579-32c1-4100-9e5b-81028db5f7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:02.535782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f5579-32c1-4100-9e5b-81028db5f7ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:02.546648 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f5579-32c1-4100-9e5b-81028db5f7ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:02.548262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f5579-32c1-4100-9e5b-81028db5f7ee None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-039f5579-32c1-4100-9e5b-81028db5f7ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:02.563154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:02.564348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:02.565524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:02.565524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:02.565524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:02.571371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 332/647] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:02.571371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f5579-32c1-4100-9e5b-81028db5f7ee None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:02.576954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:02.606837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:02.623381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c0a3e-3b8b-4af3-827a-f88cf2621f92 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:02.661713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a679a40-af32-4116-8927-dab310e932d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:02.662346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a679a40-af32-4116-8927-dab310e932d5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:02.662620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a679a40-af32-4116-8927-dab310e932d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:02.662887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a679a40-af32-4116-8927-dab310e932d5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:02.673868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a679a40-af32-4116-8927-dab310e932d5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:02.675267 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f5579-32c1-4100-9e5b-81028db5f7ee None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:02.675393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a679a40-af32-4116-8927-dab310e932d5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-8a679a40-af32-4116-8927-dab310e932d5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:02.690549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:02.691519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:02.697897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:02.697897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:02.697897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:02.697897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:02.697897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:02.697897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:02.697897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:02.697897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:02.697897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 18:11:02.697897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:02.697897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 316/648] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:11:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:02.697897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a679a40-af32-4116-8927-dab310e932d5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:02.711085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f8b2-9308-4bbd-a5de-9ccce7b47510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:02.711811 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f8b2-9308-4bbd-a5de-9ccce7b47510 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:02.712164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f8b2-9308-4bbd-a5de-9ccce7b47510 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:02.712515 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f8b2-9308-4bbd-a5de-9ccce7b47510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:02.719915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7f8b2-9308-4bbd-a5de-9ccce7b47510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:02.721443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7f8b2-9308-4bbd-a5de-9ccce7b47510 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-9ab7f8b2-9308-4bbd-a5de-9ccce7b47510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:02.733620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:02.734666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:02.735761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:02.735761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:02.735761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:02.735761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:02.735761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:02.735761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:02.735761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:02.735761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:02.739686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 333/649] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:02.740523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f8b2-9308-4bbd-a5de-9ccce7b47510 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:02.810040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a679a40-af32-4116-8927-dab310e932d5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:02.836050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:02.839396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:02.849483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f8b2-9308-4bbd-a5de-9ccce7b47510 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:02.854357 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c5249-cdba-4e2f-a772-1519a15747d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:02.854975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c5249-cdba-4e2f-a772-1519a15747d1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:02.855256 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c5249-cdba-4e2f-a772-1519a15747d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:02.855524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c5249-cdba-4e2f-a772-1519a15747d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:02.856167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c5249-cdba-4e2f-a772-1519a15747d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:02.856521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c5249-cdba-4e2f-a772-1519a15747d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:02.857923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c5249-cdba-4e2f-a772-1519a15747d1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:02.874362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 317/650] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:02.874362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c5249-cdba-4e2f-a772-1519a15747d1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:02.893096 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f0a67-ccff-44bb-b38a-3e14c8b04ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:02.893714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0a67-ccff-44bb-b38a-3e14c8b04ffb None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:02.893987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0a67-ccff-44bb-b38a-3e14c8b04ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:02.894597 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0a67-ccff-44bb-b38a-3e14c8b04ffb None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:02.894889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f0a67-ccff-44bb-b38a-3e14c8b04ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:02.895186 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f0a67-ccff-44bb-b38a-3e14c8b04ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:02.896617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f0a67-ccff-44bb-b38a-3e14c8b04ffb None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:02.913634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 334/651] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:02.913634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f0a67-ccff-44bb-b38a-3e14c8b04ffb None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:02.976487 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c5249-cdba-4e2f-a772-1519a15747d1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:03.012070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2dad1-08a2-4899-9ab9-94ca64d9852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:03.013078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2dad1-08a2-4899-9ab9-94ca64d9852f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:03.013371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2dad1-08a2-4899-9ab9-94ca64d9852f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:03.013623 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2dad1-08a2-4899-9ab9-94ca64d9852f None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:03.014417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2dad1-08a2-4899-9ab9-94ca64d9852f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:03.014725 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2dad1-08a2-4899-9ab9-94ca64d9852f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:03.016161 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2dad1-08a2-4899-9ab9-94ca64d9852f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:03.017008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f0a67-ccff-44bb-b38a-3e14c8b04ffb None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:03.034125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 318/652] 10.222.0.45 () {56 vars in 1137 bytes} [Fri Aug 26 18:11:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:03.034857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2dad1-08a2-4899-9ab9-94ca64d9852f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:03.058208 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a243ef-b633-4000-875e-817315b5e5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:03.058852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a243ef-b633-4000-875e-817315b5e5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:03.059129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a243ef-b633-4000-875e-817315b5e5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:03.059410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a243ef-b633-4000-875e-817315b5e5c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:03.060177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a243ef-b633-4000-875e-817315b5e5c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:03.060434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a243ef-b633-4000-875e-817315b5e5c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:03.062262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a243ef-b633-4000-875e-817315b5e5c7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:03.073301 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:03.073888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 335/653] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:03.075235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a243ef-b633-4000-875e-817315b5e5c7 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:03.092211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:03.148477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2dad1-08a2-4899-9ab9-94ca64d9852f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:03.183560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2ae8e-94f3-49bc-b42b-8209d08f241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:03.183799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a243ef-b633-4000-875e-817315b5e5c7 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:03.184628 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2ae8e-94f3-49bc-b42b-8209d08f241c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:03.185096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2ae8e-94f3-49bc-b42b-8209d08f241c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:03.185565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2ae8e-94f3-49bc-b42b-8209d08f241c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:03.193193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2ae8e-94f3-49bc-b42b-8209d08f241c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:03.194939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2ae8e-94f3-49bc-b42b-8209d08f241c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-9af2ae8e-94f3-49bc-b42b-8209d08f241c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:03.207164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:03.208286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:03.209260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:03.209260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:03.209260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:03.209260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:03.209260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:03.209260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:03.209260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:03.209260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:03.209260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 18:11:03.209260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:03.209260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 319/654] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:11:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:03.209862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2ae8e-94f3-49bc-b42b-8209d08f241c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:03.223466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030db9c-1589-409c-afab-29220b11dc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:03.224314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030db9c-1589-409c-afab-29220b11dc47 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:03.224805 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030db9c-1589-409c-afab-29220b11dc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:03.225214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030db9c-1589-409c-afab-29220b11dc47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:03.234353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030db9c-1589-409c-afab-29220b11dc47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:03.236086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030db9c-1589-409c-afab-29220b11dc47 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-2030db9c-1589-409c-afab-29220b11dc47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:03.248287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:03.249455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:03.250622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:03.250622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:03.250622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:03.250622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:03.250622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:03.250622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:03.250622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:03.250622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:03.250622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:03.250622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:03.252549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 336/655] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 26 18:11:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:03.253479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030db9c-1589-409c-afab-29220b11dc47 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:03.313217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:03.320023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2ae8e-94f3-49bc-b42b-8209d08f241c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:03.334145 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:03.354737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f467c8-1af4-4234-a3c1-31e858c45bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:03.355349 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f467c8-1af4-4234-a3c1-31e858c45bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:03.355636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f467c8-1af4-4234-a3c1-31e858c45bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:03.355910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f467c8-1af4-4234-a3c1-31e858c45bf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:03.359112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030db9c-1589-409c-afab-29220b11dc47 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:03.392840 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199675d-2dee-483a-afba-521d52738ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:03.393454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199675d-2dee-483a-afba-521d52738ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:03.393739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199675d-2dee-483a-afba-521d52738ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:03.394007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199675d-2dee-483a-afba-521d52738ef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:03.394729 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199675d-2dee-483a-afba-521d52738ef3 None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=74ee7b50c34742ce896a734f3ef34a53) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:03.395042 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199675d-2dee-483a-afba-521d52738ef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:03.396482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199675d-2dee-483a-afba-521d52738ef3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:03.402469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 337/656] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:03 2022] GET /identity/v3/role_assignments?user.id=74ee7b50c34742ce896a734f3ef34a53&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:03.403289 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199675d-2dee-483a-afba-521d52738ef3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:03.437899 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f467c8-1af4-4234-a3c1-31e858c45bf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:03.439594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f467c8-1af4-4234-a3c1-31e858c45bf6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:03.529204 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199675d-2dee-483a-afba-521d52738ef3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:03.557306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:03.569508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 320/657] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:11:03.569508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f467c8-1af4-4234-a3c1-31e858c45bf6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:03.573702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b88bcc-f07d-47f7-afe5-e4a0d27b4ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:03.574321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b88bcc-f07d-47f7-afe5-e4a0d27b4ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:03.575728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b88bcc-f07d-47f7-afe5-e4a0d27b4ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:03.575728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b88bcc-f07d-47f7-afe5-e4a0d27b4ad1 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:03.575728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b88bcc-f07d-47f7-afe5-e4a0d27b4ad1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:03.576031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b88bcc-f07d-47f7-afe5-e4a0d27b4ad1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:03.577982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b88bcc-f07d-47f7-afe5-e4a0d27b4ad1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:03.587931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:03.597596 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 338/658] 10.222.0.45 () {56 vars in 1139 bytes} [Fri Aug 26 18:11:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:03.599035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5666146-3abe-44f9-987c-39a71044e4b3 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:03.599326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5666146-3abe-44f9-987c-39a71044e4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:03.599598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5666146-3abe-44f9-987c-39a71044e4b3 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:03.601399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 339/659] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:03.602033 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5666146-3abe-44f9-987c-39a71044e4b3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:03.686076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f467c8-1af4-4234-a3c1-31e858c45bf6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:03.713856 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5666146-3abe-44f9-987c-39a71044e4b3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:03.726152 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f69633-23dd-41db-b786-8ac5e10a5cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:03.726765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69633-23dd-41db-b786-8ac5e10a5cff None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:03.727041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69633-23dd-41db-b786-8ac5e10a5cff None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:03.727307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69633-23dd-41db-b786-8ac5e10a5cff None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:03.728036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f69633-23dd-41db-b786-8ac5e10a5cff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:03.728339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f69633-23dd-41db-b786-8ac5e10a5cff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:03.729869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f69633-23dd-41db-b786-8ac5e10a5cff None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:03.751096 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942b878-0e06-4e58-837c-ac6b636bc788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:03.751742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942b878-0e06-4e58-837c-ac6b636bc788 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:03.752022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942b878-0e06-4e58-837c-ac6b636bc788 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:03.752295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942b878-0e06-4e58-837c-ac6b636bc788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:03.754191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 321/660] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 26 18:11:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:03.755031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f69633-23dd-41db-b786-8ac5e10a5cff None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:03.768225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942b878-0e06-4e58-837c-ac6b636bc788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:03.770317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942b878-0e06-4e58-837c-ac6b636bc788 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3942b878-0e06-4e58-837c-ac6b636bc788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:03.785602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:03.786867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:03.787823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:03.787823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:03.787823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:03.787823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 340/661] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:03.788511 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c84d6-3094-4827-b4c3-83f7a77347fe None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:03.788511 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c84d6-3094-4827-b4c3-83f7a77347fe None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:03.788691 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c84d6-3094-4827-b4c3-83f7a77347fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:03.806516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e97c84d6-3094-4827-b4c3-83f7a77347fe None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:03.807699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e97c84d6-3094-4827-b4c3-83f7a77347fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:03.821736 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:03.853818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:03.870638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f69633-23dd-41db-b786-8ac5e10a5cff None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:03.884779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 341/662] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:11:03.884779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c84d6-3094-4827-b4c3-83f7a77347fe None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:03.906930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74b0d8-ae45-49ab-892b-bd24621fb45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:03.907805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74b0d8-ae45-49ab-892b-bd24621fb45c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:03.908222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74b0d8-ae45-49ab-892b-bd24621fb45c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:03.908778 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74b0d8-ae45-49ab-892b-bd24621fb45c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:04.011514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c84d6-3094-4827-b4c3-83f7a77347fe None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:04.024235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74b0d8-ae45-49ab-892b-bd24621fb45c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:04.026340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74b0d8-ae45-49ab-892b-bd24621fb45c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:04.059234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a860c0-23c0-428d-9384-d2efa8f46a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:04.059963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a860c0-23c0-428d-9384-d2efa8f46a5c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:04.060238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a860c0-23c0-428d-9384-d2efa8f46a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:04.060505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a860c0-23c0-428d-9384-d2efa8f46a5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:04.083176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:04.127441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:04.135472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 322/663] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:11:04.136680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74b0d8-ae45-49ab-892b-bd24621fb45c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:04.155719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a860c0-23c0-428d-9384-d2efa8f46a5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:04.157322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a860c0-23c0-428d-9384-d2efa8f46a5c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:04.243637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74b0d8-ae45-49ab-892b-bd24621fb45c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:04.271508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 342/664] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:11:04.272707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a860c0-23c0-428d-9384-d2efa8f46a5c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:04.282568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5667e4-dc66-4e73-a452-fbcc4aab870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:04.283159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5667e4-dc66-4e73-a452-fbcc4aab870e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:04.283434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5667e4-dc66-4e73-a452-fbcc4aab870e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:04.283702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5667e4-dc66-4e73-a452-fbcc4aab870e None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:04.284609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5667e4-dc66-4e73-a452-fbcc4aab870e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:04.284609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5667e4-dc66-4e73-a452-fbcc4aab870e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:04.286016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5667e4-dc66-4e73-a452-fbcc4aab870e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:04.297941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 323/665] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:04.298942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5667e4-dc66-4e73-a452-fbcc4aab870e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:04.321073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:04.361179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:04.385723 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a860c0-23c0-428d-9384-d2efa8f46a5c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:04.425686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5667e4-dc66-4e73-a452-fbcc4aab870e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:04.427546 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42575849-1e4d-4abc-b75d-b3904cb41b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:04.428185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42575849-1e4d-4abc-b75d-b3904cb41b68 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:04.428465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42575849-1e4d-4abc-b75d-b3904cb41b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:04.428758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42575849-1e4d-4abc-b75d-b3904cb41b68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:04.439717 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42575849-1e4d-4abc-b75d-b3904cb41b68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:04.441585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42575849-1e4d-4abc-b75d-b3904cb41b68 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-42575849-1e4d-4abc-b75d-b3904cb41b68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:04.456555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:04.457589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:04.458493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:04.458493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:04.458493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:04.458493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 343/666] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:04.458493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42575849-1e4d-4abc-b75d-b3904cb41b68 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:04.465399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58db4a-9d46-4da3-a286-600b92c4b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:04.466220 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58db4a-9d46-4da3-a286-600b92c4b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:04.466554 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58db4a-9d46-4da3-a286-600b92c4b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:04.467016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58db4a-9d46-4da3-a286-600b92c4b6f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:04.481182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58db4a-9d46-4da3-a286-600b92c4b6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-0c58db4a-9d46-4da3-a286-600b92c4b6f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:04.487023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:04.488165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 324/667] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:11:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:04.489217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58db4a-9d46-4da3-a286-600b92c4b6f8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:04.577569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:04.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42575849-1e4d-4abc-b75d-b3904cb41b68 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:04.606544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58db4a-9d46-4da3-a286-600b92c4b6f8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:04.611132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:04.617343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb745e-de28-4b51-a474-683f86f9de8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:04.617923 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb745e-de28-4b51-a474-683f86f9de8c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:04.618202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb745e-de28-4b51-a474-683f86f9de8c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:04.618474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb745e-de28-4b51-a474-683f86f9de8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:04.629026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb745e-de28-4b51-a474-683f86f9de8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:04.630499 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb745e-de28-4b51-a474-683f86f9de8c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-24eb745e-de28-4b51-a474-683f86f9de8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:04.644227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:04.645311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:04.646494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:04.646494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:04.646494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:04.647912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df0e76-37d9-4a06-9042-b6f8d4f7de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:04.648790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df0e76-37d9-4a06-9042-b6f8d4f7de04 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:04.649221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df0e76-37d9-4a06-9042-b6f8d4f7de04 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:04.649800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df0e76-37d9-4a06-9042-b6f8d4f7de04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:04.649910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 344/668] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:04.650629 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb745e-de28-4b51-a474-683f86f9de8c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:04.657635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df0e76-37d9-4a06-9042-b6f8d4f7de04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:04.659259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df0e76-37d9-4a06-9042-b6f8d4f7de04 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-73df0e76-37d9-4a06-9042-b6f8d4f7de04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:04.672279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:04.673413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:04.674346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:04.674346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:04.674346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:04.674346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:04.674346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:04.674346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:04.674346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:04.674346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:04.677756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 325/669] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:04.678586 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df0e76-37d9-4a06-9042-b6f8d4f7de04 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:04.758242 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb745e-de28-4b51-a474-683f86f9de8c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:04.790629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df0e76-37d9-4a06-9042-b6f8d4f7de04 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:04.791397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74efe2-8707-4cee-9a91-68e0a084dab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:04.792015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74efe2-8707-4cee-9a91-68e0a084dab8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:04.792295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74efe2-8707-4cee-9a91-68e0a084dab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:04.792570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74efe2-8707-4cee-9a91-68e0a084dab8 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:04.793248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74efe2-8707-4cee-9a91-68e0a084dab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:04.793544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74efe2-8707-4cee-9a91-68e0a084dab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:04.794988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74efe2-8707-4cee-9a91-68e0a084dab8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:04.807647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 345/670] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:04.808465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74efe2-8707-4cee-9a91-68e0a084dab8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:04.833915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467bb08-8787-456b-8104-0732c542e094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:04.834955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467bb08-8787-456b-8104-0732c542e094 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:04.835460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467bb08-8787-456b-8104-0732c542e094 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:04.835945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467bb08-8787-456b-8104-0732c542e094 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:04.836978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467bb08-8787-456b-8104-0732c542e094 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:04.837527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467bb08-8787-456b-8104-0732c542e094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:04.839197 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467bb08-8787-456b-8104-0732c542e094 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:04.841692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:04.855123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:04.855870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 326/671] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:11:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:04.857169 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467bb08-8787-456b-8104-0732c542e094 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:04.919390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74efe2-8707-4cee-9a91-68e0a084dab8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:04.955959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9242503-b4bf-48a4-906a-1721e91f2f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:04.956575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9242503-b4bf-48a4-906a-1721e91f2f51 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:04.956909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9242503-b4bf-48a4-906a-1721e91f2f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:04.957182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9242503-b4bf-48a4-906a-1721e91f2f51 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:04.957816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9242503-b4bf-48a4-906a-1721e91f2f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:04.958165 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9242503-b4bf-48a4-906a-1721e91f2f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:04.959557 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9242503-b4bf-48a4-906a-1721e91f2f51 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:04.960323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467bb08-8787-456b-8104-0732c542e094 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:04.972794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 346/672] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:04.973530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9242503-b4bf-48a4-906a-1721e91f2f51 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:05.000664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ba869-f58b-4543-a51a-88283e136a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:05.001286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ba869-f58b-4543-a51a-88283e136a5b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:05.001565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ba869-f58b-4543-a51a-88283e136a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:05.001838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ba869-f58b-4543-a51a-88283e136a5b None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:05.002533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ba869-f58b-4543-a51a-88283e136a5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:05.002843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ba869-f58b-4543-a51a-88283e136a5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:05.004286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ba869-f58b-4543-a51a-88283e136a5b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:05.020531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 327/673] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:05.020531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ba869-f58b-4543-a51a-88283e136a5b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:05.074247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:05.086942 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9242503-b4bf-48a4-906a-1721e91f2f51 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:05.089030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:05.123953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ba869-f58b-4543-a51a-88283e136a5b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:05.125148 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f62ea-9d51-4cd5-9398-96442ffff59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:05.125798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f62ea-9d51-4cd5-9398-96442ffff59f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:05.126066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f62ea-9d51-4cd5-9398-96442ffff59f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:05.126339 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f62ea-9d51-4cd5-9398-96442ffff59f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:05.134036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f62ea-9d51-4cd5-9398-96442ffff59f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:05.135497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f62ea-9d51-4cd5-9398-96442ffff59f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-257f62ea-9d51-4cd5-9398-96442ffff59f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:05.148285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:05.149254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:05.150135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:05.150135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:05.150135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:05.150135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:05.150135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:05.150135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:05.150135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:05.150135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:05.150135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 347/674] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:05.151238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f62ea-9d51-4cd5-9398-96442ffff59f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:05.166863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa00c2-633f-49d2-9e92-004c103ef173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:05.167831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa00c2-633f-49d2-9e92-004c103ef173 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:05.168304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa00c2-633f-49d2-9e92-004c103ef173 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:05.168644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa00c2-633f-49d2-9e92-004c103ef173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:05.180520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa00c2-633f-49d2-9e92-004c103ef173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:05.182320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa00c2-633f-49d2-9e92-004c103ef173 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-20fa00c2-633f-49d2-9e92-004c103ef173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:05.196811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:05.197784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:05.198712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:05.198712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:05.198712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:05.198712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 328/675] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:05.198937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa00c2-633f-49d2-9e92-004c103ef173 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:05.257727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f62ea-9d51-4cd5-9398-96442ffff59f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:05.292525 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636495c-9501-41aa-a79a-ed2560a17c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:05.293209 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636495c-9501-41aa-a79a-ed2560a17c76 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:05.293503 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636495c-9501-41aa-a79a-ed2560a17c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:05.293748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636495c-9501-41aa-a79a-ed2560a17c76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:05.300836 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636495c-9501-41aa-a79a-ed2560a17c76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:05.302311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636495c-9501-41aa-a79a-ed2560a17c76 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:05.303005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa00c2-633f-49d2-9e92-004c103ef173 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-4636495c-9501-41aa-a79a-ed2560a17c76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:05.314036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:05.314949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:05.315837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:05.315837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:05.315837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:05.315837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:05.315837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:05.315837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:05.315837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:05.315837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:05.315837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 348/676] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:05.317271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636495c-9501-41aa-a79a-ed2560a17c76 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:05.317740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:05.343646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:05.347211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73931a0-0a34-4984-af2a-51f12fdbde9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:05.347799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73931a0-0a34-4984-af2a-51f12fdbde9f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:05.348087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73931a0-0a34-4984-af2a-51f12fdbde9f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:05.348424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73931a0-0a34-4984-af2a-51f12fdbde9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:05.349264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73931a0-0a34-4984-af2a-51f12fdbde9f None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=fcfeeb3365ba420c9ff03e5aadee7f66) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:05.349456 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73931a0-0a34-4984-af2a-51f12fdbde9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:05.351223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73931a0-0a34-4984-af2a-51f12fdbde9f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:05.364752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 329/677] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:05 2022] GET /identity/v3/role_assignments?user.id=fcfeeb3365ba420c9ff03e5aadee7f66&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:05.364752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73931a0-0a34-4984-af2a-51f12fdbde9f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:05.433035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636495c-9501-41aa-a79a-ed2560a17c76 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:05.470485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c52af-4348-4a57-adc3-5fb556ef6981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:05.471121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c52af-4348-4a57-adc3-5fb556ef6981 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:05.471401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c52af-4348-4a57-adc3-5fb556ef6981 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:05.471674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c52af-4348-4a57-adc3-5fb556ef6981 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:05.472401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c52af-4348-4a57-adc3-5fb556ef6981 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:05.472684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c52af-4348-4a57-adc3-5fb556ef6981 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:05.474199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c52af-4348-4a57-adc3-5fb556ef6981 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:05.482180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73931a0-0a34-4984-af2a-51f12fdbde9f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:05.488976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 349/678] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:05.489848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c52af-4348-4a57-adc3-5fb556ef6981 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:05.529621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7295aa-de6e-4a8e-b4db-64996653ea55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:05.530763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7295aa-de6e-4a8e-b4db-64996653ea55 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:05.530763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7295aa-de6e-4a8e-b4db-64996653ea55 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:05.530763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7295aa-de6e-4a8e-b4db-64996653ea55 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:05.531388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7295aa-de6e-4a8e-b4db-64996653ea55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:05.531687 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7295aa-de6e-4a8e-b4db-64996653ea55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:05.533932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7295aa-de6e-4a8e-b4db-64996653ea55 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:05.548703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 330/679] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:05.554108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eb393-589f-4425-9eac-10d4f001247c None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:05.554389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eb393-589f-4425-9eac-10d4f001247c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:05.554659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eb393-589f-4425-9eac-10d4f001247c None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:05.556078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 331/680] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:05.556600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eb393-589f-4425-9eac-10d4f001247c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:05.589892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:05.592676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:05.613156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c52af-4348-4a57-adc3-5fb556ef6981 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:05.651568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11849f-1405-43ab-b2ea-b66e83f96400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:05.652193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11849f-1405-43ab-b2ea-b66e83f96400 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:05.652472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11849f-1405-43ab-b2ea-b66e83f96400 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:05.652780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11849f-1405-43ab-b2ea-b66e83f96400 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:05.653701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11849f-1405-43ab-b2ea-b66e83f96400 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:05.654025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11849f-1405-43ab-b2ea-b66e83f96400 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:05.655530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11849f-1405-43ab-b2ea-b66e83f96400 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:05.672043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 350/681] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:05.672043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11849f-1405-43ab-b2ea-b66e83f96400 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:05.674075 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eb393-589f-4425-9eac-10d4f001247c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:05.710407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8029d-afbb-49d6-8017-55e3c89a9a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:05.711061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8029d-afbb-49d6-8017-55e3c89a9a19 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:05.711416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8029d-afbb-49d6-8017-55e3c89a9a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:05.711759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8029d-afbb-49d6-8017-55e3c89a9a19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:05.712560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8029d-afbb-49d6-8017-55e3c89a9a19 None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=78487667b3334cf09fed51b697cbf759) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:05.712969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8029d-afbb-49d6-8017-55e3c89a9a19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:05.714479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8029d-afbb-49d6-8017-55e3c89a9a19 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:05.728630 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 332/682] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:05 2022] GET /identity/v3/role_assignments?user.id=78487667b3334cf09fed51b697cbf759&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:05.728630 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e945ed-21ef-4de3-a2cf-455969ede41e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:05.728630 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e945ed-21ef-4de3-a2cf-455969ede41e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:05.728630 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e945ed-21ef-4de3-a2cf-455969ede41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:05.742698 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b0e945ed-21ef-4de3-a2cf-455969ede41e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:05.744032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b0e945ed-21ef-4de3-a2cf-455969ede41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:05.798920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11849f-1405-43ab-b2ea-b66e83f96400 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:05.841147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 333/683] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:11:05.842041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e945ed-21ef-4de3-a2cf-455969ede41e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:05.848032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490821d6-c48c-4cd7-a6fd-4bbe14223a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:05.849087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490821d6-c48c-4cd7-a6fd-4bbe14223a13 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:05.849477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490821d6-c48c-4cd7-a6fd-4bbe14223a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:05.849856 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490821d6-c48c-4cd7-a6fd-4bbe14223a13 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:05.865576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490821d6-c48c-4cd7-a6fd-4bbe14223a13 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:05.867248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490821d6-c48c-4cd7-a6fd-4bbe14223a13 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:05.876306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-490821d6-c48c-4cd7-a6fd-4bbe14223a13 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:05.894261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:05.895482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:05.896582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:05.896582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:05.896582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:05.896582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:05.896582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:05.896582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:05.896582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:05.896582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:05.896582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 18:11:05.896582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:05.902252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 351/684] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:05.907974 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490821d6-c48c-4cd7-a6fd-4bbe14223a13 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:05.912047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:05.977119 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e945ed-21ef-4de3-a2cf-455969ede41e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:06.015491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd751179-575b-46e3-92a3-15f96d5fed67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:06.016387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd751179-575b-46e3-92a3-15f96d5fed67 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:06.016863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd751179-575b-46e3-92a3-15f96d5fed67 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:06.017294 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd751179-575b-46e3-92a3-15f96d5fed67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:06.018166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd751179-575b-46e3-92a3-15f96d5fed67 None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=3791df34c6e442aaabd90d7f5c2f3a1a) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:06.018616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd751179-575b-46e3-92a3-15f96d5fed67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:06.020209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd751179-575b-46e3-92a3-15f96d5fed67 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:06.026852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 334/685] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:05 2022] GET /identity/v3/role_assignments?user.id=3791df34c6e442aaabd90d7f5c2f3a1a&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:06.054454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490821d6-c48c-4cd7-a6fd-4bbe14223a13 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:06.096120 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c41c3b-b77a-44d7-a884-96edfe703353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:06.097031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c41c3b-b77a-44d7-a884-96edfe703353 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:06.097496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c41c3b-b77a-44d7-a884-96edfe703353 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:06.097912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c41c3b-b77a-44d7-a884-96edfe703353 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:06.098975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c41c3b-b77a-44d7-a884-96edfe703353 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:06.099451 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c41c3b-b77a-44d7-a884-96edfe703353 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:06.101625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c41c3b-b77a-44d7-a884-96edfe703353 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:06.127050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 352/686] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Aug 26 18:11:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:06.133980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd751179-575b-46e3-92a3-15f96d5fed67 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:06.162957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c41c3b-b77a-44d7-a884-96edfe703353 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:06.278068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:06.289762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:06.306401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd751179-575b-46e3-92a3-15f96d5fed67 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:06.335507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c41c3b-b77a-44d7-a884-96edfe703353 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:06.351186 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1cd1-60d4-49a5-a4c9-9d3078ecdc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:06.351807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1cd1-60d4-49a5-a4c9-9d3078ecdc28 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:06.352084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1cd1-60d4-49a5-a4c9-9d3078ecdc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:06.352354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1cd1-60d4-49a5-a4c9-9d3078ecdc28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:06.377934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f5c19-3b9b-4146-9e47-c72224bd1e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:06.379002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f5c19-3b9b-4146-9e47-c72224bd1e83 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:06.379476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f5c19-3b9b-4146-9e47-c72224bd1e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:06.379943 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f5c19-3b9b-4146-9e47-c72224bd1e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:06.396799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f5c19-3b9b-4146-9e47-c72224bd1e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:06.396799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f5c19-3b9b-4146-9e47-c72224bd1e83 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-8d2f5c19-3b9b-4146-9e47-c72224bd1e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:06.410107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:06.411094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:06.412024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:06.412024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:06.412024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:06.412024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 353/687] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:06.418505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f5c19-3b9b-4146-9e47-c72224bd1e83 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:06.432503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa1cd1-60d4-49a5-a4c9-9d3078ecdc28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:06.434298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa1cd1-60d4-49a5-a4c9-9d3078ecdc28 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:06.531192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:06.542981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f5c19-3b9b-4146-9e47-c72224bd1e83 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:06.543631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 335/688] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:11:06.548493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1cd1-60d4-49a5-a4c9-9d3078ecdc28 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:06.558413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:06.582792 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4c641-7736-437f-992b-1698c3be7127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:06.583514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4c641-7736-437f-992b-1698c3be7127 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:06.583799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4c641-7736-437f-992b-1698c3be7127 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:06.584072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4c641-7736-437f-992b-1698c3be7127 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:06.584737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4c641-7736-437f-992b-1698c3be7127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:06.585349 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4c641-7736-437f-992b-1698c3be7127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:06.586665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4c641-7736-437f-992b-1698c3be7127 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:06.601482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 354/689] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:06.607380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4c641-7736-437f-992b-1698c3be7127 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:06.666833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1cd1-60d4-49a5-a4c9-9d3078ecdc28 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:06.704302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890d9f9-56ba-4016-9529-dc0bb39ca264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:06.705384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890d9f9-56ba-4016-9529-dc0bb39ca264 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:06.705892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890d9f9-56ba-4016-9529-dc0bb39ca264 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:06.706416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890d9f9-56ba-4016-9529-dc0bb39ca264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:06.716085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4c641-7736-437f-992b-1698c3be7127 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:06.718562 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890d9f9-56ba-4016-9529-dc0bb39ca264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:06.720282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890d9f9-56ba-4016-9529-dc0bb39ca264 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-3890d9f9-56ba-4016-9529-dc0bb39ca264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:06.737235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:06.738247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:06.739146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:06.739146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:06.739146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:06.741471 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 336/690] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:06.750654 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890d9f9-56ba-4016-9529-dc0bb39ca264 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:06.764069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafeaeb1-6abb-4e57-8e4f-2e568409098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:06.764936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeaeb1-6abb-4e57-8e4f-2e568409098f None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:06.765140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeaeb1-6abb-4e57-8e4f-2e568409098f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:06.765367 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeaeb1-6abb-4e57-8e4f-2e568409098f None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:06.766023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafeaeb1-6abb-4e57-8e4f-2e568409098f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:06.767595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafeaeb1-6abb-4e57-8e4f-2e568409098f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:06.799467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:06.807318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 355/691] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:11:06 2022] POST /identity/v3/users => generated 254 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:11:06.863989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890d9f9-56ba-4016-9529-dc0bb39ca264 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:06.900581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b246ad-9711-4b97-91ad-27acb655edd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:06.901649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b246ad-9711-4b97-91ad-27acb655edd4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:06.902127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b246ad-9711-4b97-91ad-27acb655edd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:06.902608 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b246ad-9711-4b97-91ad-27acb655edd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:06.903527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b246ad-9711-4b97-91ad-27acb655edd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:06.904026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b246ad-9711-4b97-91ad-27acb655edd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:06.905656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b246ad-9711-4b97-91ad-27acb655edd4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:06.919933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 337/692] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:06.925879 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafeaeb1-6abb-4e57-8e4f-2e568409098f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:06.971040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:07.092654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafeaeb1-6abb-4e57-8e4f-2e568409098f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:07.127875 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09004463-fa0d-43a4-be43-a38a43130cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:07.128517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09004463-fa0d-43a4-be43-a38a43130cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:07.128821 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09004463-fa0d-43a4-be43-a38a43130cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:07.129093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09004463-fa0d-43a4-be43-a38a43130cc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:07.135861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09004463-fa0d-43a4-be43-a38a43130cc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:07.137687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09004463-fa0d-43a4-be43-a38a43130cc9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-09004463-fa0d-43a4-be43-a38a43130cc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:07.149070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:07.149978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:07.151354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:07.151354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:07.151354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:07.151354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:07.151354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:07.151354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:07.151354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:07.151354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:07.151354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 356/693] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:07.156077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b246ad-9711-4b97-91ad-27acb655edd4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:07.269221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b246ad-9711-4b97-91ad-27acb655edd4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:07.281049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:07.303852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b186b-287a-4290-a79c-b410d5840c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:07.304476 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b186b-287a-4290-a79c-b410d5840c3e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:07.304782 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b186b-287a-4290-a79c-b410d5840c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:07.305061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b186b-287a-4290-a79c-b410d5840c3e None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:07.305758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b186b-287a-4290-a79c-b410d5840c3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:07.306068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b186b-287a-4290-a79c-b410d5840c3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:07.307498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b186b-287a-4290-a79c-b410d5840c3e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:07.319927 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 338/694] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:07.325816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09004463-fa0d-43a4-be43-a38a43130cc9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:07.430117 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:07.444148 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09004463-fa0d-43a4-be43-a38a43130cc9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:07.483956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb0abe-f58d-4cb6-b932-c1ac6faf3f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:07.484571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb0abe-f58d-4cb6-b932-c1ac6faf3f9b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:07.484953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb0abe-f58d-4cb6-b932-c1ac6faf3f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:07.485225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb0abe-f58d-4cb6-b932-c1ac6faf3f9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:07.485957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb0abe-f58d-4cb6-b932-c1ac6faf3f9b None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=98c92b2c982a4780884365a7a7ec6514) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:07.486265 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb0abe-f58d-4cb6-b932-c1ac6faf3f9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:07.487777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb0abe-f58d-4cb6-b932-c1ac6faf3f9b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:07.494063 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 357/695] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:07 2022] GET /identity/v3/role_assignments?user.id=98c92b2c982a4780884365a7a7ec6514&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:07.564896 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3bfa7-e9c9-4492-b627-c9f8009b1a1d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:07.565374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3bfa7-e9c9-4492-b627-c9f8009b1a1d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:07.565750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3bfa7-e9c9-4492-b627-c9f8009b1a1d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:07.567475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 339/696] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:07.572584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1ef81-c7c6-4c2a-b5eb-725c20ad33da None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:07.573077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1ef81-c7c6-4c2a-b5eb-725c20ad33da None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:07.573491 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1ef81-c7c6-4c2a-b5eb-725c20ad33da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:07.602829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-22d1ef81-c7c6-4c2a-b5eb-725c20ad33da None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:07.604278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-22d1ef81-c7c6-4c2a-b5eb-725c20ad33da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:07.701100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 358/697] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:11:07.993772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3bfa7-e9c9-4492-b627-c9f8009b1a1d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:08.129426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3bfa7-e9c9-4492-b627-c9f8009b1a1d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:08.157610 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b2e52-ab76-40b7-aeaf-cdb47383d712 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:08.158161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b2e52-ab76-40b7-aeaf-cdb47383d712 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:08.158161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b2e52-ab76-40b7-aeaf-cdb47383d712 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:08.159714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 359/698] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:08.164821 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817865bf-9b8d-4fc3-9e1b-0ca35ed28c17 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:08.165074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817865bf-9b8d-4fc3-9e1b-0ca35ed28c17 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:08.165345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817865bf-9b8d-4fc3-9e1b-0ca35ed28c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:08.174510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c7f6c-ebf4-4c33-8cca-79ca66741f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:08.175738 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c7f6c-ebf4-4c33-8cca-79ca66741f88 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:08.176158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c7f6c-ebf4-4c33-8cca-79ca66741f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:08.176583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c7f6c-ebf4-4c33-8cca-79ca66741f88 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:08.177337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c7f6c-ebf4-4c33-8cca-79ca66741f88 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:08.178836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c7f6c-ebf4-4c33-8cca-79ca66741f88 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:08.183561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-817865bf-9b8d-4fc3-9e1b-0ca35ed28c17 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:08.184828 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-817865bf-9b8d-4fc3-9e1b-0ca35ed28c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ea0c7f6c-ebf4-4c33-8cca-79ca66741f88 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:08.199946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:08.201339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 18:11:08.202370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:08.209046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 340/699] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Aug 26 18:11:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:08.213731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c7f6c-ebf4-4c33-8cca-79ca66741f88 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:08.263944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:08.270684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 360/700] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:11:08.359481 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c7f6c-ebf4-4c33-8cca-79ca66741f88 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:08.394178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716f859-1155-4266-be4b-e13b10489592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:08.394794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716f859-1155-4266-be4b-e13b10489592 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:08.395074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716f859-1155-4266-be4b-e13b10489592 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:08.395344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716f859-1155-4266-be4b-e13b10489592 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:08.395977 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716f859-1155-4266-be4b-e13b10489592 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:08.396276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716f859-1155-4266-be4b-e13b10489592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:08.397737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716f859-1155-4266-be4b-e13b10489592 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:08.402863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 341/701] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Aug 26 18:11:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:08.409426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817865bf-9b8d-4fc3-9e1b-0ca35ed28c17 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:08.433808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:08.559802 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716f859-1155-4266-be4b-e13b10489592 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:08.579331 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817865bf-9b8d-4fc3-9e1b-0ca35ed28c17 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:08.641418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ed289-f7f0-430b-8b2e-5d073b9060f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:08.642048 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ed289-f7f0-430b-8b2e-5d073b9060f2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:08.642331 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ed289-f7f0-430b-8b2e-5d073b9060f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:08.642622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ed289-f7f0-430b-8b2e-5d073b9060f2 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:08.643290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ed289-f7f0-430b-8b2e-5d073b9060f2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:08.643602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ed289-f7f0-430b-8b2e-5d073b9060f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:08.645015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ed289-f7f0-430b-8b2e-5d073b9060f2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:08.655781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 361/702] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Aug 26 18:11:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:08.670791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:08.681542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716f859-1155-4266-be4b-e13b10489592 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:08.732272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014ac80-1b13-459e-afba-bf47fd3b498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:08.732971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014ac80-1b13-459e-afba-bf47fd3b498c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:08.733250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014ac80-1b13-459e-afba-bf47fd3b498c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:08.733528 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014ac80-1b13-459e-afba-bf47fd3b498c None admin] PATH_INFO: `/v3/services/network` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:08.734128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014ac80-1b13-459e-afba-bf47fd3b498c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:08.735617 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014ac80-1b13-459e-afba-bf47fd3b498c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-0014ac80-1b13-459e-afba-bf47fd3b498c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:08.745438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:08.746497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:08.747388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 342/703] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:08 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:08.754762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ed289-f7f0-430b-8b2e-5d073b9060f2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:08.873008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:08.877230 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd98ef-3083-44c9-a851-b67df3307a4d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:08.877518 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd98ef-3083-44c9-a851-b67df3307a4d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:08.877791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd98ef-3083-44c9-a851-b67df3307a4d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:08.879280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 343/704] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:08.884581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9be3b3-aefe-4aec-a811-46ee68f6c006 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:08.885274 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9be3b3-aefe-4aec-a811-46ee68f6c006 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:08.885746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9be3b3-aefe-4aec-a811-46ee68f6c006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:08.897917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ed289-f7f0-430b-8b2e-5d073b9060f2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:08.912229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8c9be3b3-aefe-4aec-a811-46ee68f6c006 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:08.913681 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8c9be3b3-aefe-4aec-a811-46ee68f6c006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:08.942766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f66a5-a21f-4b40-a57c-b66d6256031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:08.943398 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f66a5-a21f-4b40-a57c-b66d6256031e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:08.943674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f66a5-a21f-4b40-a57c-b66d6256031e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:08.943940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f66a5-a21f-4b40-a57c-b66d6256031e None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:08.944574 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f66a5-a21f-4b40-a57c-b66d6256031e None admin] RBAC: Adding query filter params (name=network) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:08.944904 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f66a5-a21f-4b40-a57c-b66d6256031e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:08.946279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f66a5-a21f-4b40-a57c-b66d6256031e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:08.951210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 362/705] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:08.956481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f66a5-a21f-4b40-a57c-b66d6256031e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:09.020052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 344/706] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:11:09.094491 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f66a5-a21f-4b40-a57c-b66d6256031e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:09.129177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430317f-837d-4878-ac1a-ca7b9152e18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:09.129715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430317f-837d-4878-ac1a-ca7b9152e18b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:09.129993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430317f-837d-4878-ac1a-ca7b9152e18b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:09.130266 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430317f-837d-4878-ac1a-ca7b9152e18b None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:09.130895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430317f-837d-4878-ac1a-ca7b9152e18b None admin] RBAC: Adding query filter params (type=network) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:09.131197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430317f-837d-4878-ac1a-ca7b9152e18b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:09.132584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430317f-837d-4878-ac1a-ca7b9152e18b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:09.137755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 363/707] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:09.482922 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f756938-ec43-4780-8181-b0020d8ad597 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:09.484648 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430317f-837d-4878-ac1a-ca7b9152e18b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:09.485093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f756938-ec43-4780-8181-b0020d8ad597 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:09.485384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f756938-ec43-4780-8181-b0020d8ad597 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:09.486898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 345/708] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:09.490408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:09.491954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384e1e0-a38c-4bb4-af17-7361aaf58dba None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:09.495312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384e1e0-a38c-4bb4-af17-7361aaf58dba None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:09.495312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384e1e0-a38c-4bb4-af17-7361aaf58dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:09.515639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d384e1e0-a38c-4bb4-af17-7361aaf58dba None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:09.516864 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d384e1e0-a38c-4bb4-af17-7361aaf58dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:09.593280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 346/709] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 18:11:09.682825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430317f-837d-4878-ac1a-ca7b9152e18b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:09.729979 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57854d85-6c34-405b-a7c6-e0ee38a8c2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:09.730623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57854d85-6c34-405b-a7c6-e0ee38a8c2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:09.730899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57854d85-6c34-405b-a7c6-e0ee38a8c2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:09.731171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57854d85-6c34-405b-a7c6-e0ee38a8c2d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:09.746545 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57854d85-6c34-405b-a7c6-e0ee38a8c2d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-57854d85-6c34-405b-a7c6-e0ee38a8c2d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:09.752393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:09.753365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:09.754760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 364/710] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:09.759384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384e1e0-a38c-4bb4-af17-7361aaf58dba None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:09.789964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:09.896154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384e1e0-a38c-4bb4-af17-7361aaf58dba None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:09.937900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58feecf7-2768-4f5f-8b0f-c00e3680595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:09.938524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feecf7-2768-4f5f-8b0f-c00e3680595a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:09.938804 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feecf7-2768-4f5f-8b0f-c00e3680595a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:09.939077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feecf7-2768-4f5f-8b0f-c00e3680595a None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:09.939801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feecf7-2768-4f5f-8b0f-c00e3680595a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:09.940109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feecf7-2768-4f5f-8b0f-c00e3680595a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:09.941606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feecf7-2768-4f5f-8b0f-c00e3680595a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:09.944279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57854d85-6c34-405b-a7c6-e0ee38a8c2d4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:09.952264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 347/711] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:09.959371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58feecf7-2768-4f5f-8b0f-c00e3680595a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:10.059246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:10.100903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57854d85-6c34-405b-a7c6-e0ee38a8c2d4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:10.118176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:10.138870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc385eb-9333-4ae4-bb7d-a7a7c12e4bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:10.139970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc385eb-9333-4ae4-bb7d-a7a7c12e4bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:10.140446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc385eb-9333-4ae4-bb7d-a7a7c12e4bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:10.140954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc385eb-9333-4ae4-bb7d-a7a7c12e4bb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:10.151967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc385eb-9333-4ae4-bb7d-a7a7c12e4bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1dc385eb-9333-4ae4-bb7d-a7a7c12e4bb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:10.157752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:10.158677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:10.160773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:10.160773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:10.160773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:10.160773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:10.160773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:10.160773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:10.160773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:10.160773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:10.160773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:10.160773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:10.160773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:10.160773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:10.163847 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 365/712] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:11:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:10.171508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc385eb-9333-4ae4-bb7d-a7a7c12e4bb3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:10.179946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58feecf7-2768-4f5f-8b0f-c00e3680595a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:10.238404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6836c4-d202-4ce2-9894-94c8ec34bac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:10.239350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6836c4-d202-4ce2-9894-94c8ec34bac5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:10.239638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6836c4-d202-4ce2-9894-94c8ec34bac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:10.240180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6836c4-d202-4ce2-9894-94c8ec34bac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:10.253801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6836c4-d202-4ce2-9894-94c8ec34bac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:10.255758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6836c4-d202-4ce2-9894-94c8ec34bac5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-0c6836c4-d202-4ce2-9894-94c8ec34bac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:10.272066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:10.273561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:10.274500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:10.274500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:10.274500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:10.274500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 348/713] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:10.275170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4852a-8944-4df0-b4c7-fe1347ccfd77 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:10.280739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4852a-8944-4df0-b4c7-fe1347ccfd77 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:10.280739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4852a-8944-4df0-b4c7-fe1347ccfd77 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:10.280924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 349/714] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:10.282107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4852a-8944-4df0-b4c7-fe1347ccfd77 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:10.314241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc385eb-9333-4ae4-bb7d-a7a7c12e4bb3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:10.339754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:10.356675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229d047-d4c1-48fb-ae85-6023c2383a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:10.357815 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229d047-d4c1-48fb-ae85-6023c2383a57 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:10.358294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229d047-d4c1-48fb-ae85-6023c2383a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:10.358848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229d047-d4c1-48fb-ae85-6023c2383a57 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:10.359746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229d047-d4c1-48fb-ae85-6023c2383a57 None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:10.360292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229d047-d4c1-48fb-ae85-6023c2383a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:10.362107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229d047-d4c1-48fb-ae85-6023c2383a57 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:10.371653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 366/715] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:11:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:10.373469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6898887-e186-4eed-ac6f-10c02d534758 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:10.373992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6898887-e186-4eed-ac6f-10c02d534758 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:10.374553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6898887-e186-4eed-ac6f-10c02d534758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:10.394025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a6898887-e186-4eed-ac6f-10c02d534758 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:10.395621 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a6898887-e186-4eed-ac6f-10c02d534758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:10.408642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4852a-8944-4df0-b4c7-fe1347ccfd77 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:10.442047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:10.451849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01ad56-acb0-48dd-a3ba-8f1db63f26d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:10.452476 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01ad56-acb0-48dd-a3ba-8f1db63f26d4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:10.452777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01ad56-acb0-48dd-a3ba-8f1db63f26d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:10.453060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01ad56-acb0-48dd-a3ba-8f1db63f26d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:10.453756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01ad56-acb0-48dd-a3ba-8f1db63f26d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:10.454182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01ad56-acb0-48dd-a3ba-8f1db63f26d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:10.455880 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01ad56-acb0-48dd-a3ba-8f1db63f26d4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:10.475176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 350/716] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:10.475176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01ad56-acb0-48dd-a3ba-8f1db63f26d4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:10.478805 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 367/717] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:11:10.479926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6898887-e186-4eed-ac6f-10c02d534758 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:10.668904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01ad56-acb0-48dd-a3ba-8f1db63f26d4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:10.681065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6898887-e186-4eed-ac6f-10c02d534758 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:10.699564 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:10.730959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be7ba6-4044-47be-8ae6-75970820f748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:10.732113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be7ba6-4044-47be-8ae6-75970820f748 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:10.733482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be7ba6-4044-47be-8ae6-75970820f748 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:10.735051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be7ba6-4044-47be-8ae6-75970820f748 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:10.744790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5e194-311f-4033-bc34-5c60e60d2826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:10.745739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5e194-311f-4033-bc34-5c60e60d2826 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:10.746252 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5e194-311f-4033-bc34-5c60e60d2826 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:10.746723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5e194-311f-4033-bc34-5c60e60d2826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:10.750382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be7ba6-4044-47be-8ae6-75970820f748 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:10.753569 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be7ba6-4044-47be-8ae6-75970820f748 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:10.768849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5e194-311f-4033-bc34-5c60e60d2826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:10.770888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5e194-311f-4033-bc34-5c60e60d2826 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-73be7ba6-4044-47be-8ae6-75970820f748 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:10.776239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:10.777210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:10.778166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:10.778166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:10.778166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:10.778166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:10.778166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:10.778166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:10.778166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:10.778166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:10.778166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:10.778166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:10.786208 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 368/718] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 26 18:11:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-5cd5e194-311f-4033-bc34-5c60e60d2826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:10.796369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:10.797365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:10.798267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:10.798267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:10.798267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:10.798446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be7ba6-4044-47be-8ae6-75970820f748 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:10.800468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 351/719] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:10.801656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5e194-311f-4033-bc34-5c60e60d2826 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:10.848381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:10.900976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be7ba6-4044-47be-8ae6-75970820f748 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:10.914297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5e194-311f-4033-bc34-5c60e60d2826 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:10.935397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa31fe-3dad-4f3d-a9e3-e158330fcb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:10.936018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa31fe-3dad-4f3d-a9e3-e158330fcb2c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:10.936296 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa31fe-3dad-4f3d-a9e3-e158330fcb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:10.936575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa31fe-3dad-4f3d-a9e3-e158330fcb2c None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:10.937333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa31fe-3dad-4f3d-a9e3-e158330fcb2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:10.937640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa31fe-3dad-4f3d-a9e3-e158330fcb2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:10.939105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa31fe-3dad-4f3d-a9e3-e158330fcb2c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:10.951992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102dbb9-3f31-4c2a-b0a8-fe3984ace20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:10.952635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102dbb9-3f31-4c2a-b0a8-fe3984ace20e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:10.952944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102dbb9-3f31-4c2a-b0a8-fe3984ace20e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:10.953221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102dbb9-3f31-4c2a-b0a8-fe3984ace20e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:10.961989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 369/720] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 26 18:11:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:10.961989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa31fe-3dad-4f3d-a9e3-e158330fcb2c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:10.963605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102dbb9-3f31-4c2a-b0a8-fe3984ace20e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-8102dbb9-3f31-4c2a-b0a8-fe3984ace20e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:10.968943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:10.969867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 352/721] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:10.976000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98077ef-cb05-41da-b7f2-9cebba56a594 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:10.976785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98077ef-cb05-41da-b7f2-9cebba56a594 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:10.976785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98077ef-cb05-41da-b7f2-9cebba56a594 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:10.976785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 353/722] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:10.976785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98077ef-cb05-41da-b7f2-9cebba56a594 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:11.003355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:11.072242 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa31fe-3dad-4f3d-a9e3-e158330fcb2c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:11.081421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:11.085722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98077ef-cb05-41da-b7f2-9cebba56a594 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:11.111136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11f05e-5054-4649-be08-82e48dc26834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:11.112137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11f05e-5054-4649-be08-82e48dc26834 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:11.112595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11f05e-5054-4649-be08-82e48dc26834 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:11.113066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11f05e-5054-4649-be08-82e48dc26834 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:11.113996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11f05e-5054-4649-be08-82e48dc26834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:11.114600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11f05e-5054-4649-be08-82e48dc26834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:11.116154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11f05e-5054-4649-be08-82e48dc26834 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:11.118997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2668632-c184-4f13-b648-fbdad6364637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:11.119616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2668632-c184-4f13-b648-fbdad6364637 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:11.119897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2668632-c184-4f13-b648-fbdad6364637 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:11.120173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2668632-c184-4f13-b648-fbdad6364637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:11.128899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 370/723] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:11.130035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11f05e-5054-4649-be08-82e48dc26834 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:11.235919 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:11.244542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11f05e-5054-4649-be08-82e48dc26834 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:11.282024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b27f60-7611-48d3-9de0-c55fbc4d6241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:11.282639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b27f60-7611-48d3-9de0-c55fbc4d6241 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:11.282920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b27f60-7611-48d3-9de0-c55fbc4d6241 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:11.283194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b27f60-7611-48d3-9de0-c55fbc4d6241 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:11.283860 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b27f60-7611-48d3-9de0-c55fbc4d6241 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:11.284166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b27f60-7611-48d3-9de0-c55fbc4d6241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:11.285844 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b27f60-7611-48d3-9de0-c55fbc4d6241 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:11.295130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 371/724] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:11.296335 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510f3c7-4bd3-4637-a4fb-1482dbe486cd None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:11.296621 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510f3c7-4bd3-4637-a4fb-1482dbe486cd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:11.296918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510f3c7-4bd3-4637-a4fb-1482dbe486cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:11.309133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2668632-c184-4f13-b648-fbdad6364637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:11.310660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2668632-c184-4f13-b648-fbdad6364637 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:11.315631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a510f3c7-4bd3-4637-a4fb-1482dbe486cd None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:11.316857 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a510f3c7-4bd3-4637-a4fb-1482dbe486cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:11.395062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 372/725] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:11:11.395913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510f3c7-4bd3-4637-a4fb-1482dbe486cd None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:11.409897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:11.419574 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 354/726] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:11:11.420247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2668632-c184-4f13-b648-fbdad6364637 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:11.491345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:11.506415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510f3c7-4bd3-4637-a4fb-1482dbe486cd None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:11.535713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2668632-c184-4f13-b648-fbdad6364637 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:11.548321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864bc2e-2272-45e7-9957-2fe9ca6ba2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:11.548986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864bc2e-2272-45e7-9957-2fe9ca6ba2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:11.549272 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864bc2e-2272-45e7-9957-2fe9ca6ba2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:11.549542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864bc2e-2272-45e7-9957-2fe9ca6ba2e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:11.556878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864bc2e-2272-45e7-9957-2fe9ca6ba2e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:11.558341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864bc2e-2272-45e7-9957-2fe9ca6ba2e3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-7864bc2e-2272-45e7-9957-2fe9ca6ba2e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:11.569787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:11.570720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 373/727] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 26 18:11:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2264c-3b2e-4497-adb3-01d7c61a0079 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:11.576639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2264c-3b2e-4497-adb3-01d7c61a0079 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:11.577378 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2264c-3b2e-4497-adb3-01d7c61a0079 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:11.577378 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 374/728] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:11.577514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918868ff-2798-42c0-b241-7f13d4af9f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:11.577514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918868ff-2798-42c0-b241-7f13d4af9f7a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:11.577656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918868ff-2798-42c0-b241-7f13d4af9f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:11.578079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918868ff-2798-42c0-b241-7f13d4af9f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:11.578964 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2264c-3b2e-4497-adb3-01d7c61a0079 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:11.589723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918868ff-2798-42c0-b241-7f13d4af9f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:11.591625 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918868ff-2798-42c0-b241-7f13d4af9f7a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-918868ff-2798-42c0-b241-7f13d4af9f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:11.608096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:11.609293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:11.610174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:11.610174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:11.610174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:11.610174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 355/729] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:11.610174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918868ff-2798-42c0-b241-7f13d4af9f7a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:11.665997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:11.688828 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2264c-3b2e-4497-adb3-01d7c61a0079 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:11.713437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918868ff-2798-42c0-b241-7f13d4af9f7a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:11.720661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1ff2a-f409-430d-965d-a21c9aff54c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:11.721314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1ff2a-f409-430d-965d-a21c9aff54c8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:11.721594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1ff2a-f409-430d-965d-a21c9aff54c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:11.721856 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1ff2a-f409-430d-965d-a21c9aff54c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:11.732488 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1ff2a-f409-430d-965d-a21c9aff54c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:11.734036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1ff2a-f409-430d-965d-a21c9aff54c8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:11.740158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:11.747445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b497a9e-b4b9-415b-b4fd-f97db432e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:11.747866 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b497a9e-b4b9-415b-b4fd-f97db432e17f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:11.748140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b497a9e-b4b9-415b-b4fd-f97db432e17f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:11.748406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b497a9e-b4b9-415b-b4fd-f97db432e17f None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e4a1ff2a-f409-430d-965d-a21c9aff54c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:11.748742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:11.749677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:11.750575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:11.750575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:11.750575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:11.750742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b497a9e-b4b9-415b-b4fd-f97db432e17f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:11.750742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b497a9e-b4b9-415b-b4fd-f97db432e17f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:11.750873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 375/730] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:11.750942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b497a9e-b4b9-415b-b4fd-f97db432e17f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:11.751272 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ca2de-793f-4857-b9e7-d6931fb7d873 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:11.751360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ca2de-793f-4857-b9e7-d6931fb7d873 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:11.751596 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ca2de-793f-4857-b9e7-d6931fb7d873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:11.768337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 356/731] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Aug 26 18:11:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:11.769084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b497a9e-b4b9-415b-b4fd-f97db432e17f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:11.769761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-226ca2de-793f-4857-b9e7-d6931fb7d873 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:11.770990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-226ca2de-793f-4857-b9e7-d6931fb7d873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:11.837531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 376/732] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 18:11:11.838321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ca2de-793f-4857-b9e7-d6931fb7d873 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:11.867205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b497a9e-b4b9-415b-b4fd-f97db432e17f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:11.878855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:11.903187 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e406ac7-2e34-4161-bcdc-926978bda0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:11.903829 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e406ac7-2e34-4161-bcdc-926978bda0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:11.904141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e406ac7-2e34-4161-bcdc-926978bda0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:11.904381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e406ac7-2e34-4161-bcdc-926978bda0f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:11.905073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e406ac7-2e34-4161-bcdc-926978bda0f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:11.905376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e406ac7-2e34-4161-bcdc-926978bda0f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:11.906742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e406ac7-2e34-4161-bcdc-926978bda0f0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:11.920798 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 357/733] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:11.920798 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e406ac7-2e34-4161-bcdc-926978bda0f0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:11.954191 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ca2de-793f-4857-b9e7-d6931fb7d873 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:11.980550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:11.988902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d284b72-cd2f-4913-a6d0-9e1ff55d91cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:11.990358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d284b72-cd2f-4913-a6d0-9e1ff55d91cd None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:11.991162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d284b72-cd2f-4913-a6d0-9e1ff55d91cd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:11.991434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d284b72-cd2f-4913-a6d0-9e1ff55d91cd None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:11.992289 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d284b72-cd2f-4913-a6d0-9e1ff55d91cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:11.994469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d284b72-cd2f-4913-a6d0-9e1ff55d91cd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:12.016918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 377/734] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:11:11 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:11:12.016918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d284b72-cd2f-4913-a6d0-9e1ff55d91cd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:12.024863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e406ac7-2e34-4161-bcdc-926978bda0f0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:12.097011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a77de0-abc9-4329-87ef-40982b4d23a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:12.097671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a77de0-abc9-4329-87ef-40982b4d23a3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:12.097945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a77de0-abc9-4329-87ef-40982b4d23a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:12.098241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a77de0-abc9-4329-87ef-40982b4d23a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:12.098903 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a77de0-abc9-4329-87ef-40982b4d23a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:12.099205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a77de0-abc9-4329-87ef-40982b4d23a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:12.100594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a77de0-abc9-4329-87ef-40982b4d23a3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:12.114558 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 358/735] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:12.115436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a77de0-abc9-4329-87ef-40982b4d23a3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:12.144423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:12.160340 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d284b72-cd2f-4913-a6d0-9e1ff55d91cd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:12.199171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64360dc7-7918-4c38-a3b4-a0cc30f1c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:12.200006 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64360dc7-7918-4c38-a3b4-a0cc30f1c53d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:12.200308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64360dc7-7918-4c38-a3b4-a0cc30f1c53d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:12.200585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64360dc7-7918-4c38-a3b4-a0cc30f1c53d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:12.230087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a77de0-abc9-4329-87ef-40982b4d23a3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:12.265845 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:12.266410 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a231429-47cd-41c4-aad3-70b86d9434b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:12.267311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a231429-47cd-41c4-aad3-70b86d9434b4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:12.267311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a231429-47cd-41c4-aad3-70b86d9434b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:12.267887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a231429-47cd-41c4-aad3-70b86d9434b4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:12.277165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a231429-47cd-41c4-aad3-70b86d9434b4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:12.278704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a231429-47cd-41c4-aad3-70b86d9434b4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:12.280064 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64360dc7-7918-4c38-a3b4-a0cc30f1c53d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:12.281571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64360dc7-7918-4c38-a3b4-a0cc30f1c53d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-8a231429-47cd-41c4-aad3-70b86d9434b4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:12.292170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:12.293179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:12.294229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:12.294229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:12.294229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:12.294229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:12.294229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:12.294229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:12.294229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:12.294229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:12.294229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 18:11:12.294229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:12.294229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 359/736] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:12.294229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a231429-47cd-41c4-aad3-70b86d9434b4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:12.384684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:12.390732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 378/737] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:12 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 18:11:12.391816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64360dc7-7918-4c38-a3b4-a0cc30f1c53d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:12.404984 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a231429-47cd-41c4-aad3-70b86d9434b4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:12.440631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c707fa5-3586-4e66-a3ec-a6f6ae37af7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:12.441289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c707fa5-3586-4e66-a3ec-a6f6ae37af7a None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:12.441568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c707fa5-3586-4e66-a3ec-a6f6ae37af7a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:12.441846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c707fa5-3586-4e66-a3ec-a6f6ae37af7a None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:12.442600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c707fa5-3586-4e66-a3ec-a6f6ae37af7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:12.443970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c707fa5-3586-4e66-a3ec-a6f6ae37af7a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:12.464845 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 360/738] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:11:12 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:11:12.464845 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c707fa5-3586-4e66-a3ec-a6f6ae37af7a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:12.495335 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:12.509902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64360dc7-7918-4c38-a3b4-a0cc30f1c53d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:12.558100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412bf33-c9c8-41ff-a690-31b70667ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:12.558742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412bf33-c9c8-41ff-a690-31b70667ab62 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:12.559025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412bf33-c9c8-41ff-a690-31b70667ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:12.559295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412bf33-c9c8-41ff-a690-31b70667ab62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:12.567405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412bf33-c9c8-41ff-a690-31b70667ab62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:12.569078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412bf33-c9c8-41ff-a690-31b70667ab62 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:12.581965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c707fa5-3586-4e66-a3ec-a6f6ae37af7a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e412bf33-c9c8-41ff-a690-31b70667ab62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:12.582176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:12.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:12.584410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:12.584410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:12.584410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:12.584410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:12.584410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:12.584410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:12.584410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:12.584410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:12.584410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 379/739] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:12.584410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412bf33-c9c8-41ff-a690-31b70667ab62 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:12.621915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff48c3-0ebd-4a9f-9d9e-041a77134e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:12.622937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff48c3-0ebd-4a9f-9d9e-041a77134e54 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:12.623486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff48c3-0ebd-4a9f-9d9e-041a77134e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:12.623897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff48c3-0ebd-4a9f-9d9e-041a77134e54 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:12.624651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff48c3-0ebd-4a9f-9d9e-041a77134e54 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:12.625656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff48c3-0ebd-4a9f-9d9e-041a77134e54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:12.627114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff48c3-0ebd-4a9f-9d9e-041a77134e54 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:12.647595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 361/740] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Aug 26 18:11:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:12.648376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff48c3-0ebd-4a9f-9d9e-041a77134e54 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:12.653411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:12.698630 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412bf33-c9c8-41ff-a690-31b70667ab62 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:12.742922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89677cb4-3ef0-4b08-8465-738c2c26bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:12.743575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89677cb4-3ef0-4b08-8465-738c2c26bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:12.743852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89677cb4-3ef0-4b08-8465-738c2c26bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:12.744123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89677cb4-3ef0-4b08-8465-738c2c26bfd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:12.758370 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89677cb4-3ef0-4b08-8465-738c2c26bfd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:12.760355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89677cb4-3ef0-4b08-8465-738c2c26bfd4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:12.764408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:12.773083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff48c3-0ebd-4a9f-9d9e-041a77134e54 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-89677cb4-3ef0-4b08-8465-738c2c26bfd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:12.780121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:12.781109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:12.781987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:12.781987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:12.781987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:12.784806 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 380/741] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:12.785646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89677cb4-3ef0-4b08-8465-738c2c26bfd4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:12.821911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e2562-1fc8-4642-986b-ca70aa7039ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:12.822525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e2562-1fc8-4642-986b-ca70aa7039ec None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:12.822805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e2562-1fc8-4642-986b-ca70aa7039ec None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:12.823079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e2562-1fc8-4642-986b-ca70aa7039ec None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:12.823779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e2562-1fc8-4642-986b-ca70aa7039ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:12.824085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e2562-1fc8-4642-986b-ca70aa7039ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:12.825625 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e2562-1fc8-4642-986b-ca70aa7039ec None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:12.838114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 362/742] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:12.838965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e2562-1fc8-4642-986b-ca70aa7039ec None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:12.916983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89677cb4-3ef0-4b08-8465-738c2c26bfd4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:12.927229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:12.965479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c7476-8b96-4070-9e36-fe053b8f8b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:12.966666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c7476-8b96-4070-9e36-fe053b8f8b13 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:12.966947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c7476-8b96-4070-9e36-fe053b8f8b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:12.967491 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c7476-8b96-4070-9e36-fe053b8f8b13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:12.983579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e2562-1fc8-4642-986b-ca70aa7039ec None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:13.025845 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78140f29-af20-4796-a7dd-96396f9186d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:13.026682 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78140f29-af20-4796-a7dd-96396f9186d1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:13.026965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78140f29-af20-4796-a7dd-96396f9186d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:13.027238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78140f29-af20-4796-a7dd-96396f9186d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:13.027899 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78140f29-af20-4796-a7dd-96396f9186d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:13.028204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78140f29-af20-4796-a7dd-96396f9186d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:13.030247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78140f29-af20-4796-a7dd-96396f9186d1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:13.039929 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:13.046392 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 363/743] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:13.047783 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78140f29-af20-4796-a7dd-96396f9186d1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:13.053750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c7476-8b96-4070-9e36-fe053b8f8b13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:13.055244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c7476-8b96-4070-9e36-fe053b8f8b13 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:13.174474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78140f29-af20-4796-a7dd-96396f9186d1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:13.178051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 381/744] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:11:13.178927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c7476-8b96-4070-9e36-fe053b8f8b13 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:13.204210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:13.215686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b786698-d32d-4b12-802b-0813adac42dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:13.216508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b786698-d32d-4b12-802b-0813adac42dd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:13.216891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b786698-d32d-4b12-802b-0813adac42dd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:13.217235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b786698-d32d-4b12-802b-0813adac42dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:13.218037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b786698-d32d-4b12-802b-0813adac42dd None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=3791df34c6e442aaabd90d7f5c2f3a1a) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:13.218417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b786698-d32d-4b12-802b-0813adac42dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:13.219974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b786698-d32d-4b12-802b-0813adac42dd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:13.226238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 364/745] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:13 2022] GET /identity/v3/role_assignments?user.id=3791df34c6e442aaabd90d7f5c2f3a1a&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=db572ad3d504403cbb227c2155c93eda => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:13.227154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b786698-d32d-4b12-802b-0813adac42dd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:13.354767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b786698-d32d-4b12-802b-0813adac42dd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:13.366408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:13.374594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c7476-8b96-4070-9e36-fe053b8f8b13 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:13.389589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885ff94-f4f9-457f-9cd4-3022ddb61ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:13.390231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885ff94-f4f9-457f-9cd4-3022ddb61ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:13.390518 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885ff94-f4f9-457f-9cd4-3022ddb61ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:13.390896 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885ff94-f4f9-457f-9cd4-3022ddb61ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:13.402292 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885ff94-f4f9-457f-9cd4-3022ddb61ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:13.403812 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885ff94-f4f9-457f-9cd4-3022ddb61ae3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a885ff94-f4f9-457f-9cd4-3022ddb61ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:13.419862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:13.421923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:13.423086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:13.423086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:13.423086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:13.423086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 365/746] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:13.431954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885ff94-f4f9-457f-9cd4-3022ddb61ae3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:13.439700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69381f38-b110-4589-8c3b-e914392fc605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:13.440526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69381f38-b110-4589-8c3b-e914392fc605 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:13.440834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69381f38-b110-4589-8c3b-e914392fc605 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:13.441101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69381f38-b110-4589-8c3b-e914392fc605 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:13.449909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69381f38-b110-4589-8c3b-e914392fc605 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:13.451654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69381f38-b110-4589-8c3b-e914392fc605 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-69381f38-b110-4589-8c3b-e914392fc605 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:13.468581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:13.469961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:13.471052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:13.471052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:13.471052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:13.471052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:13.471052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:13.471052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:13.471052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:13.471052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:13.471052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 382/747] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:13.476389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69381f38-b110-4589-8c3b-e914392fc605 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:13.487269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:13.556996 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885ff94-f4f9-457f-9cd4-3022ddb61ae3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:13.602029 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c9f07-3fda-41f2-a4ff-dc5279db75d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:13.603053 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9f07-3fda-41f2-a4ff-dc5279db75d9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:13.603547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9f07-3fda-41f2-a4ff-dc5279db75d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:13.604014 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9f07-3fda-41f2-a4ff-dc5279db75d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:13.604975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c9f07-3fda-41f2-a4ff-dc5279db75d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:13.605661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c9f07-3fda-41f2-a4ff-dc5279db75d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:13.607289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c9f07-3fda-41f2-a4ff-dc5279db75d9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:13.625193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 366/748] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:13.633747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c9f07-3fda-41f2-a4ff-dc5279db75d9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:13.823253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:13.826179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c9f07-3fda-41f2-a4ff-dc5279db75d9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:13.879286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0674a1-8479-4240-80cf-cd3e0eef0fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:13.879856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0674a1-8479-4240-80cf-cd3e0eef0fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:13.880134 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0674a1-8479-4240-80cf-cd3e0eef0fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:13.880405 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0674a1-8479-4240-80cf-cd3e0eef0fd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:13.894504 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0674a1-8479-4240-80cf-cd3e0eef0fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:13.895977 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0674a1-8479-4240-80cf-cd3e0eef0fd0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:13.900238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69381f38-b110-4589-8c3b-e914392fc605 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-1c0674a1-8479-4240-80cf-cd3e0eef0fd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:13.917978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:13.918916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:13.919819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:13.919819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:13.919819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:13.919819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:13.919819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:13.919819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:13.919819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:13.919819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:13.921869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 367/749] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:13.927850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0674a1-8479-4240-80cf-cd3e0eef0fd0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:13.964909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f95571-d9ac-403a-83af-da43428dfddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:13.965764 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f95571-d9ac-403a-83af-da43428dfddd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:13.966201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f95571-d9ac-403a-83af-da43428dfddd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:13.966598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f95571-d9ac-403a-83af-da43428dfddd None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:13.967417 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f95571-d9ac-403a-83af-da43428dfddd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:13.967874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f95571-d9ac-403a-83af-da43428dfddd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:13.969482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f95571-d9ac-403a-83af-da43428dfddd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:13.986623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 383/750] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 511 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:13.992431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f95571-d9ac-403a-83af-da43428dfddd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:14.024190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:14.091662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0674a1-8479-4240-80cf-cd3e0eef0fd0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:14.130790 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f95571-d9ac-403a-83af-da43428dfddd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:14.131104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1be78-36f3-4716-a381-0a1a77bfe06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:14.131994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1be78-36f3-4716-a381-0a1a77bfe06d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:14.132471 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1be78-36f3-4716-a381-0a1a77bfe06d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:14.132997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1be78-36f3-4716-a381-0a1a77bfe06d None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:14.133947 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1be78-36f3-4716-a381-0a1a77bfe06d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:14.134467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1be78-36f3-4716-a381-0a1a77bfe06d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:14.136161 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1be78-36f3-4716-a381-0a1a77bfe06d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:14.149434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 368/751] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:14.151052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87092d-bcf3-4d7c-9825-135fd8697c51 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:14.151534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87092d-bcf3-4d7c-9825-135fd8697c51 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:14.152019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87092d-bcf3-4d7c-9825-135fd8697c51 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:14.157699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 369/752] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:14.158828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87092d-bcf3-4d7c-9825-135fd8697c51 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:14.173808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c4fe6-c1c5-40d9-b8d1-9e2176d863db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:14.174722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4fe6-c1c5-40d9-b8d1-9e2176d863db None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:14.175002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4fe6-c1c5-40d9-b8d1-9e2176d863db None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:14.175266 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4fe6-c1c5-40d9-b8d1-9e2176d863db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:14.176438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c4fe6-c1c5-40d9-b8d1-9e2176d863db None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=7626e0cf57a74281b3cf5f3b31b5b79a) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:14.176765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c4fe6-c1c5-40d9-b8d1-9e2176d863db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:14.178479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c4fe6-c1c5-40d9-b8d1-9e2176d863db None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:14.183726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:14.192936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 384/753] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:13 2022] GET /identity/v3/role_assignments?user.id=7626e0cf57a74281b3cf5f3b31b5b79a&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:14.194536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8761f-3af7-44b5-b128-b384d579c83c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:14.194820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8761f-3af7-44b5-b128-b384d579c83c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:14.195088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8761f-3af7-44b5-b128-b384d579c83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:14.234439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ccc8761f-3af7-44b5-b128-b384d579c83c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:14.237530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ccc8761f-3af7-44b5-b128-b384d579c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:14.358394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87092d-bcf3-4d7c-9825-135fd8697c51 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:14.375369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 385/754] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:14.404439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52034582-d671-4e82-83e2-68013be2acca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:14.404997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52034582-d671-4e82-83e2-68013be2acca None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:14.405435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52034582-d671-4e82-83e2-68013be2acca None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:14.405709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52034582-d671-4e82-83e2-68013be2acca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:14.406489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52034582-d671-4e82-83e2-68013be2acca None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=98c92b2c982a4780884365a7a7ec6514) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:14.406797 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52034582-d671-4e82-83e2-68013be2acca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:14.408271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52034582-d671-4e82-83e2-68013be2acca None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:14.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 370/755] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:14 2022] GET /identity/v3/role_assignments?user.id=98c92b2c982a4780884365a7a7ec6514&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=db572ad3d504403cbb227c2155c93eda => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:14.482714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f87e-f155-44d4-aab0-4f312d1e0fd7 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:14.483283 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f87e-f155-44d4-aab0-4f312d1e0fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:14.483764 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f87e-f155-44d4-aab0-4f312d1e0fd7 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:14.485803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 386/756] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:14.494810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222ed32-db0a-417e-9830-c1ce5097819a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:14.495094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222ed32-db0a-417e-9830-c1ce5097819a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:14.495360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222ed32-db0a-417e-9830-c1ce5097819a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:14.522594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0222ed32-db0a-417e-9830-c1ce5097819a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:14.523832 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0222ed32-db0a-417e-9830-c1ce5097819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:14.620492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 371/757] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:14.666447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f87e-f155-44d4-aab0-4f312d1e0fd7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:14.679949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:14.780780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f87e-f155-44d4-aab0-4f312d1e0fd7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:14.824617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a112b2b-2a63-475f-903b-b4c41f6f2b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:14.825763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a112b2b-2a63-475f-903b-b4c41f6f2b0a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:14.826320 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a112b2b-2a63-475f-903b-b4c41f6f2b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:14.826798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a112b2b-2a63-475f-903b-b4c41f6f2b0a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:14.827595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a112b2b-2a63-475f-903b-b4c41f6f2b0a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:14.829224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a112b2b-2a63-475f-903b-b4c41f6f2b0a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-4a112b2b-2a63-475f-903b-b4c41f6f2b0a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:14.843143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:14.844158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 18:11:14.845015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:14.847523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 387/758] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Aug 26 18:11:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:14.853938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222ed32-db0a-417e-9830-c1ce5097819a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:14.883315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:15.000682 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222ed32-db0a-417e-9830-c1ce5097819a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:15.049461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64795757-ed28-481d-94ab-480d78f038f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:15.050447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795757-ed28-481d-94ab-480d78f038f7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:15.050919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795757-ed28-481d-94ab-480d78f038f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:15.051415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795757-ed28-481d-94ab-480d78f038f7 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:15.052239 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64795757-ed28-481d-94ab-480d78f038f7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:15.052771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64795757-ed28-481d-94ab-480d78f038f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:15.054332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64795757-ed28-481d-94ab-480d78f038f7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:15.064657 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 372/759] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Aug 26 18:11:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:15.070371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a112b2b-2a63-475f-903b-b4c41f6f2b0a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:15.083052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64795757-ed28-481d-94ab-480d78f038f7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:15.249128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:15.263871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:15.311145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64795757-ed28-481d-94ab-480d78f038f7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:15.372518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a112b2b-2a63-475f-903b-b4c41f6f2b0a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:15.385895 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9ea7f-6a21-4d93-ac83-4ee2f109acdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:15.386882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9ea7f-6a21-4d93-ac83-4ee2f109acdc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:15.387426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9ea7f-6a21-4d93-ac83-4ee2f109acdc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:15.387939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9ea7f-6a21-4d93-ac83-4ee2f109acdc None admin] PATH_INFO: `/v3/services/network` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:15.388810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9ea7f-6a21-4d93-ac83-4ee2f109acdc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:15.391276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9ea7f-6a21-4d93-ac83-4ee2f109acdc None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-12d9ea7f-6a21-4d93-ac83-4ee2f109acdc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:15.404254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:15.405455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 18:11:15.406515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:15.409661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 373/760] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:15 2022] GET /identity/v3/services/network => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:15.417668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9ea7f-6a21-4d93-ac83-4ee2f109acdc None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:15.458017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9947e-7b8d-4fe7-b208-c5358016345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:15.459033 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9947e-7b8d-4fe7-b208-c5358016345a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:15.459556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9947e-7b8d-4fe7-b208-c5358016345a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:15.459995 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9947e-7b8d-4fe7-b208-c5358016345a None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:15.460847 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9947e-7b8d-4fe7-b208-c5358016345a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:15.461284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9947e-7b8d-4fe7-b208-c5358016345a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:15.462948 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9947e-7b8d-4fe7-b208-c5358016345a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:15.473899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 388/761] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Aug 26 18:11:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:15.479980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9947e-7b8d-4fe7-b208-c5358016345a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:15.635826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9ea7f-6a21-4d93-ac83-4ee2f109acdc None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:15.704277 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9947e-7b8d-4fe7-b208-c5358016345a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:15.742040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67b0df-e7d0-4912-862a-9a5e0e350fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:15.742663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67b0df-e7d0-4912-862a-9a5e0e350fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:15.742938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67b0df-e7d0-4912-862a-9a5e0e350fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:15.743205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67b0df-e7d0-4912-862a-9a5e0e350fc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:15.743689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79240c01-ec27-4087-8151-740ce64933b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:15.743903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67b0df-e7d0-4912-862a-9a5e0e350fc9 None admin] RBAC: Adding query filter params (interface=public, service_id=a9344338367f478f80e59b6ff50c5ebd, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:15.744206 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67b0df-e7d0-4912-862a-9a5e0e350fc9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:15.744920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79240c01-ec27-4087-8151-740ce64933b9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:15.745408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79240c01-ec27-4087-8151-740ce64933b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:15.745640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67b0df-e7d0-4912-862a-9a5e0e350fc9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:15.746054 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79240c01-ec27-4087-8151-740ce64933b9 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:15.746886 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79240c01-ec27-4087-8151-740ce64933b9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:15.756741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79240c01-ec27-4087-8151-740ce64933b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:15.756741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79240c01-ec27-4087-8151-740ce64933b9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:15.756741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 374/763] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:15.757053 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f153d-bd61-4713-b06b-59f2e908dc11 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:15.757130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f153d-bd61-4713-b06b-59f2e908dc11 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:15.757402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f153d-bd61-4713-b06b-59f2e908dc11 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:15.760737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 389/763] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 26 18:11:15 2022] GET /identity/v3/endpoints?service_id=a9344338367f478f80e59b6ff50c5ebd&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:15.760737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67b0df-e7d0-4912-862a-9a5e0e350fc9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:15.768340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 375/764] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:15.772507 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f153d-bd61-4713-b06b-59f2e908dc11 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:15.772628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:15.787189 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:15.889311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67b0df-e7d0-4912-862a-9a5e0e350fc9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:15.890162 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f153d-bd61-4713-b06b-59f2e908dc11 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:15.925975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9faeb-7c74-486d-8899-cc7adc0d1067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:15.926694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9faeb-7c74-486d-8899-cc7adc0d1067 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:15.927041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9faeb-7c74-486d-8899-cc7adc0d1067 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:15.927379 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9faeb-7c74-486d-8899-cc7adc0d1067 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:15.928146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9faeb-7c74-486d-8899-cc7adc0d1067 None admin] RBAC: Adding query filter params (type=network) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:15.928518 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9faeb-7c74-486d-8899-cc7adc0d1067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:15.930009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9faeb-7c74-486d-8899-cc7adc0d1067 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:15.930568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8e7da-bfc9-4ff7-a1f1-ef0f4c685827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:15.931190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8e7da-bfc9-4ff7-a1f1-ef0f4c685827 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:15.931631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8e7da-bfc9-4ff7-a1f1-ef0f4c685827 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:15.931906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8e7da-bfc9-4ff7-a1f1-ef0f4c685827 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:15.932508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8e7da-bfc9-4ff7-a1f1-ef0f4c685827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:15.934593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8e7da-bfc9-4ff7-a1f1-ef0f4c685827 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:15.937068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 376/765] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:15.938401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f429d-60e2-42b5-ac4f-13aca7260c0a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:15.938764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f429d-60e2-42b5-ac4f-13aca7260c0a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:15.939101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f429d-60e2-42b5-ac4f-13aca7260c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:15.944826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 390/766] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 26 18:11:15 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:15.945791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8e7da-bfc9-4ff7-a1f1-ef0f4c685827 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:15.973990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-bb2f429d-60e2-42b5-ac4f-13aca7260c0a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:15.978218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bb2f429d-60e2-42b5-ac4f-13aca7260c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:16.085070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:16.129155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:16.136185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 377/767] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:16.136962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8e7da-bfc9-4ff7-a1f1-ef0f4c685827 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:16.171848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58913a8-cfb0-426a-8f2c-ee2f49a8c01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:16.172874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58913a8-cfb0-426a-8f2c-ee2f49a8c01c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:16.173346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58913a8-cfb0-426a-8f2c-ee2f49a8c01c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:16.173812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58913a8-cfb0-426a-8f2c-ee2f49a8c01c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:16.174698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58913a8-cfb0-426a-8f2c-ee2f49a8c01c None admin] RBAC: Adding query filter params (interface=public, service_id=b0041f326ed6461b994556cb1c36762b, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:16.175216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58913a8-cfb0-426a-8f2c-ee2f49a8c01c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:16.176798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58913a8-cfb0-426a-8f2c-ee2f49a8c01c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:16.182524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 391/768] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 26 18:11:15 2022] GET /identity/v3/endpoints?service_id=b0041f326ed6461b994556cb1c36762b&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:16.187924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f429d-60e2-42b5-ac4f-13aca7260c0a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:16.299348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f429d-60e2-42b5-ac4f-13aca7260c0a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:16.336488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9722f-0d65-42bd-97fa-e00ba5f8b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:16.337075 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9722f-0d65-42bd-97fa-e00ba5f8b681 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:16.337354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9722f-0d65-42bd-97fa-e00ba5f8b681 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:16.337678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9722f-0d65-42bd-97fa-e00ba5f8b681 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:16.338300 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9722f-0d65-42bd-97fa-e00ba5f8b681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:16.339678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9722f-0d65-42bd-97fa-e00ba5f8b681 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:16.345750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 378/769] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 26 18:11:16 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:16.404860 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d3952-6ac3-4127-a830-529f75424a1f None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:16.405193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d3952-6ac3-4127-a830-529f75424a1f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:16.405626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d3952-6ac3-4127-a830-529f75424a1f None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:16.407357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 392/770] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:16.413478 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe298af7-c391-4774-bdaa-8e20bab23e1a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:16.413785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe298af7-c391-4774-bdaa-8e20bab23e1a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:16.414031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe298af7-c391-4774-bdaa-8e20bab23e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:16.420058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d3952-6ac3-4127-a830-529f75424a1f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:16.443338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fe298af7-c391-4774-bdaa-8e20bab23e1a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:16.444589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fe298af7-c391-4774-bdaa-8e20bab23e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:16.550696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:16.560513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 379/771] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:16.596639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d3952-6ac3-4127-a830-529f75424a1f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:16.629114 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:16.646376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbf5b6-4bc6-4658-ae11-7b49df4ce806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:16.647083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbf5b6-4bc6-4658-ae11-7b49df4ce806 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:16.647365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbf5b6-4bc6-4658-ae11-7b49df4ce806 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:16.647636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbf5b6-4bc6-4658-ae11-7b49df4ce806 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:16.661966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbf5b6-4bc6-4658-ae11-7b49df4ce806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-71cbf5b6-4bc6-4658-ae11-7b49df4ce806 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:16.666697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:16.667618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:16.668542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:16.668542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:16.668542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:16.668542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:16.668542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:16.668542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:16.668542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:16.668542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:16.668542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:16.668542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:16.668542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:16.668542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:16.670712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 393/772] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:16.675694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe298af7-c391-4774-bdaa-8e20bab23e1a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:16.742173 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf20fcc-0760-4136-8ac6-8724a33935bd None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:16.742507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf20fcc-0760-4136-8ac6-8724a33935bd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:16.742725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf20fcc-0760-4136-8ac6-8724a33935bd None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:16.744331 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 394/773] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:16.749433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20c7e1-3786-4135-978f-21f25a71e2f3 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:16.749710 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20c7e1-3786-4135-978f-21f25a71e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:16.749982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20c7e1-3786-4135-978f-21f25a71e2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:16.781423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8d20c7e1-3786-4135-978f-21f25a71e2f3 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:16.782648 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8d20c7e1-3786-4135-978f-21f25a71e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:16.806863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe298af7-c391-4774-bdaa-8e20bab23e1a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:16.849396 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbeeb4-2feb-4744-a71d-0f7b5a67fd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:16.851453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbeeb4-2feb-4744-a71d-0f7b5a67fd6e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:16.851763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbeeb4-2feb-4744-a71d-0f7b5a67fd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:16.852007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbeeb4-2feb-4744-a71d-0f7b5a67fd6e None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:16.852784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbeeb4-2feb-4744-a71d-0f7b5a67fd6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:16.853112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbeeb4-2feb-4744-a71d-0f7b5a67fd6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:16.854811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbeeb4-2feb-4744-a71d-0f7b5a67fd6e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:16.866421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 380/774] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:11:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:16.867354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbeeb4-2feb-4744-a71d-0f7b5a67fd6e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:16.909119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 395/775] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:11:16.910365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20c7e1-3786-4135-978f-21f25a71e2f3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:16.928904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:17.031259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20c7e1-3786-4135-978f-21f25a71e2f3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:17.042846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbeeb4-2feb-4744-a71d-0f7b5a67fd6e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:17.055043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:17.071450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63271e-607c-4dec-b149-c10d242bbfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:17.072455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63271e-607c-4dec-b149-c10d242bbfce None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:17.073107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63271e-607c-4dec-b149-c10d242bbfce None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:17.073582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63271e-607c-4dec-b149-c10d242bbfce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:17.085506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63271e-607c-4dec-b149-c10d242bbfce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:17.087853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63271e-607c-4dec-b149-c10d242bbfce None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-8d63271e-607c-4dec-b149-c10d242bbfce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:17.104706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:17.105698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:17.106615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:17.106615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:17.106615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:17.109286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 396/776] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:17.114645 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63271e-607c-4dec-b149-c10d242bbfce None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:17.140683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbaea1-6ca1-4732-9ac6-cc4dfafd8393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:17.141403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbaea1-6ca1-4732-9ac6-cc4dfafd8393 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:17.141685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbaea1-6ca1-4732-9ac6-cc4dfafd8393 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:17.141959 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbaea1-6ca1-4732-9ac6-cc4dfafd8393 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:17.177444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbaea1-6ca1-4732-9ac6-cc4dfafd8393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b1fbaea1-6ca1-4732-9ac6-cc4dfafd8393 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:17.182699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:17.183607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:17.184453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 381/777] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:11:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:17.197745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbaea1-6ca1-4732-9ac6-cc4dfafd8393 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:17.229485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63271e-607c-4dec-b149-c10d242bbfce None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:17.266081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27abe81-23a4-413a-83e7-b8633853df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:17.267041 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27abe81-23a4-413a-83e7-b8633853df20 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:17.267540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27abe81-23a4-413a-83e7-b8633853df20 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:17.268193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27abe81-23a4-413a-83e7-b8633853df20 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:17.269160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27abe81-23a4-413a-83e7-b8633853df20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:17.269704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27abe81-23a4-413a-83e7-b8633853df20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:17.271472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27abe81-23a4-413a-83e7-b8633853df20 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:17.284855 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 397/778] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:17.286008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27abe81-23a4-413a-83e7-b8633853df20 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:17.319204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbaea1-6ca1-4732-9ac6-cc4dfafd8393 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:17.319841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:17.338594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:17.358882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6681b09-fda0-4482-9cde-4e301174d072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:17.359790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6681b09-fda0-4482-9cde-4e301174d072 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:17.360296 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6681b09-fda0-4482-9cde-4e301174d072 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:17.360835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6681b09-fda0-4482-9cde-4e301174d072 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:17.361723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6681b09-fda0-4482-9cde-4e301174d072 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:17.362242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6681b09-fda0-4482-9cde-4e301174d072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:17.363899 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6681b09-fda0-4482-9cde-4e301174d072 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:17.373213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 382/779] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:11:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:17.374350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6681b09-fda0-4482-9cde-4e301174d072 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:17.401540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27abe81-23a4-413a-83e7-b8633853df20 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:17.440539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f514248-3c80-4643-879f-a2a1bdbc011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:17.441235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f514248-3c80-4643-879f-a2a1bdbc011c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:17.441513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f514248-3c80-4643-879f-a2a1bdbc011c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:17.441785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f514248-3c80-4643-879f-a2a1bdbc011c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:17.453311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f514248-3c80-4643-879f-a2a1bdbc011c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-6f514248-3c80-4643-879f-a2a1bdbc011c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:17.458518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:17.459439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:17.460285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:17.460285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:17.460285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:17.460285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:17.460285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:17.460285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:17.460285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:17.460285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:17.460285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:17.460285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:17.460285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:17.460285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:17.464460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 398/780] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:17.465345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f514248-3c80-4643-879f-a2a1bdbc011c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:17.485870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6681b09-fda0-4482-9cde-4e301174d072 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:17.522747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7a84e-c77a-4b5a-befe-b4b88d6886ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:17.523742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7a84e-c77a-4b5a-befe-b4b88d6886ef None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:17.524216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7a84e-c77a-4b5a-befe-b4b88d6886ef None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:17.524703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7a84e-c77a-4b5a-befe-b4b88d6886ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:17.533638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7a84e-c77a-4b5a-befe-b4b88d6886ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:17.535518 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7a84e-c77a-4b5a-befe-b4b88d6886ef None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b4c7a84e-c77a-4b5a-befe-b4b88d6886ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:17.547865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:17.548879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:17.549940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:17.549940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:17.549940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:17.549940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:17.549940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:17.549940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:17.549940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:17.549940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:17.549940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:17.549940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:17.557345 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 383/781] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 26 18:11:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:17.558554 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7a84e-c77a-4b5a-befe-b4b88d6886ef None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:17.575316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:17.585141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f514248-3c80-4643-879f-a2a1bdbc011c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:17.603980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:17.624121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c74e52-d933-42ba-9031-a9abc45afdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:17.625037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c74e52-d933-42ba-9031-a9abc45afdd9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:17.625461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c74e52-d933-42ba-9031-a9abc45afdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:17.625969 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c74e52-d933-42ba-9031-a9abc45afdd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:17.637150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c74e52-d933-42ba-9031-a9abc45afdd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:17.639017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c74e52-d933-42ba-9031-a9abc45afdd9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-41c74e52-d933-42ba-9031-a9abc45afdd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:17.655459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:17.656687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:17.657842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:17.657842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:17.657842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:17.664505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 399/782] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:17.665756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c74e52-d933-42ba-9031-a9abc45afdd9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:17.674364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7a84e-c77a-4b5a-befe-b4b88d6886ef None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:17.711360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464e0b-aea7-4902-8b78-fbad3d7ed73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:17.712168 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464e0b-aea7-4902-8b78-fbad3d7ed73a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:17.712542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464e0b-aea7-4902-8b78-fbad3d7ed73a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:17.713136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464e0b-aea7-4902-8b78-fbad3d7ed73a None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:17.713833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26464e0b-aea7-4902-8b78-fbad3d7ed73a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:17.714274 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26464e0b-aea7-4902-8b78-fbad3d7ed73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:17.715928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26464e0b-aea7-4902-8b78-fbad3d7ed73a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:17.730545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 384/783] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:11:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:17.730545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464e0b-aea7-4902-8b78-fbad3d7ed73a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:17.780883 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c74e52-d933-42ba-9031-a9abc45afdd9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:17.818547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169b284-76a2-45dd-aabd-b60684d22902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:17.819675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169b284-76a2-45dd-aabd-b60684d22902 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:17.820101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169b284-76a2-45dd-aabd-b60684d22902 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:17.820516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169b284-76a2-45dd-aabd-b60684d22902 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:17.822087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169b284-76a2-45dd-aabd-b60684d22902 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:17.822544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169b284-76a2-45dd-aabd-b60684d22902 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:17.824634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169b284-76a2-45dd-aabd-b60684d22902 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:17.829449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:17.833704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464e0b-aea7-4902-8b78-fbad3d7ed73a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:17.854197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 400/784] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 26 18:11:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:17.855382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169b284-76a2-45dd-aabd-b60684d22902 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:17.877501 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20efce3-de3b-476e-b1a8-98d37f9405d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:17.878068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20efce3-de3b-476e-b1a8-98d37f9405d6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:17.878350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20efce3-de3b-476e-b1a8-98d37f9405d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:17.878623 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20efce3-de3b-476e-b1a8-98d37f9405d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:17.879419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20efce3-de3b-476e-b1a8-98d37f9405d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:17.879605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20efce3-de3b-476e-b1a8-98d37f9405d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:17.880988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20efce3-de3b-476e-b1a8-98d37f9405d6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:17.885092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:17.899603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 385/785] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:17.899603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20efce3-de3b-476e-b1a8-98d37f9405d6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:17.989833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169b284-76a2-45dd-aabd-b60684d22902 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:18.012591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20efce3-de3b-476e-b1a8-98d37f9405d6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:18.028600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c4e6c-c240-4f74-ab55-a355f0a2321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:18.029272 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c4e6c-c240-4f74-ab55-a355f0a2321d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.029549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c4e6c-c240-4f74-ab55-a355f0a2321d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.029819 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c4e6c-c240-4f74-ab55-a355f0a2321d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.040378 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c4e6c-c240-4f74-ab55-a355f0a2321d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:18.041968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c4e6c-c240-4f74-ab55-a355f0a2321d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-df5c4e6c-c240-4f74-ab55-a355f0a2321d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:18.057276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:18.058269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:18.059164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:18.059164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:18.059164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:18.061733 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c86ce2-e8e2-409f-bc69-96683c83020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:18.063130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c86ce2-e8e2-409f-bc69-96683c83020e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.063641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c86ce2-e8e2-409f-bc69-96683c83020e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.064125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c86ce2-e8e2-409f-bc69-96683c83020e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.064888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 401/786] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:18.065808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c4e6c-c240-4f74-ab55-a355f0a2321d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:18.078066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c86ce2-e8e2-409f-bc69-96683c83020e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:18.080697 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c86ce2-e8e2-409f-bc69-96683c83020e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b5c86ce2-e8e2-409f-bc69-96683c83020e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:18.101992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:18.102992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:18.103913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:18.103913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:18.103913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:18.107101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 386/787] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:18.108123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c86ce2-e8e2-409f-bc69-96683c83020e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:18.127611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:18.133027 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:18.193425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c4e6c-c240-4f74-ab55-a355f0a2321d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:18.230541 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10521e88-f8cc-40a2-a0ea-b2836b467749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:18.231235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10521e88-f8cc-40a2-a0ea-b2836b467749 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.231551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10521e88-f8cc-40a2-a0ea-b2836b467749 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.231866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10521e88-f8cc-40a2-a0ea-b2836b467749 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.240625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10521e88-f8cc-40a2-a0ea-b2836b467749 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:18.242220 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10521e88-f8cc-40a2-a0ea-b2836b467749 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:18.255269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c86ce2-e8e2-409f-bc69-96683c83020e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-10521e88-f8cc-40a2-a0ea-b2836b467749 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:18.258744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:18.259674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:18.261218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:18.261218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:18.261218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:18.261218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:18.261218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:18.261218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:18.261218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:18.261218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:18.261218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 18:11:18.261218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:18.261218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 402/788] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 26 18:11:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:18.261218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10521e88-f8cc-40a2-a0ea-b2836b467749 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:18.295306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07af8f4-4f14-4676-8a0e-af1bdd498a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:18.296480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07af8f4-4f14-4676-8a0e-af1bdd498a32 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.297094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07af8f4-4f14-4676-8a0e-af1bdd498a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.297521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07af8f4-4f14-4676-8a0e-af1bdd498a32 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.298177 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07af8f4-4f14-4676-8a0e-af1bdd498a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:18.298532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07af8f4-4f14-4676-8a0e-af1bdd498a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:18.299976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07af8f4-4f14-4676-8a0e-af1bdd498a32 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:18.317972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 387/789] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:18.317972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2140ba-caaa-4513-b243-a2b0b74eedd4 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.317972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2140ba-caaa-4513-b243-a2b0b74eedd4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.317972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2140ba-caaa-4513-b243-a2b0b74eedd4 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.317972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 388/790] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:18.317972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2140ba-caaa-4513-b243-a2b0b74eedd4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:18.370752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10521e88-f8cc-40a2-a0ea-b2836b467749 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:18.385762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:18.399918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:18.410968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afaa13-2813-4700-a517-bcfaf48a4b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:18.411583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afaa13-2813-4700-a517-bcfaf48a4b3c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.411872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afaa13-2813-4700-a517-bcfaf48a4b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.412121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afaa13-2813-4700-a517-bcfaf48a4b3c None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.412781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afaa13-2813-4700-a517-bcfaf48a4b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:18.413077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afaa13-2813-4700-a517-bcfaf48a4b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:18.414457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afaa13-2813-4700-a517-bcfaf48a4b3c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:18.430432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 403/791] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:18.430432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afaa13-2813-4700-a517-bcfaf48a4b3c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:18.433143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2140ba-caaa-4513-b243-a2b0b74eedd4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:18.470368 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ef1f0-2418-4c75-924c-a8c27be32e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:18.470972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ef1f0-2418-4c75-924c-a8c27be32e4b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.471244 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ef1f0-2418-4c75-924c-a8c27be32e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.471619 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ef1f0-2418-4c75-924c-a8c27be32e4b None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.472371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ef1f0-2418-4c75-924c-a8c27be32e4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:18.472678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ef1f0-2418-4c75-924c-a8c27be32e4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:18.474291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ef1f0-2418-4c75-924c-a8c27be32e4b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:18.493204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 389/792] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Aug 26 18:11:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:18.494422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084c1f-8e51-4397-b4f6-f6d5283c373d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.494711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084c1f-8e51-4397-b4f6-f6d5283c373d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.494983 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084c1f-8e51-4397-b4f6-f6d5283c373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.512573 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-17084c1f-8e51-4397-b4f6-f6d5283c373d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:18.513856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-17084c1f-8e51-4397-b4f6-f6d5283c373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:18.531426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afaa13-2813-4700-a517-bcfaf48a4b3c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:18.565910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90089bf4-ea38-453f-a9e8-f5369989c746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:18.566564 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90089bf4-ea38-453f-a9e8-f5369989c746 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.566874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90089bf4-ea38-453f-a9e8-f5369989c746 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.567253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90089bf4-ea38-453f-a9e8-f5369989c746 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.574223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90089bf4-ea38-453f-a9e8-f5369989c746 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:18.575924 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90089bf4-ea38-453f-a9e8-f5369989c746 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:18.580299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 390/793] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:18.581160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17084c1f-8e51-4397-b4f6-f6d5283c373d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-90089bf4-ea38-453f-a9e8-f5369989c746 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:18.587248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:18.588179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:18.589149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:18.589149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:18.589149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:18.589149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:18.589149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:18.589149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:18.589149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:18.589149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:18.589149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 18:11:18.589149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:18.589149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 404/794] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:18.589755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1e60-f0e7-4665-8d3c-9928760d511a None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.589755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1e60-f0e7-4665-8d3c-9928760d511a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.591091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1e60-f0e7-4665-8d3c-9928760d511a None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.592553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 405/795] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:18.593276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb1e60-f0e7-4665-8d3c-9928760d511a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:18.630263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:18.650247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:18.696271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17084c1f-8e51-4397-b4f6-f6d5283c373d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:18.701672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb1e60-f0e7-4665-8d3c-9928760d511a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:18.733534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73933483-c281-48ed-bedd-b91bb8c79413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:18.734167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73933483-c281-48ed-bedd-b91bb8c79413 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.734447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73933483-c281-48ed-bedd-b91bb8c79413 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.734717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73933483-c281-48ed-bedd-b91bb8c79413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.736378 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96204abc-483b-4043-bf48-d80260578b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:18.737117 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204abc-483b-4043-bf48-d80260578b53 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.737397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204abc-483b-4043-bf48-d80260578b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.737674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204abc-483b-4043-bf48-d80260578b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.742080 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73933483-c281-48ed-bedd-b91bb8c79413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:18.743708 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73933483-c281-48ed-bedd-b91bb8c79413 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:18.747690 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96204abc-483b-4043-bf48-d80260578b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:18.749168 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96204abc-483b-4043-bf48-d80260578b53 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-73933483-c281-48ed-bedd-b91bb8c79413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:18.757035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:18.757941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:18.759062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:18.759062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:18.759062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:18.759062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:18.759062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:18.759062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:18.759062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:18.759062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:18.761076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 391/796] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:18.762049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73933483-c281-48ed-bedd-b91bb8c79413 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-96204abc-483b-4043-bf48-d80260578b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:18.763714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:18.764605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:18.765604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:18.765604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:18.765604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:18.769627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 406/797] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:18.770767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b897-b559-44ca-9119-f38634c60d70 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.771044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b897-b559-44ca-9119-f38634c60d70 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.771313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b897-b559-44ca-9119-f38634c60d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.790134 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fdb9b897-b559-44ca-9119-f38634c60d70 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:18.791813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fdb9b897-b559-44ca-9119-f38634c60d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:18.860162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 407/798] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:18.861050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9b897-b559-44ca-9119-f38634c60d70 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:18.870933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73933483-c281-48ed-bedd-b91bb8c79413 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:18.878981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:18.891866 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:18.905747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81662b9-a0bc-48d2-b38d-fa48781d4620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:18.906299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81662b9-a0bc-48d2-b38d-fa48781d4620 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:18.906581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81662b9-a0bc-48d2-b38d-fa48781d4620 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:18.906855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81662b9-a0bc-48d2-b38d-fa48781d4620 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:18.907594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81662b9-a0bc-48d2-b38d-fa48781d4620 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:18.907905 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81662b9-a0bc-48d2-b38d-fa48781d4620 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:18.909385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81662b9-a0bc-48d2-b38d-fa48781d4620 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:18.927577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 392/799] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Aug 26 18:11:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:18.928410 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81662b9-a0bc-48d2-b38d-fa48781d4620 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:18.975651 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9b897-b559-44ca-9119-f38634c60d70 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.011065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28703a5b-d82b-4f48-81ee-2ad4f5a005ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.011804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28703a5b-d82b-4f48-81ee-2ad4f5a005ca None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.011986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28703a5b-d82b-4f48-81ee-2ad4f5a005ca None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.012224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28703a5b-d82b-4f48-81ee-2ad4f5a005ca None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:19.012975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28703a5b-d82b-4f48-81ee-2ad4f5a005ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:19.013282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28703a5b-d82b-4f48-81ee-2ad4f5a005ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:19.014731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28703a5b-d82b-4f48-81ee-2ad4f5a005ca None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:19.026838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 408/800] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:19.027429 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28703a5b-d82b-4f48-81ee-2ad4f5a005ca None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:19.038715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81662b9-a0bc-48d2-b38d-fa48781d4620 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.073293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6c1ce-bf71-4aef-9d97-2f7a3a671b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.073905 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6c1ce-bf71-4aef-9d97-2f7a3a671b9d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.074180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6c1ce-bf71-4aef-9d97-2f7a3a671b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.074449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6c1ce-bf71-4aef-9d97-2f7a3a671b9d None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:19.075093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6c1ce-bf71-4aef-9d97-2f7a3a671b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:19.075388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6c1ce-bf71-4aef-9d97-2f7a3a671b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:19.076793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6c1ce-bf71-4aef-9d97-2f7a3a671b9d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:19.093050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 393/801] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:19.093050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6c1ce-bf71-4aef-9d97-2f7a3a671b9d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:19.113722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:19.135096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:19.137388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28703a5b-d82b-4f48-81ee-2ad4f5a005ca None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.171931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ff9bf-c56b-4ca1-8299-fb4583cbf2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.172593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ff9bf-c56b-4ca1-8299-fb4583cbf2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.172905 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ff9bf-c56b-4ca1-8299-fb4583cbf2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.173176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ff9bf-c56b-4ca1-8299-fb4583cbf2e0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:19.173759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ff9bf-c56b-4ca1-8299-fb4583cbf2e0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:19.175139 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ff9bf-c56b-4ca1-8299-fb4583cbf2e0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-768ff9bf-c56b-4ca1-8299-fb4583cbf2e0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:19.184241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:19.185495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:19.186672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 409/802] 10.222.0.45 () {56 vars in 1129 bytes} [Fri Aug 26 18:11:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:19.187476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ff9bf-c56b-4ca1-8299-fb4583cbf2e0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:19.197670 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6c1ce-bf71-4aef-9d97-2f7a3a671b9d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.232188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb0371-6ea6-408c-aad3-84645966f117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.232848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb0371-6ea6-408c-aad3-84645966f117 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.233111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb0371-6ea6-408c-aad3-84645966f117 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.233382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb0371-6ea6-408c-aad3-84645966f117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:19.246263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb0371-6ea6-408c-aad3-84645966f117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:19.248085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb0371-6ea6-408c-aad3-84645966f117 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-6dcb0371-6ea6-408c-aad3-84645966f117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:19.267021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:19.268171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:19.274076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:19.274076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:19.274076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:19.274076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 394/803] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:19.274076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb0371-6ea6-408c-aad3-84645966f117 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:19.297735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ff9bf-c56b-4ca1-8299-fb4583cbf2e0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.331560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10946d7-01c2-4beb-87a6-71103baf7e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.332227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10946d7-01c2-4beb-87a6-71103baf7e85 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.332507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10946d7-01c2-4beb-87a6-71103baf7e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.332810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10946d7-01c2-4beb-87a6-71103baf7e85 None admin] PATH_INFO: `/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/3791df34c6e442aaabd90d7f5c2f3a1a/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:19.334727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10946d7-01c2-4beb-87a6-71103baf7e85 None admin] RBAC: Authorizing `identity:create_grant(project_id=2803c5ec5ecf4223836ddf75397cc095, user_id=3791df34c6e442aaabd90d7f5c2f3a1a, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:19.336178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10946d7-01c2-4beb-87a6-71103baf7e85 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:19.345247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:19.360750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 410/804] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:11:19 2022] PUT /identity/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/3791df34c6e442aaabd90d7f5c2f3a1a/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:11:19.360750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10946d7-01c2-4beb-87a6-71103baf7e85 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:19.381411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:19.394795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb0371-6ea6-408c-aad3-84645966f117 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.434229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e73d70-6aba-4061-9390-3eb91ce7e6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.435082 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e73d70-6aba-4061-9390-3eb91ce7e6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.435387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e73d70-6aba-4061-9390-3eb91ce7e6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.435837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e73d70-6aba-4061-9390-3eb91ce7e6e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:19.445458 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e73d70-6aba-4061-9390-3eb91ce7e6e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:19.446955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e73d70-6aba-4061-9390-3eb91ce7e6e4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a6e73d70-6aba-4061-9390-3eb91ce7e6e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:19.459667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:19.460850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:19.461767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:19.461767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:19.461767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:19.461767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:19.461767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:19.461767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:19.461767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:19.461767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:19.461767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 395/805] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:19.461767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e73d70-6aba-4061-9390-3eb91ce7e6e4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:19.473984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10946d7-01c2-4beb-87a6-71103baf7e85 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.516078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4f4f6-07c6-4390-af9d-6ae32706768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.516750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4f4f6-07c6-4390-af9d-6ae32706768c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.517040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4f4f6-07c6-4390-af9d-6ae32706768c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.517310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4f4f6-07c6-4390-af9d-6ae32706768c None admin] PATH_INFO: `/v3/services/network` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:19.517895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4f4f6-07c6-4390-af9d-6ae32706768c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:19.519853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4f4f6-07c6-4390-af9d-6ae32706768c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-94c4f4f6-07c6-4390-af9d-6ae32706768c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:19.530405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:19.531442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:19.532310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 411/806] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:19 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:19.533185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4f4f6-07c6-4390-af9d-6ae32706768c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:19.587543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e73d70-6aba-4061-9390-3eb91ce7e6e4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.596584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:19.623983 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92650047-2557-4482-90f6-6855b035ea86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.624596 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650047-2557-4482-90f6-6855b035ea86 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.624901 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650047-2557-4482-90f6-6855b035ea86 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.625172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650047-2557-4482-90f6-6855b035ea86 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:19.625910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92650047-2557-4482-90f6-6855b035ea86 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:19.626213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92650047-2557-4482-90f6-6855b035ea86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:19.627680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92650047-2557-4482-90f6-6855b035ea86 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:19.635004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4f4f6-07c6-4390-af9d-6ae32706768c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.639583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 396/807] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Aug 26 18:11:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:19.640890 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92650047-2557-4482-90f6-6855b035ea86 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:19.664998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:19.670419 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3130eaf-cceb-41d0-ad57-bfb173ad3b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.671038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3130eaf-cceb-41d0-ad57-bfb173ad3b94 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.671318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3130eaf-cceb-41d0-ad57-bfb173ad3b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.671591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3130eaf-cceb-41d0-ad57-bfb173ad3b94 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:19.672238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3130eaf-cceb-41d0-ad57-bfb173ad3b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:19.672560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3130eaf-cceb-41d0-ad57-bfb173ad3b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:19.673987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3130eaf-cceb-41d0-ad57-bfb173ad3b94 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:19.692171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 412/808] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:19.692171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3130eaf-cceb-41d0-ad57-bfb173ad3b94 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:19.760471 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92650047-2557-4482-90f6-6855b035ea86 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.796703 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3130eaf-cceb-41d0-ad57-bfb173ad3b94 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.798535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61370985-5764-433d-a3b9-f7465b5d8147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.799160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61370985-5764-433d-a3b9-f7465b5d8147 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.799433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61370985-5764-433d-a3b9-f7465b5d8147 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.799701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61370985-5764-433d-a3b9-f7465b5d8147 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:19.800410 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61370985-5764-433d-a3b9-f7465b5d8147 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:19.800733 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61370985-5764-433d-a3b9-f7465b5d8147 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:19.802166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61370985-5764-433d-a3b9-f7465b5d8147 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:19.819793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 397/809] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:19.819793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61370985-5764-433d-a3b9-f7465b5d8147 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:19.821679 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:19.832954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7cf1b-95e5-4935-b1df-e87220de9a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.833560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7cf1b-95e5-4935-b1df-e87220de9a13 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.833851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7cf1b-95e5-4935-b1df-e87220de9a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.834103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7cf1b-95e5-4935-b1df-e87220de9a13 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:19.834836 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7cf1b-95e5-4935-b1df-e87220de9a13 None admin] RBAC: Adding query filter params (name=network) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:19.835021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7cf1b-95e5-4935-b1df-e87220de9a13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:19.836403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7cf1b-95e5-4935-b1df-e87220de9a13 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:19.846055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 413/810] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:19.846055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7cf1b-95e5-4935-b1df-e87220de9a13 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:19.896911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:19.922931 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61370985-5764-433d-a3b9-f7465b5d8147 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.952193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7cf1b-95e5-4935-b1df-e87220de9a13 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:19.957407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b1763-e1e0-4ea8-9735-d770b940c1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.958026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b1763-e1e0-4ea8-9735-d770b940c1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.958304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b1763-e1e0-4ea8-9735-d770b940c1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.958574 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b1763-e1e0-4ea8-9735-d770b940c1a5 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:19.959214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b1763-e1e0-4ea8-9735-d770b940c1a5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:19.959511 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b1763-e1e0-4ea8-9735-d770b940c1a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:19.960908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b1763-e1e0-4ea8-9735-d770b940c1a5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:19.965971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 398/811] 10.222.0.45 () {56 vars in 1124 bytes} [Fri Aug 26 18:11:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:19.967031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b1763-e1e0-4ea8-9735-d770b940c1a5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:19.993127 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62946342-b040-4fdf-8620-e0dc55181b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:19.993911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946342-b040-4fdf-8620-e0dc55181b6c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:19.994474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946342-b040-4fdf-8620-e0dc55181b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:19.994625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946342-b040-4fdf-8620-e0dc55181b6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:20.002558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62946342-b040-4fdf-8620-e0dc55181b6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:20.004041 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62946342-b040-4fdf-8620-e0dc55181b6c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-62946342-b040-4fdf-8620-e0dc55181b6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:20.016659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:20.017623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:20.018514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:20.018514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:20.018514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:20.018514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:20.018514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:20.018514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:20.018514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:20.018514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:20.018514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 414/812] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:20.018514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62946342-b040-4fdf-8620-e0dc55181b6c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:20.071465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:20.092391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b1763-e1e0-4ea8-9735-d770b940c1a5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:20.129291 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62946342-b040-4fdf-8620-e0dc55181b6c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:20.133875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9bf14-3148-4c8d-9327-875bd895183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:20.134538 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9bf14-3148-4c8d-9327-875bd895183d None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:20.134818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9bf14-3148-4c8d-9327-875bd895183d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:20.135086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9bf14-3148-4c8d-9327-875bd895183d None admin] PATH_INFO: `/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/7626e0cf57a74281b3cf5f3b31b5b79a/roles/5a08ee803b2e44e280fc0c2c4941df8b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:20.144986 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:20.153040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9bf14-3148-4c8d-9327-875bd895183d None admin] RBAC: Authorizing `identity:create_grant(project_id=2803c5ec5ecf4223836ddf75397cc095, user_id=7626e0cf57a74281b3cf5f3b31b5b79a, role_id=5a08ee803b2e44e280fc0c2c4941df8b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:20.154582 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9bf14-3148-4c8d-9327-875bd895183d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:20.165226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb00a6f-46dc-49e5-9c33-f921ecb7325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:20.165926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb00a6f-46dc-49e5-9c33-f921ecb7325a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:20.166112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb00a6f-46dc-49e5-9c33-f921ecb7325a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:20.166370 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb00a6f-46dc-49e5-9c33-f921ecb7325a None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:20.166991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb00a6f-46dc-49e5-9c33-f921ecb7325a None admin] RBAC: Adding query filter params (type=network) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:20.167293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb00a6f-46dc-49e5-9c33-f921ecb7325a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:20.177142 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 399/813] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:11:19 2022] PUT /identity/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/7626e0cf57a74281b3cf5f3b31b5b79a/roles/5a08ee803b2e44e280fc0c2c4941df8b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:11:20.177358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb00a6f-46dc-49e5-9c33-f921ecb7325a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:20.177454 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9bf14-3148-4c8d-9327-875bd895183d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:20.182743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 415/814] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:20.183847 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb00a6f-46dc-49e5-9c33-f921ecb7325a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:20.318208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9bf14-3148-4c8d-9327-875bd895183d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:20.318500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb00a6f-46dc-49e5-9c33-f921ecb7325a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:20.335403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:20.364686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc228c-b865-4e02-9004-99d887aed101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:20.365389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc228c-b865-4e02-9004-99d887aed101 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:20.365723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc228c-b865-4e02-9004-99d887aed101 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:20.365936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc228c-b865-4e02-9004-99d887aed101 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:20.366615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc228c-b865-4e02-9004-99d887aed101 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:20.368072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc228c-b865-4e02-9004-99d887aed101 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:20.368518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142898f2-0f97-410b-80f5-90e20e28998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:20.370066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142898f2-0f97-410b-80f5-90e20e28998d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:20.370066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142898f2-0f97-410b-80f5-90e20e28998d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:20.370066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142898f2-0f97-410b-80f5-90e20e28998d None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:20.370381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142898f2-0f97-410b-80f5-90e20e28998d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:20.370660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142898f2-0f97-410b-80f5-90e20e28998d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:20.372132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142898f2-0f97-410b-80f5-90e20e28998d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:20.397498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 416/815] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:20.398032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 400/816] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:11:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:11:20.398280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142898f2-0f97-410b-80f5-90e20e28998d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:20.406043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc228c-b865-4e02-9004-99d887aed101 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:20.472305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:20.535898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142898f2-0f97-410b-80f5-90e20e28998d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:20.559657 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc228c-b865-4e02-9004-99d887aed101 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:20.608472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cec08-cf56-4c6f-a077-bfaf25fc6b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:20.609039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cec08-cf56-4c6f-a077-bfaf25fc6b8d None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:20.609319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cec08-cf56-4c6f-a077-bfaf25fc6b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:20.609589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cec08-cf56-4c6f-a077-bfaf25fc6b8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:20.610276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cec08-cf56-4c6f-a077-bfaf25fc6b8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:20.611674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cec08-cf56-4c6f-a077-bfaf25fc6b8d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:20.631108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7a209-bee7-42af-b7a6-c63da9342bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:20.631817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7a209-bee7-42af-b7a6-c63da9342bbb None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:20.632131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7a209-bee7-42af-b7a6-c63da9342bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:20.632374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7a209-bee7-42af-b7a6-c63da9342bbb None admin] PATH_INFO: `/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/98c92b2c982a4780884365a7a7ec6514/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:20.635952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7a209-bee7-42af-b7a6-c63da9342bbb None admin] RBAC: Authorizing `identity:create_grant(project_id=2803c5ec5ecf4223836ddf75397cc095, user_id=98c92b2c982a4780884365a7a7ec6514, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:20.637531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7a209-bee7-42af-b7a6-c63da9342bbb None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:20.644413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 417/817] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:11:20 2022] POST /identity/v3/endpoints => generated 337 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:11:20.663416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 401/818] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:11:20 2022] PUT /identity/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/98c92b2c982a4780884365a7a7ec6514/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:11:21.370139 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa1ebb-0b8a-4c2b-8204-96736e3e2ed8 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:21.371204 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa1ebb-0b8a-4c2b-8204-96736e3e2ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:21.371692 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa1ebb-0b8a-4c2b-8204-96736e3e2ed8 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:21.373691 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 418/819] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:21.379217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13907ef-35fe-4e7f-9096-bbddf8839119 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:21.380008 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13907ef-35fe-4e7f-9096-bbddf8839119 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:21.380501 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13907ef-35fe-4e7f-9096-bbddf8839119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:21.399158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a13907ef-35fe-4e7f-9096-bbddf8839119 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:21.400354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a13907ef-35fe-4e7f-9096-bbddf8839119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:21.472422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 402/820] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:21.737719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa1ebb-0b8a-4c2b-8204-96736e3e2ed8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:21.768367 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:21.849125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa1ebb-0b8a-4c2b-8204-96736e3e2ed8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:21.884499 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a509-a057-4134-8df8-80038b121463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:21.885169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a509-a057-4134-8df8-80038b121463 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:21.885453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a509-a057-4134-8df8-80038b121463 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:21.885728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a509-a057-4134-8df8-80038b121463 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:21.896514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631a509-a057-4134-8df8-80038b121463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-6631a509-a057-4134-8df8-80038b121463 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:21.901536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:21.902464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:21.903299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 419/821] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:21.908917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13907ef-35fe-4e7f-9096-bbddf8839119 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:21.936627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:22.012091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13907ef-35fe-4e7f-9096-bbddf8839119 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:22.048100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08236f79-1b40-48fe-af8a-b515231ac87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:22.049160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08236f79-1b40-48fe-af8a-b515231ac87a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.049676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08236f79-1b40-48fe-af8a-b515231ac87a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.050148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08236f79-1b40-48fe-af8a-b515231ac87a None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.051085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08236f79-1b40-48fe-af8a-b515231ac87a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:22.051587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08236f79-1b40-48fe-af8a-b515231ac87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:22.053203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08236f79-1b40-48fe-af8a-b515231ac87a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:22.062971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 403/822] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:11:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:22.069819 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a509-a057-4134-8df8-80038b121463 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:22.159750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:22.172254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a509-a057-4134-8df8-80038b121463 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:22.207684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656018a-f796-478b-add8-f82741a517bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:22.208331 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656018a-f796-478b-add8-f82741a517bf None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.208615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656018a-f796-478b-add8-f82741a517bf None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.208916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656018a-f796-478b-add8-f82741a517bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.219622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656018a-f796-478b-add8-f82741a517bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:22.221139 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656018a-f796-478b-add8-f82741a517bf None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:22.222951 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc34fd-d10b-4dfa-8aee-a71ce9257359 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.223241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc34fd-d10b-4dfa-8aee-a71ce9257359 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.223517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc34fd-d10b-4dfa-8aee-a71ce9257359 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.225031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 404/823] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:11:22.234144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564308-f99c-4430-85f7-afe74faa35d4 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.234726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564308-f99c-4430-85f7-afe74faa35d4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.235205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564308-f99c-4430-85f7-afe74faa35d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-a656018a-f796-478b-add8-f82741a517bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:22.237212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:22.238132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:22.239016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:22.239016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:22.239016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:22.239016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 420/824] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:22.244215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656018a-f796-478b-add8-f82741a517bf None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:22.266646 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9a564308-f99c-4430-85f7-afe74faa35d4 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:22.269367 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9a564308-f99c-4430-85f7-afe74faa35d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:22.356870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 405/825] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:22.357234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656018a-f796-478b-add8-f82741a517bf None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:22.392967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd13d9f-3b08-4e42-97c3-3272236f45c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:22.394004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd13d9f-3b08-4e42-97c3-3272236f45c8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.394004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd13d9f-3b08-4e42-97c3-3272236f45c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.394248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd13d9f-3b08-4e42-97c3-3272236f45c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.394818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd13d9f-3b08-4e42-97c3-3272236f45c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:22.395125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd13d9f-3b08-4e42-97c3-3272236f45c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:22.396546 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd13d9f-3b08-4e42-97c3-3272236f45c8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:22.406603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:22.410247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 421/826] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:22.415770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564308-f99c-4430-85f7-afe74faa35d4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:22.434841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:22.518792 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564308-f99c-4430-85f7-afe74faa35d4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:22.557921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ec800-c511-4361-8335-d36d85ae3673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:22.558564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ec800-c511-4361-8335-d36d85ae3673 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.558900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ec800-c511-4361-8335-d36d85ae3673 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.559247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ec800-c511-4361-8335-d36d85ae3673 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.566653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ec800-c511-4361-8335-d36d85ae3673 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:22.568170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ec800-c511-4361-8335-d36d85ae3673 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-402ec800-c511-4361-8335-d36d85ae3673 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:22.579995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:22.581000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:22.582171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:22.582171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:22.582171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:22.582171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:22.582171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:22.582171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:22.582171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:22.582171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:22.582171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:22.582171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:22.582171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 406/827] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 26 18:11:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:22.587068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd13d9f-3b08-4e42-97c3-3272236f45c8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:22.628376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38455c35-b22d-4f3f-9ef7-d5447dc21233 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.628654 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38455c35-b22d-4f3f-9ef7-d5447dc21233 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.628954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38455c35-b22d-4f3f-9ef7-d5447dc21233 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.630323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 407/828] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:11:22.635779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36ba3b-768f-4441-ba5d-18ddc5dd5079 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.636058 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36ba3b-768f-4441-ba5d-18ddc5dd5079 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.636393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36ba3b-768f-4441-ba5d-18ddc5dd5079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.660044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ab36ba3b-768f-4441-ba5d-18ddc5dd5079 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:22.661302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ab36ba3b-768f-4441-ba5d-18ddc5dd5079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:22.700355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd13d9f-3b08-4e42-97c3-3272236f45c8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:22.730054 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 408/829] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:11:22.730901 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36ba3b-768f-4441-ba5d-18ddc5dd5079 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:22.737499 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6dfc2-86fa-4722-a165-0e90e9a13084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:22.738190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6dfc2-86fa-4722-a165-0e90e9a13084 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.738469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6dfc2-86fa-4722-a165-0e90e9a13084 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.738735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6dfc2-86fa-4722-a165-0e90e9a13084 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.739459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6dfc2-86fa-4722-a165-0e90e9a13084 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:22.739760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6dfc2-86fa-4722-a165-0e90e9a13084 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:22.741220 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6dfc2-86fa-4722-a165-0e90e9a13084 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:22.744509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:22.760871 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 422/830] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 26 18:11:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:22.761729 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6d755-2dc2-4a78-a022-0c5448f414b2 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.762013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6d755-2dc2-4a78-a022-0c5448f414b2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.762282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6d755-2dc2-4a78-a022-0c5448f414b2 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.763890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 423/831] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:22.769906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6d755-2dc2-4a78-a022-0c5448f414b2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:22.838798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:22.843833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36ba3b-768f-4441-ba5d-18ddc5dd5079 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:22.880078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085553f5-4ee0-4d7c-ac98-d746862648c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:22.880972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085553f5-4ee0-4d7c-ac98-d746862648c9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.881446 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085553f5-4ee0-4d7c-ac98-d746862648c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.881714 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085553f5-4ee0-4d7c-ac98-d746862648c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.884807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6d755-2dc2-4a78-a022-0c5448f414b2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:22.893885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085553f5-4ee0-4d7c-ac98-d746862648c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-085553f5-4ee0-4d7c-ac98-d746862648c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:22.899532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:22.900498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:22.901364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 409/832] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:11:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:22.902071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df90ec-03da-4214-aec7-d9cc2b729581 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.902071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df90ec-03da-4214-aec7-d9cc2b729581 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.902816 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df90ec-03da-4214-aec7-d9cc2b729581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.919977 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-06df90ec-03da-4214-aec7-d9cc2b729581 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:22.921274 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-06df90ec-03da-4214-aec7-d9cc2b729581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:22.926103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb40a51-131b-497a-92f0-c8864048a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:22.927014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb40a51-131b-497a-92f0-c8864048a9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:22.927536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb40a51-131b-497a-92f0-c8864048a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:22.928085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb40a51-131b-497a-92f0-c8864048a9f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:22.991968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:22.998262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 410/833] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:22.999079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df90ec-03da-4214-aec7-d9cc2b729581 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.002108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb40a51-131b-497a-92f0-c8864048a9f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:23.003589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb40a51-131b-497a-92f0-c8864048a9f6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:23.063385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:23.105022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df90ec-03da-4214-aec7-d9cc2b729581 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:23.108530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 424/834] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:11:23.113722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb40a51-131b-497a-92f0-c8864048a9f6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.143391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ef6fe-1673-43df-8660-6cc900420ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:23.144017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ef6fe-1673-43df-8660-6cc900420ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:23.144272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ef6fe-1673-43df-8660-6cc900420ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:23.144774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ef6fe-1673-43df-8660-6cc900420ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:23.145226 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ef6fe-1673-43df-8660-6cc900420ff1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:23.145523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ef6fe-1673-43df-8660-6cc900420ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:23.146888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ef6fe-1673-43df-8660-6cc900420ff1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:23.160198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 411/835] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:11:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:23.160198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ef6fe-1673-43df-8660-6cc900420ff1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.221115 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:23.221302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb40a51-131b-497a-92f0-c8864048a9f6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:23.258780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a34f42-6062-4fe2-ac4c-2749891f750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:23.259471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a34f42-6062-4fe2-ac4c-2749891f750f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:23.259758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a34f42-6062-4fe2-ac4c-2749891f750f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:23.260035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a34f42-6062-4fe2-ac4c-2749891f750f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:23.260743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a34f42-6062-4fe2-ac4c-2749891f750f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:23.262140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a34f42-6062-4fe2-ac4c-2749891f750f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:23.267754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ef6fe-1673-43df-8660-6cc900420ff1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e9a34f42-6062-4fe2-ac4c-2749891f750f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:23.271769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:23.272772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:23.273660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 425/836] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:11:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:23.274460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a34f42-6062-4fe2-ac4c-2749891f750f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.299757 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:23.301946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7c79-41d2-41f0-9c88-5aae5b3eb8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:23.302635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7c79-41d2-41f0-9c88-5aae5b3eb8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:23.302913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7c79-41d2-41f0-9c88-5aae5b3eb8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:23.303182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7c79-41d2-41f0-9c88-5aae5b3eb8b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:23.313982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e7c79-41d2-41f0-9c88-5aae5b3eb8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:23.315355 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e7c79-41d2-41f0-9c88-5aae5b3eb8b9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-d55e7c79-41d2-41f0-9c88-5aae5b3eb8b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:23.329121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:23.330121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:23.331434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:23.331434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:23.331434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:23.331434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 412/837] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:23.331434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7c79-41d2-41f0-9c88-5aae5b3eb8b9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.380762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a34f42-6062-4fe2-ac4c-2749891f750f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:23.413714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015f721-f0ae-44fb-a476-54643563ddf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:23.414337 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015f721-f0ae-44fb-a476-54643563ddf5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:23.414643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015f721-f0ae-44fb-a476-54643563ddf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:23.414913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015f721-f0ae-44fb-a476-54643563ddf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:23.425270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015f721-f0ae-44fb-a476-54643563ddf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:23.426763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015f721-f0ae-44fb-a476-54643563ddf5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:23.429718 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7c79-41d2-41f0-9c88-5aae5b3eb8b9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-9015f721-f0ae-44fb-a476-54643563ddf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:23.440467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:23.441497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:23.447463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:23.447463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:23.447463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:23.447463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 426/838] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:23.447463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015f721-f0ae-44fb-a476-54643563ddf5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.449799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:23.463459 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311f12d-91fd-4bc4-9323-de927aa898fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:23.464091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311f12d-91fd-4bc4-9323-de927aa898fd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:23.464367 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311f12d-91fd-4bc4-9323-de927aa898fd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:23.464633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311f12d-91fd-4bc4-9323-de927aa898fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:23.474867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311f12d-91fd-4bc4-9323-de927aa898fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-9311f12d-91fd-4bc4-9323-de927aa898fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:23.480347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:23.481365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 413/839] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:23.482242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311f12d-91fd-4bc4-9323-de927aa898fd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.523935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:23.549775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015f721-f0ae-44fb-a476-54643563ddf5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:23.582627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1140f21-50f7-4249-ad0c-76d489fe77ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:23.583158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1140f21-50f7-4249-ad0c-76d489fe77ca None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:23.583418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1140f21-50f7-4249-ad0c-76d489fe77ca None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:23.583741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1140f21-50f7-4249-ad0c-76d489fe77ca None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:23.584308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1140f21-50f7-4249-ad0c-76d489fe77ca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:23.584777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1140f21-50f7-4249-ad0c-76d489fe77ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:23.586013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1140f21-50f7-4249-ad0c-76d489fe77ca None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:23.587311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311f12d-91fd-4bc4-9323-de927aa898fd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:23.590305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 427/840] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:11:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:23.591066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1140f21-50f7-4249-ad0c-76d489fe77ca None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.622482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfcfbb-83c4-48bf-a6c7-21b83511d979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:23.623099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfcfbb-83c4-48bf-a6c7-21b83511d979 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:23.623378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfcfbb-83c4-48bf-a6c7-21b83511d979 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:23.623648 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfcfbb-83c4-48bf-a6c7-21b83511d979 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:23.624291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfcfbb-83c4-48bf-a6c7-21b83511d979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:23.624592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfcfbb-83c4-48bf-a6c7-21b83511d979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:23.626002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfcfbb-83c4-48bf-a6c7-21b83511d979 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:23.637595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 414/841] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:23.638418 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfcfbb-83c4-48bf-a6c7-21b83511d979 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.668092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:23.696363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1140f21-50f7-4249-ad0c-76d489fe77ca None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:23.732360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4f578-ce8b-400f-8d84-73605256a5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:23.733002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4f578-ce8b-400f-8d84-73605256a5cc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:23.733280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4f578-ce8b-400f-8d84-73605256a5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:23.733530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4f578-ce8b-400f-8d84-73605256a5cc None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:23.734172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4f578-ce8b-400f-8d84-73605256a5cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:23.734473 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4f578-ce8b-400f-8d84-73605256a5cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:23.735847 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4f578-ce8b-400f-8d84-73605256a5cc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:23.737173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfcfbb-83c4-48bf-a6c7-21b83511d979 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:23.742706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:23.748651 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 428/842] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:23.749575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4f578-ce8b-400f-8d84-73605256a5cc None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.771957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bfd70-009f-45b6-9e83-148bdc33d8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:23.772652 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bfd70-009f-45b6-9e83-148bdc33d8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:23.772957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bfd70-009f-45b6-9e83-148bdc33d8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:23.773224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bfd70-009f-45b6-9e83-148bdc33d8f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:23.773883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bfd70-009f-45b6-9e83-148bdc33d8f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:23.774181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bfd70-009f-45b6-9e83-148bdc33d8f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:23.775579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bfd70-009f-45b6-9e83-148bdc33d8f4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:23.783340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 415/843] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:23.784100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bfd70-009f-45b6-9e83-148bdc33d8f4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.849421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4f578-ce8b-400f-8d84-73605256a5cc None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:23.875806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:23.883091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bfd70-009f-45b6-9e83-148bdc33d8f4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:23.884538 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712f4a5-bfa9-4869-bcb8-2508c35d9922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:23.885179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712f4a5-bfa9-4869-bcb8-2508c35d9922 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:23.885458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712f4a5-bfa9-4869-bcb8-2508c35d9922 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:23.885744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712f4a5-bfa9-4869-bcb8-2508c35d9922 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:23.886349 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712f4a5-bfa9-4869-bcb8-2508c35d9922 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:23.886643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712f4a5-bfa9-4869-bcb8-2508c35d9922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:23.888043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712f4a5-bfa9-4869-bcb8-2508c35d9922 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:23.892584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 429/844] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:11:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:23.893385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712f4a5-bfa9-4869-bcb8-2508c35d9922 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.920251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0f418-0633-4971-9aab-a8c0aacd00bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:23.920954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0f418-0633-4971-9aab-a8c0aacd00bd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:23.921241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0f418-0633-4971-9aab-a8c0aacd00bd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:23.921614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0f418-0633-4971-9aab-a8c0aacd00bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:23.929178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0f418-0633-4971-9aab-a8c0aacd00bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:23.930656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0f418-0633-4971-9aab-a8c0aacd00bd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-2fa0f418-0633-4971-9aab-a8c0aacd00bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:23.942916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:23.944085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:23.950338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:23.950338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:23.950338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:23.950338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:23.950338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:23.950338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:23.950338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:23.950338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:23.950338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 416/845] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:23.950338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0f418-0633-4971-9aab-a8c0aacd00bd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:23.978149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:24.024119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712f4a5-bfa9-4869-bcb8-2508c35d9922 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:24.058514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0f418-0633-4971-9aab-a8c0aacd00bd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:24.062752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f4fb5-8665-4de1-a3fd-2fbe2bc6addf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:24.063588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f4fb5-8665-4de1-a3fd-2fbe2bc6addf None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:24.064003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f4fb5-8665-4de1-a3fd-2fbe2bc6addf None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:24.064428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f4fb5-8665-4de1-a3fd-2fbe2bc6addf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:24.072478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f4fb5-8665-4de1-a3fd-2fbe2bc6addf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:24.074128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f4fb5-8665-4de1-a3fd-2fbe2bc6addf None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c48f4fb5-8665-4de1-a3fd-2fbe2bc6addf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:24.085414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:24.086494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:24.087673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:24.087673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:24.087673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:24.087673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:24.087673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:24.087673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:24.087673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:24.087673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:24.087673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 18:11:24.087673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:24.089512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 430/846] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 26 18:11:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:24.090414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f4fb5-8665-4de1-a3fd-2fbe2bc6addf None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:24.098527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a6a45-c4d6-49ab-86c8-e42125b47361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:24.099174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a6a45-c4d6-49ab-86c8-e42125b47361 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:24.099509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a6a45-c4d6-49ab-86c8-e42125b47361 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:24.099728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a6a45-c4d6-49ab-86c8-e42125b47361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:24.111931 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a6a45-c4d6-49ab-86c8-e42125b47361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:24.113455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a6a45-c4d6-49ab-86c8-e42125b47361 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-5a0a6a45-c4d6-49ab-86c8-e42125b47361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:24.127825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:24.128858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:24.134566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:24.134566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:24.134566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:24.134566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 417/847] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:24.134566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a6a45-c4d6-49ab-86c8-e42125b47361 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:24.142451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:24.199216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f4fb5-8665-4de1-a3fd-2fbe2bc6addf None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:24.223020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:24.236688 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a843d1f-0100-41e5-8799-d6d36e48c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:24.237351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a843d1f-0100-41e5-8799-d6d36e48c033 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:24.237632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a843d1f-0100-41e5-8799-d6d36e48c033 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:24.237903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a843d1f-0100-41e5-8799-d6d36e48c033 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:24.238605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a843d1f-0100-41e5-8799-d6d36e48c033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:24.238911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a843d1f-0100-41e5-8799-d6d36e48c033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:24.240439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a843d1f-0100-41e5-8799-d6d36e48c033 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:24.243684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a6a45-c4d6-49ab-86c8-e42125b47361 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:24.254632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 431/848] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:24.254632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a843d1f-0100-41e5-8799-d6d36e48c033 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:24.289559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc4454-4618-4c00-b4b5-a38380571505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:24.291054 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc4454-4618-4c00-b4b5-a38380571505 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:24.291332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc4454-4618-4c00-b4b5-a38380571505 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:24.291602 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc4454-4618-4c00-b4b5-a38380571505 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:24.292338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc4454-4618-4c00-b4b5-a38380571505 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:24.292645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc4454-4618-4c00-b4b5-a38380571505 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:24.294135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc4454-4618-4c00-b4b5-a38380571505 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:24.311855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 418/849] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Aug 26 18:11:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:24.312943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc4454-4618-4c00-b4b5-a38380571505 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:24.363928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a843d1f-0100-41e5-8799-d6d36e48c033 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:24.382711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:24.399319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fd6ce-cbb8-4f36-a773-f2f65577b0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:24.399927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fd6ce-cbb8-4f36-a773-f2f65577b0df None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:24.400209 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fd6ce-cbb8-4f36-a773-f2f65577b0df None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:24.400473 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fd6ce-cbb8-4f36-a773-f2f65577b0df None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:24.401134 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fd6ce-cbb8-4f36-a773-f2f65577b0df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:24.401434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fd6ce-cbb8-4f36-a773-f2f65577b0df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:24.402803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fd6ce-cbb8-4f36-a773-f2f65577b0df None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:24.421289 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 432/850] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:24.421289 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fd6ce-cbb8-4f36-a773-f2f65577b0df None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:24.431129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc4454-4618-4c00-b4b5-a38380571505 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:24.468247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37236d-19b2-400b-af55-b0a66a5e71fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:24.469016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:24.469199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37236d-19b2-400b-af55-b0a66a5e71fe None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:24.469474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37236d-19b2-400b-af55-b0a66a5e71fe None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:24.469909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37236d-19b2-400b-af55-b0a66a5e71fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:24.471025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37236d-19b2-400b-af55-b0a66a5e71fe None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=3791df34c6e442aaabd90d7f5c2f3a1a) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:24.471327 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37236d-19b2-400b-af55-b0a66a5e71fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:24.472804 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37236d-19b2-400b-af55-b0a66a5e71fe None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:24.479254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 419/851] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:24 2022] GET /identity/v3/role_assignments?user.id=3791df34c6e442aaabd90d7f5c2f3a1a&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=db572ad3d504403cbb227c2155c93eda => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:24.479972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37236d-19b2-400b-af55-b0a66a5e71fe None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:24.545642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fd6ce-cbb8-4f36-a773-f2f65577b0df None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:24.588076 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941caf78-8030-416d-831f-2ba13c0abc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:24.588585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941caf78-8030-416d-831f-2ba13c0abc01 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:24.589003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941caf78-8030-416d-831f-2ba13c0abc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:24.589372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941caf78-8030-416d-831f-2ba13c0abc01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:24.623740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37236d-19b2-400b-af55-b0a66a5e71fe None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:24.659671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:24.669890 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7950f7-3057-45e5-b359-b96b9d6ef0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:24.670621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7950f7-3057-45e5-b359-b96b9d6ef0ef None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:24.670906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7950f7-3057-45e5-b359-b96b9d6ef0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:24.671180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7950f7-3057-45e5-b359-b96b9d6ef0ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:24.676140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941caf78-8030-416d-831f-2ba13c0abc01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:24.677654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941caf78-8030-416d-831f-2ba13c0abc01 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:24.679625 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7950f7-3057-45e5-b359-b96b9d6ef0ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:24.682070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7950f7-3057-45e5-b359-b96b9d6ef0ef None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ca7950f7-3057-45e5-b359-b96b9d6ef0ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:24.698384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:24.699352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:24.700304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:24.700304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:24.700304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:24.700304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:24.700304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:24.700304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:24.700304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:24.700304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:24.700304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 18:11:24.700304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:24.702711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 420/852] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:24.709127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7950f7-3057-45e5-b359-b96b9d6ef0ef None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:24.732614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:24.801593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 433/853] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:11:24.807420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941caf78-8030-416d-831f-2ba13c0abc01 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:24.837106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7950f7-3057-45e5-b359-b96b9d6ef0ef None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:24.879025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5c6fc-4e6e-4d96-96b7-7439ced13f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:24.879998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5c6fc-4e6e-4d96-96b7-7439ced13f08 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:24.880373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5c6fc-4e6e-4d96-96b7-7439ced13f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:24.881148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5c6fc-4e6e-4d96-96b7-7439ced13f08 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:24.882263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5c6fc-4e6e-4d96-96b7-7439ced13f08 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:24.882910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5c6fc-4e6e-4d96-96b7-7439ced13f08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:24.885155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5c6fc-4e6e-4d96-96b7-7439ced13f08 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:24.908695 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 421/854] 10.222.0.45 () {56 vars in 1135 bytes} [Fri Aug 26 18:11:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:24.914708 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5c6fc-4e6e-4d96-96b7-7439ced13f08 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:24.931609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941caf78-8030-416d-831f-2ba13c0abc01 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:24.972851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1e3b-c6e9-4182-8e59-e0d60dbd2473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:24.973986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1e3b-c6e9-4182-8e59-e0d60dbd2473 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:24.974099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:24.974577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1e3b-c6e9-4182-8e59-e0d60dbd2473 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:24.975073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1e3b-c6e9-4182-8e59-e0d60dbd2473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:24.988452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e1e3b-c6e9-4182-8e59-e0d60dbd2473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:24.990381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e1e3b-c6e9-4182-8e59-e0d60dbd2473 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:24.992759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-5a3e1e3b-c6e9-4182-8e59-e0d60dbd2473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:25.007661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:25.008672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:25.009609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:25.009609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:25.009609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:25.011723 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 434/855] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:25.019522 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1e3b-c6e9-4182-8e59-e0d60dbd2473 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:25.035519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5c6fc-4e6e-4d96-96b7-7439ced13f08 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:25.070585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc061d13-b26f-4be8-9fa5-c73bc2bc4a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:25.071229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc061d13-b26f-4be8-9fa5-c73bc2bc4a01 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:25.071508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc061d13-b26f-4be8-9fa5-c73bc2bc4a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:25.071779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc061d13-b26f-4be8-9fa5-c73bc2bc4a01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:25.120100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1e3b-c6e9-4182-8e59-e0d60dbd2473 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:25.143131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc061d13-b26f-4be8-9fa5-c73bc2bc4a01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:25.144614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc061d13-b26f-4be8-9fa5-c73bc2bc4a01 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:25.156034 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edaf67-4342-42b6-8007-61ad812d8749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:25.156649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edaf67-4342-42b6-8007-61ad812d8749 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:25.156972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edaf67-4342-42b6-8007-61ad812d8749 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:25.157263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edaf67-4342-42b6-8007-61ad812d8749 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:25.157930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edaf67-4342-42b6-8007-61ad812d8749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:25.158228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edaf67-4342-42b6-8007-61ad812d8749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:25.159599 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edaf67-4342-42b6-8007-61ad812d8749 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:25.176488 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 435/856] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:25.177420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edaf67-4342-42b6-8007-61ad812d8749 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:25.191376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:25.234296 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:25.251449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 422/857] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:11:25.259052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc061d13-b26f-4be8-9fa5-c73bc2bc4a01 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:25.280998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edaf67-4342-42b6-8007-61ad812d8749 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:25.316226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e723d-7a3c-4ca7-86ad-0fb831bec145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:25.317145 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e723d-7a3c-4ca7-86ad-0fb831bec145 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:25.317480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e723d-7a3c-4ca7-86ad-0fb831bec145 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:25.317759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e723d-7a3c-4ca7-86ad-0fb831bec145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:25.327015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e723d-7a3c-4ca7-86ad-0fb831bec145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:25.328796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e723d-7a3c-4ca7-86ad-0fb831bec145 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-6c6e723d-7a3c-4ca7-86ad-0fb831bec145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:25.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:25.345203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:25.346101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:25.346101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:25.346101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:25.346101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:25.346101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:25.346101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:25.346101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:25.346101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:25.348788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 436/858] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:25.351108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e723d-7a3c-4ca7-86ad-0fb831bec145 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:25.369085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc061d13-b26f-4be8-9fa5-c73bc2bc4a01 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:25.410015 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625385b0-fc6e-475f-acf3-c235019e462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:25.411605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625385b0-fc6e-475f-acf3-c235019e462a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:25.412085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625385b0-fc6e-475f-acf3-c235019e462a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:25.412812 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625385b0-fc6e-475f-acf3-c235019e462a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:25.427262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625385b0-fc6e-475f-acf3-c235019e462a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:25.429595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625385b0-fc6e-475f-acf3-c235019e462a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:25.438888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-625385b0-fc6e-475f-acf3-c235019e462a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:25.451031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:25.452023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:25.452938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:25.452938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:25.452938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:25.459208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 423/859] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:25.460738 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625385b0-fc6e-475f-acf3-c235019e462a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:25.472686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e723d-7a3c-4ca7-86ad-0fb831bec145 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:25.487416 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:25.509686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562b0b9-1db0-4237-ab12-3e1e2e62181c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:25.510304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562b0b9-1db0-4237-ab12-3e1e2e62181c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:25.510586 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562b0b9-1db0-4237-ab12-3e1e2e62181c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:25.510861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562b0b9-1db0-4237-ab12-3e1e2e62181c None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:25.511562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562b0b9-1db0-4237-ab12-3e1e2e62181c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:25.511870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562b0b9-1db0-4237-ab12-3e1e2e62181c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:25.513419 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562b0b9-1db0-4237-ab12-3e1e2e62181c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:25.526520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 437/860] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:25.532992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562b0b9-1db0-4237-ab12-3e1e2e62181c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:25.577933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625385b0-fc6e-475f-acf3-c235019e462a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:25.613715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9512ec0-f492-41f4-baf7-d3d1b55925f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:25.614675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9512ec0-f492-41f4-baf7-d3d1b55925f8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:25.615123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9512ec0-f492-41f4-baf7-d3d1b55925f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:25.615537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9512ec0-f492-41f4-baf7-d3d1b55925f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:25.616323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9512ec0-f492-41f4-baf7-d3d1b55925f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:25.616898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9512ec0-f492-41f4-baf7-d3d1b55925f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:25.618519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9512ec0-f492-41f4-baf7-d3d1b55925f8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:25.636554 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 424/861] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:25.637797 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9512ec0-f492-41f4-baf7-d3d1b55925f8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:25.641323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562b0b9-1db0-4237-ab12-3e1e2e62181c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:25.678981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf797a81-a498-434e-9ca9-826dc9014d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:25.679942 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf797a81-a498-434e-9ca9-826dc9014d27 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:25.680467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf797a81-a498-434e-9ca9-826dc9014d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:25.680928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf797a81-a498-434e-9ca9-826dc9014d27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:25.681811 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf797a81-a498-434e-9ca9-826dc9014d27 None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=7626e0cf57a74281b3cf5f3b31b5b79a) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:25.682292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf797a81-a498-434e-9ca9-826dc9014d27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:25.683983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf797a81-a498-434e-9ca9-826dc9014d27 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:25.696993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 438/862] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:25 2022] GET /identity/v3/role_assignments?user.id=7626e0cf57a74281b3cf5f3b31b5b79a&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:25.712198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:25.758587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9512ec0-f492-41f4-baf7-d3d1b55925f8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:25.796319 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c7128-5fca-4ef9-9e32-5484fb504507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:25.796994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c7128-5fca-4ef9-9e32-5484fb504507 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:25.797274 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c7128-5fca-4ef9-9e32-5484fb504507 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:25.797546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c7128-5fca-4ef9-9e32-5484fb504507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:25.805068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c7128-5fca-4ef9-9e32-5484fb504507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:25.806646 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c7128-5fca-4ef9-9e32-5484fb504507 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:25.814337 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1fb5a-2502-4258-858c-005a14bb82a2 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:25.814652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1fb5a-2502-4258-858c-005a14bb82a2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:25.814896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1fb5a-2502-4258-858c-005a14bb82a2 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:25.816562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 439/863] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-387c7128-5fca-4ef9-9e32-5484fb504507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:25.818946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:25.819813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:25.821185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:25.821185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:25.821185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:25.821185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:25.821185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:25.821185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:25.821185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:25.821185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:25.821185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 425/864] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:25.822200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30004fe-77cc-4e0e-b63a-9942b5efc794 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:25.822482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30004fe-77cc-4e0e-b63a-9942b5efc794 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:25.822753 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30004fe-77cc-4e0e-b63a-9942b5efc794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:25.826105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c7128-5fca-4ef9-9e32-5484fb504507 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:25.854950 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f30004fe-77cc-4e0e-b63a-9942b5efc794 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:25.856241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f30004fe-77cc-4e0e-b63a-9942b5efc794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:25.895249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:25.943442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 440/865] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:25.953991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c7128-5fca-4ef9-9e32-5484fb504507 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:25.971589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:25.989367 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b29a6-e016-414c-9606-f8caa2eb9c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:25.989982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b29a6-e016-414c-9606-f8caa2eb9c20 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:25.990259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b29a6-e016-414c-9606-f8caa2eb9c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:25.990530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b29a6-e016-414c-9606-f8caa2eb9c20 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:25.991231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b29a6-e016-414c-9606-f8caa2eb9c20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:25.991537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b29a6-e016-414c-9606-f8caa2eb9c20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:25.993000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b29a6-e016-414c-9606-f8caa2eb9c20 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:26.006291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 426/866] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:26.012017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30004fe-77cc-4e0e-b63a-9942b5efc794 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:26.117934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30004fe-77cc-4e0e-b63a-9942b5efc794 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:26.154966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7558d-4eb1-4e14-a892-3a6f35768de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:26.155918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7558d-4eb1-4e14-a892-3a6f35768de9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:26.156373 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7558d-4eb1-4e14-a892-3a6f35768de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:26.156847 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7558d-4eb1-4e14-a892-3a6f35768de9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:26.157748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7558d-4eb1-4e14-a892-3a6f35768de9 None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=98c92b2c982a4780884365a7a7ec6514) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:26.158260 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7558d-4eb1-4e14-a892-3a6f35768de9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:26.159877 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7558d-4eb1-4e14-a892-3a6f35768de9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:26.166595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 441/867] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:26 2022] GET /identity/v3/role_assignments?user.id=98c92b2c982a4780884365a7a7ec6514&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=db572ad3d504403cbb227c2155c93eda => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:26.208055 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b29a6-e016-414c-9606-f8caa2eb9c20 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:26.315469 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b29a6-e016-414c-9606-f8caa2eb9c20 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:26.353208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e992bf-2b20-493c-9b63-b48d210c9719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:26.353824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e992bf-2b20-493c-9b63-b48d210c9719 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:26.354102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e992bf-2b20-493c-9b63-b48d210c9719 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:26.354426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e992bf-2b20-493c-9b63-b48d210c9719 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:26.355101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e992bf-2b20-493c-9b63-b48d210c9719 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:26.356469 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e992bf-2b20-493c-9b63-b48d210c9719 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:26.374158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 427/868] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:11:26 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:11:26.561001 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915b55-d8cb-444c-af24-4bd7c140179b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:26.561517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915b55-d8cb-444c-af24-4bd7c140179b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:26.561517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915b55-d8cb-444c-af24-4bd7c140179b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:26.563141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 442/869] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:26.568737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df1e84-d316-45cb-9bfe-b92ead4ca8e3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:26.569181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df1e84-d316-45cb-9bfe-b92ead4ca8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:26.569364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df1e84-d316-45cb-9bfe-b92ead4ca8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:26.591121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-67df1e84-d316-45cb-9bfe-b92ead4ca8e3 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:26.592764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-67df1e84-d316-45cb-9bfe-b92ead4ca8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:26.623408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:26.667451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 428/870] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:26 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:11:26.933912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915b55-d8cb-444c-af24-4bd7c140179b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:26.966714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:27.039174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915b55-d8cb-444c-af24-4bd7c140179b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:27.073469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0f055-a86d-4619-a721-71c96f679107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:27.074153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0f055-a86d-4619-a721-71c96f679107 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:27.074433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0f055-a86d-4619-a721-71c96f679107 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:27.074703 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0f055-a86d-4619-a721-71c96f679107 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:27.075279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0f055-a86d-4619-a721-71c96f679107 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:27.076763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0f055-a86d-4619-a721-71c96f679107 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-29f0f055-a86d-4619-a721-71c96f679107 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:27.085471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:27.086426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:27.087317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 443/871] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Aug 26 18:11:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:27.092981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df1e84-d316-45cb-9bfe-b92ead4ca8e3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:27.195640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df1e84-d316-45cb-9bfe-b92ead4ca8e3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:27.231237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0fda1-a1c3-49f5-8056-3a1a56a15111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:27.232262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0fda1-a1c3-49f5-8056-3a1a56a15111 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:27.232771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0fda1-a1c3-49f5-8056-3a1a56a15111 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:27.233245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0fda1-a1c3-49f5-8056-3a1a56a15111 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:27.234081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0fda1-a1c3-49f5-8056-3a1a56a15111 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:27.234618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0fda1-a1c3-49f5-8056-3a1a56a15111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:27.236257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0fda1-a1c3-49f5-8056-3a1a56a15111 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:27.241641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 429/872] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 26 18:11:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:27.252768 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0f055-a86d-4619-a721-71c96f679107 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:27.346205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:27.352300 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0f055-a86d-4619-a721-71c96f679107 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:27.387483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd3601-db68-4ae9-97be-604333715b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:27.388189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd3601-db68-4ae9-97be-604333715b5e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:27.388469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd3601-db68-4ae9-97be-604333715b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:27.388759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd3601-db68-4ae9-97be-604333715b5e None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:27.389400 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd3601-db68-4ae9-97be-604333715b5e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:27.389702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd3601-db68-4ae9-97be-604333715b5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:27.391092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd3601-db68-4ae9-97be-604333715b5e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:27.396233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 444/873] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 26 18:11:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:27.785948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7f297-1d3a-4173-a2ca-41d68d15f894 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:27.786944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7f297-1d3a-4173-a2ca-41d68d15f894 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:27.787456 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7f297-1d3a-4173-a2ca-41d68d15f894 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:27.789313 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 430/874] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:27.794897 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d28ec9-892f-47e9-bb63-4331cd10a37c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:27.795773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d28ec9-892f-47e9-bb63-4331cd10a37c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:27.796247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d28ec9-892f-47e9-bb63-4331cd10a37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:27.815007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-89d28ec9-892f-47e9-bb63-4331cd10a37c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:27.816549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-89d28ec9-892f-47e9-bb63-4331cd10a37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:27.885628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 445/875] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:27 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:28.149895 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bcdb7-3d16-4743-9260-78a582423ed7 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:28.150243 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bcdb7-3d16-4743-9260-78a582423ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:28.150363 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bcdb7-3d16-4743-9260-78a582423ed7 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:28.151991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 431/876] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:28.155603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d28ec9-892f-47e9-bb63-4331cd10a37c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:28.157309 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dff530-78f4-4d30-afd7-90e0388c2756 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:28.157600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dff530-78f4-4d30-afd7-90e0388c2756 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:28.157875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dff530-78f4-4d30-afd7-90e0388c2756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:28.188958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-83dff530-78f4-4d30-afd7-90e0388c2756 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:28.190137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-83dff530-78f4-4d30-afd7-90e0388c2756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:28.222230 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:28.274756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:28.281903 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 432/877] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:28 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:11:28.287589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d28ec9-892f-47e9-bb63-4331cd10a37c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:28.322748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b9ea7-7c3f-4102-a2fa-f1daf8a298b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:28.323712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b9ea7-7c3f-4102-a2fa-f1daf8a298b4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:28.324171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b9ea7-7c3f-4102-a2fa-f1daf8a298b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:28.324620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b9ea7-7c3f-4102-a2fa-f1daf8a298b4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:28.335501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b9ea7-7c3f-4102-a2fa-f1daf8a298b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-d20b9ea7-7c3f-4102-a2fa-f1daf8a298b4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:28.340822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:28.341786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:28.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:28.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:28.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:28.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:28.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:28.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:28.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:28.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:28.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:28.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:28.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 18:11:28.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:28.348922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 446/878] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Aug 26 18:11:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:28.349082 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2b8da-da33-4adf-80c3-dd65ff7f9c34 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:28.349082 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2b8da-da33-4adf-80c3-dd65ff7f9c34 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:28.349082 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2b8da-da33-4adf-80c3-dd65ff7f9c34 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:28.350700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 433/879] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:28.351098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b9ea7-7c3f-4102-a2fa-f1daf8a298b4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:28.358110 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333276a-3546-43b0-b230-b5c13582e45f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:28.358509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333276a-3546-43b0-b230-b5c13582e45f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:28.358874 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333276a-3546-43b0-b230-b5c13582e45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:28.379668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e333276a-3546-43b0-b230-b5c13582e45f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:28.381277 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e333276a-3546-43b0-b230-b5c13582e45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:28.473176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 434/880] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:28 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:28.478651 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b9ea7-7c3f-4102-a2fa-f1daf8a298b4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:28.516159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6009729-85de-41bd-a2b2-9e084b677fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:28.517114 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6009729-85de-41bd-a2b2-9e084b677fed None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:28.517576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6009729-85de-41bd-a2b2-9e084b677fed None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:28.518024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6009729-85de-41bd-a2b2-9e084b677fed None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:28.518868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6009729-85de-41bd-a2b2-9e084b677fed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:28.519457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6009729-85de-41bd-a2b2-9e084b677fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:28.521111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6009729-85de-41bd-a2b2-9e084b677fed None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:28.530363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 447/881] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 26 18:11:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:28.535951 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333276a-3546-43b0-b230-b5c13582e45f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:28.543806 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6009729-85de-41bd-a2b2-9e084b677fed None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:28.570629 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:28.646939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6009729-85de-41bd-a2b2-9e084b677fed None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:28.651537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:28.667813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333276a-3546-43b0-b230-b5c13582e45f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:28.688697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00153731-3721-4056-8282-df5b1571feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:28.689356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00153731-3721-4056-8282-df5b1571feca None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:28.689635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00153731-3721-4056-8282-df5b1571feca None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:28.689908 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00153731-3721-4056-8282-df5b1571feca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:28.691405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00153731-3721-4056-8282-df5b1571feca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:28.692821 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00153731-3721-4056-8282-df5b1571feca None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-00153731-3721-4056-8282-df5b1571feca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:28.702056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:28.703079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:28.703936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:28.708278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 448/882] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 26 18:11:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:28.709661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00153731-3721-4056-8282-df5b1571feca None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:28.719851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062c411-0bcf-4dc6-9194-6d5be0c96d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:28.720806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062c411-0bcf-4dc6-9194-6d5be0c96d36 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:28.721720 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062c411-0bcf-4dc6-9194-6d5be0c96d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:28.722200 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062c411-0bcf-4dc6-9194-6d5be0c96d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:28.736770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062c411-0bcf-4dc6-9194-6d5be0c96d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:28.739125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062c411-0bcf-4dc6-9194-6d5be0c96d36 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-1062c411-0bcf-4dc6-9194-6d5be0c96d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:28.758559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:28.759624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:28.760519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:28.760519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:28.760519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:28.760519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 435/883] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:28.760519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062c411-0bcf-4dc6-9194-6d5be0c96d36 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:28.798243 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:28.821943 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00153731-3721-4056-8282-df5b1571feca None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:28.860239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9578a-1caf-4868-af18-f03b8158beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:28.860899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9578a-1caf-4868-af18-f03b8158beef None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:28.861182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9578a-1caf-4868-af18-f03b8158beef None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:28.861454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9578a-1caf-4868-af18-f03b8158beef None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:28.862087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9578a-1caf-4868-af18-f03b8158beef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:28.862392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9578a-1caf-4868-af18-f03b8158beef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:28.863784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9578a-1caf-4868-af18-f03b8158beef None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:28.868570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 449/884] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 26 18:11:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:28.869422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9578a-1caf-4868-af18-f03b8158beef None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:28.870027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062c411-0bcf-4dc6-9194-6d5be0c96d36 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:28.907317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b7cd0-37d6-4299-9cd3-166bc47ac978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:28.908232 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b7cd0-37d6-4299-9cd3-166bc47ac978 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:28.908661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b7cd0-37d6-4299-9cd3-166bc47ac978 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:28.909102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b7cd0-37d6-4299-9cd3-166bc47ac978 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:28.909843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b7cd0-37d6-4299-9cd3-166bc47ac978 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:28.911222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b7cd0-37d6-4299-9cd3-166bc47ac978 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-5a9b7cd0-37d6-4299-9cd3-166bc47ac978 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:28.920264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:28.921579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:28.922419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 436/885] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:11:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:28.923203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b7cd0-37d6-4299-9cd3-166bc47ac978 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:28.928435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:28.985960 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9578a-1caf-4868-af18-f03b8158beef None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:29.026018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62554cf9-d711-4654-9bbf-a93fab354cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:29.026591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62554cf9-d711-4654-9bbf-a93fab354cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:29.026831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62554cf9-d711-4654-9bbf-a93fab354cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:29.027102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62554cf9-d711-4654-9bbf-a93fab354cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:29.027775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62554cf9-d711-4654-9bbf-a93fab354cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:29.028078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62554cf9-d711-4654-9bbf-a93fab354cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:29.029502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62554cf9-d711-4654-9bbf-a93fab354cf4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:29.034769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b7cd0-37d6-4299-9cd3-166bc47ac978 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:29.038527 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:29.044031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 450/886] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:29.045162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62554cf9-d711-4654-9bbf-a93fab354cf4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:29.075372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f34f6-4ea7-41f2-bdc7-d709944ee542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:29.076032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f34f6-4ea7-41f2-bdc7-d709944ee542 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:29.076313 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f34f6-4ea7-41f2-bdc7-d709944ee542 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:29.076590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f34f6-4ea7-41f2-bdc7-d709944ee542 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:29.077258 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f34f6-4ea7-41f2-bdc7-d709944ee542 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:29.077556 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f34f6-4ea7-41f2-bdc7-d709944ee542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:29.078928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f34f6-4ea7-41f2-bdc7-d709944ee542 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:29.083557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 437/887] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 26 18:11:28 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:29.084362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f34f6-4ea7-41f2-bdc7-d709944ee542 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:29.162083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62554cf9-d711-4654-9bbf-a93fab354cf4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:29.190091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:29.202727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348dc90-856e-41ec-89af-61f1ebfb9e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:29.203781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348dc90-856e-41ec-89af-61f1ebfb9e79 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:29.204359 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348dc90-856e-41ec-89af-61f1ebfb9e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:29.204876 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348dc90-856e-41ec-89af-61f1ebfb9e79 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:29.206468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348dc90-856e-41ec-89af-61f1ebfb9e79 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:29.207278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348dc90-856e-41ec-89af-61f1ebfb9e79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:29.209561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348dc90-856e-41ec-89af-61f1ebfb9e79 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:29.220592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 451/888] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:11:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:29.222583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348dc90-856e-41ec-89af-61f1ebfb9e79 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:29.233909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f34f6-4ea7-41f2-bdc7-d709944ee542 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:29.285799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f2c9d-f910-471e-a21a-117e6861fd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:29.286771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f2c9d-f910-471e-a21a-117e6861fd31 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:29.287787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f2c9d-f910-471e-a21a-117e6861fd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:29.288266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f2c9d-f910-471e-a21a-117e6861fd31 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:29.299419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f2c9d-f910-471e-a21a-117e6861fd31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:29.301749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f2c9d-f910-471e-a21a-117e6861fd31 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:29.304303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-fe4f2c9d-f910-471e-a21a-117e6861fd31 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:29.318438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:29.319534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:29.320860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:29.320860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:29.320860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:29.320860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:29.320860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:29.320860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:29.320860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:29.320860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:29.320860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 18:11:29.320860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:29.320860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 438/889] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 26 18:11:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:29.325362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f2c9d-f910-471e-a21a-117e6861fd31 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:29.352898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348dc90-856e-41ec-89af-61f1ebfb9e79 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:29.389463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4feff55-d4d1-4f0c-9bb8-30de96a3970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:29.390087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feff55-d4d1-4f0c-9bb8-30de96a3970b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:29.390382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feff55-d4d1-4f0c-9bb8-30de96a3970b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:29.390644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feff55-d4d1-4f0c-9bb8-30de96a3970b None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:29.391280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feff55-d4d1-4f0c-9bb8-30de96a3970b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:29.391585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feff55-d4d1-4f0c-9bb8-30de96a3970b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:29.393017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feff55-d4d1-4f0c-9bb8-30de96a3970b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:29.397953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 452/890] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:11:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:29.399113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346515b4-27b2-4bd6-9da9-d4e3839dad54 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:29.399395 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346515b4-27b2-4bd6-9da9-d4e3839dad54 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:29.399665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346515b4-27b2-4bd6-9da9-d4e3839dad54 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:29.401055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 453/891] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:29.405663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346515b4-27b2-4bd6-9da9-d4e3839dad54 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:29.443727 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f2c9d-f910-471e-a21a-117e6861fd31 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:29.471440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:29.481094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fe219-8245-4e83-b976-ea920db03cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:29.481711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fe219-8245-4e83-b976-ea920db03cae None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:29.482078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fe219-8245-4e83-b976-ea920db03cae None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:29.482350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fe219-8245-4e83-b976-ea920db03cae None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:29.483095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fe219-8245-4e83-b976-ea920db03cae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:29.483397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fe219-8245-4e83-b976-ea920db03cae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:29.484851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fe219-8245-4e83-b976-ea920db03cae None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:29.507208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 439/892] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Aug 26 18:11:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:29.508556 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12affeb4-32ac-4c74-937e-ae846b010c6b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:29.508874 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12affeb4-32ac-4c74-937e-ae846b010c6b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:29.509151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12affeb4-32ac-4c74-937e-ae846b010c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:29.513539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346515b4-27b2-4bd6-9da9-d4e3839dad54 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:29.527373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-12affeb4-32ac-4c74-937e-ae846b010c6b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:29.528660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-12affeb4-32ac-4c74-937e-ae846b010c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:29.549229 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:29.561142 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea633ab-16fd-4573-abb0-c907a3f819a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:29.561783 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea633ab-16fd-4573-abb0-c907a3f819a8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:29.562049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea633ab-16fd-4573-abb0-c907a3f819a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:29.562325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea633ab-16fd-4573-abb0-c907a3f819a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:29.563052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea633ab-16fd-4573-abb0-c907a3f819a8 None admin] RBAC: Adding query filter params (interface=public, service_id=b3925fdc70e74902ac5df0eb8359f1c3, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:29.563367 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea633ab-16fd-4573-abb0-c907a3f819a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:29.564794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea633ab-16fd-4573-abb0-c907a3f819a8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:29.571382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 454/893] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 26 18:11:29 2022] GET /identity/v3/endpoints?service_id=b3925fdc70e74902ac5df0eb8359f1c3&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:29.572024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea633ab-16fd-4573-abb0-c907a3f819a8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:29.607242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 440/894] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:29.608105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12affeb4-32ac-4c74-937e-ae846b010c6b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:29.686293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea633ab-16fd-4573-abb0-c907a3f819a8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:29.724183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eeb768-c572-48be-aa18-476efade190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:29.725279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeb768-c572-48be-aa18-476efade190f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:29.726803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeb768-c572-48be-aa18-476efade190f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:29.727876 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeb768-c572-48be-aa18-476efade190f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:29.736736 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12affeb4-32ac-4c74-937e-ae846b010c6b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:29.755336 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:29.775109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c205ae6-b7ff-4f5c-bbff-bb26991db165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:29.775597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c205ae6-b7ff-4f5c-bbff-bb26991db165 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:29.775874 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c205ae6-b7ff-4f5c-bbff-bb26991db165 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:29.776144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c205ae6-b7ff-4f5c-bbff-bb26991db165 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:29.776854 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c205ae6-b7ff-4f5c-bbff-bb26991db165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:29.778259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c205ae6-b7ff-4f5c-bbff-bb26991db165 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:29.793571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:29.793775 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 441/895] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 26 18:11:29 2022] GET /identity/v3/services => generated 1011 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:11:29.804444 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eeb768-c572-48be-aa18-476efade190f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:29.806183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eeb768-c572-48be-aa18-476efade190f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:29.897805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c205ae6-b7ff-4f5c-bbff-bb26991db165 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:29.917887 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 455/896] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:29 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:11:29.923654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eeb768-c572-48be-aa18-476efade190f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:30.013763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c205ae6-b7ff-4f5c-bbff-bb26991db165 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:30.022794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:30.032862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eeb768-c572-48be-aa18-476efade190f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:30.050024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5da519-9152-4485-aab7-468d4e4226be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:30.050985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5da519-9152-4485-aab7-468d4e4226be None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:30.051468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5da519-9152-4485-aab7-468d4e4226be None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:30.051967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5da519-9152-4485-aab7-468d4e4226be None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:30.052854 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5da519-9152-4485-aab7-468d4e4226be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:30.054429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5da519-9152-4485-aab7-468d4e4226be None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:30.073097 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317ef4a-3c3e-4e83-9375-4f48b0be8d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:30.073760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ef4a-3c3e-4e83-9375-4f48b0be8d6f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:30.074089 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ef4a-3c3e-4e83-9375-4f48b0be8d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:30.074298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ef4a-3c3e-4e83-9375-4f48b0be8d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:30.080745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 442/897] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:11:29 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:11:30.097325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317ef4a-3c3e-4e83-9375-4f48b0be8d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:30.098939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317ef4a-3c3e-4e83-9375-4f48b0be8d6f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e317ef4a-3c3e-4e83-9375-4f48b0be8d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:30.117725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:30.118728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:30.119670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:30.119670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:30.119670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:30.119670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 456/898] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:30.125227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5da519-9152-4485-aab7-468d4e4226be None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:30.175389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:30.250421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5da519-9152-4485-aab7-468d4e4226be None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:30.286999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb2f22-0811-4b94-912c-2b90467df0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:30.287611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb2f22-0811-4b94-912c-2b90467df0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:30.287885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb2f22-0811-4b94-912c-2b90467df0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:30.288157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb2f22-0811-4b94-912c-2b90467df0e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:30.288827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb2f22-0811-4b94-912c-2b90467df0e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:30.289126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb2f22-0811-4b94-912c-2b90467df0e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:30.290491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb2f22-0811-4b94-912c-2b90467df0e3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:30.302228 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 443/899] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:30.308121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317ef4a-3c3e-4e83-9375-4f48b0be8d6f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:30.417583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317ef4a-3c3e-4e83-9375-4f48b0be8d6f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:30.454617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6e0a9-391e-4dbb-8621-38706ef5954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:30.455285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6e0a9-391e-4dbb-8621-38706ef5954f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:30.455581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6e0a9-391e-4dbb-8621-38706ef5954f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:30.455847 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6e0a9-391e-4dbb-8621-38706ef5954f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:30.464946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6e0a9-391e-4dbb-8621-38706ef5954f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:30.467583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6e0a9-391e-4dbb-8621-38706ef5954f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-aef6e0a9-391e-4dbb-8621-38706ef5954f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:30.481849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:30.482894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:30.483784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:30.483784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:30.483784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:30.483784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:30.483784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:30.483784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:30.483784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:30.483784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:30.483784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 457/900] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:30.490145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb2f22-0811-4b94-912c-2b90467df0e3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:30.599818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:30.607370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb2f22-0811-4b94-912c-2b90467df0e3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:30.642942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb740e1-5a71-4a08-9209-808b9957471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:30.643561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb740e1-5a71-4a08-9209-808b9957471c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:30.643840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb740e1-5a71-4a08-9209-808b9957471c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:30.644111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb740e1-5a71-4a08-9209-808b9957471c None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:30.644822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb740e1-5a71-4a08-9209-808b9957471c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:30.645129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb740e1-5a71-4a08-9209-808b9957471c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:30.646549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb740e1-5a71-4a08-9209-808b9957471c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:30.659357 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 444/901] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:30.665381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6e0a9-391e-4dbb-8621-38706ef5954f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:30.669324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:30.768960 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6e0a9-391e-4dbb-8621-38706ef5954f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:30.807432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72326c1-b922-48b5-994a-9f28846a1f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:30.808065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72326c1-b922-48b5-994a-9f28846a1f59 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:30.808296 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72326c1-b922-48b5-994a-9f28846a1f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:30.808556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72326c1-b922-48b5-994a-9f28846a1f59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:30.809319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72326c1-b922-48b5-994a-9f28846a1f59 None admin] RBAC: Adding query filter params (role.id=5b7184a41c574ff3851c31ce9496e8ae, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=7626e0cf57a74281b3cf5f3b31b5b79a) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:30.809622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72326c1-b922-48b5-994a-9f28846a1f59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:30.811121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72326c1-b922-48b5-994a-9f28846a1f59 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:30.817015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 458/902] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:30 2022] GET /identity/v3/role_assignments?user.id=7626e0cf57a74281b3cf5f3b31b5b79a&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5b7184a41c574ff3851c31ce9496e8ae => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:31.013431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7097a-ba9a-4318-a2b5-ee4c6d896805 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:31.013979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7097a-ba9a-4318-a2b5-ee4c6d896805 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:31.013979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7097a-ba9a-4318-a2b5-ee4c6d896805 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:31.015579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 445/903] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:31.021166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5d2ea-e405-4531-a3c6-fef229c2d1ae None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:31.021457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5d2ea-e405-4531-a3c6-fef229c2d1ae None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:31.021727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5d2ea-e405-4531-a3c6-fef229c2d1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:31.039735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fac5d2ea-e405-4531-a3c6-fef229c2d1ae None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:31.040957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fac5d2ea-e405-4531-a3c6-fef229c2d1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:31.105148 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:31.111467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 459/904] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:31.376111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7097a-ba9a-4318-a2b5-ee4c6d896805 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:31.478374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7097a-ba9a-4318-a2b5-ee4c6d896805 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:31.520151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e44f61-7d85-4b85-9457-28bc00329354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:31.520151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e44f61-7d85-4b85-9457-28bc00329354 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:31.520151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e44f61-7d85-4b85-9457-28bc00329354 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:31.520151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e44f61-7d85-4b85-9457-28bc00329354 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:31.520570 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e44f61-7d85-4b85-9457-28bc00329354 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:31.521702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e44f61-7d85-4b85-9457-28bc00329354 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:31.539522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 446/905] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:11:31 2022] POST /identity/v3/services => generated 241 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:11:31.837678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f8a6-cade-41c1-9ffc-42367160196d None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:31.838210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f8a6-cade-41c1-9ffc-42367160196d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:31.838210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f8a6-cade-41c1-9ffc-42367160196d None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:31.839809 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 460/906] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:31.845426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5426a-f1ba-4a19-839f-334d3a020e05 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:31.845708 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5426a-f1ba-4a19-839f-334d3a020e05 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:31.845975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5426a-f1ba-4a19-839f-334d3a020e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:31.865932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-dbc5426a-f1ba-4a19-839f-334d3a020e05 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:31.867116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dbc5426a-f1ba-4a19-839f-334d3a020e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:31.879104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:31.958989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 447/907] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:32.096888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964d2c-cc02-42c3-9b48-9a94c2b62735 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:32.097468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964d2c-cc02-42c3-9b48-9a94c2b62735 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:32.097941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964d2c-cc02-42c3-9b48-9a94c2b62735 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:32.099743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 461/908] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:32.105493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba70cc-0033-42dc-ac46-44a34a410c8d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:32.105954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba70cc-0033-42dc-ac46-44a34a410c8d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:32.106033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba70cc-0033-42dc-ac46-44a34a410c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:32.128730 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-38ba70cc-0033-42dc-ac46-44a34a410c8d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:32.129930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-38ba70cc-0033-42dc-ac46-44a34a410c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:32.196612 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 448/909] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:32.241015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65964d2c-cc02-42c3-9b48-9a94c2b62735 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:32.370633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65964d2c-cc02-42c3-9b48-9a94c2b62735 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:32.413628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff4b62-e82f-4dc5-ac4b-a6fe673f8ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:32.414261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff4b62-e82f-4dc5-ac4b-a6fe673f8ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:32.414533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff4b62-e82f-4dc5-ac4b-a6fe673f8ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:32.414814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff4b62-e82f-4dc5-ac4b-a6fe673f8ce9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:32.415697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff4b62-e82f-4dc5-ac4b-a6fe673f8ce9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:32.417854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff4b62-e82f-4dc5-ac4b-a6fe673f8ce9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-f3ff4b62-e82f-4dc5-ac4b-a6fe673f8ce9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:32.428655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:32.429700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:32.430576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 462/910] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:11:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:32.436023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba70cc-0033-42dc-ac46-44a34a410c8d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:32.467094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff4b62-e82f-4dc5-ac4b-a6fe673f8ce9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:32.521785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:32.553316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:32.562251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba70cc-0033-42dc-ac46-44a34a410c8d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:32.599427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078148ee-b0de-491c-a270-0f4c3b5bf8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:32.600174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078148ee-b0de-491c-a270-0f4c3b5bf8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:32.600382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078148ee-b0de-491c-a270-0f4c3b5bf8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:32.600564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078148ee-b0de-491c-a270-0f4c3b5bf8c0 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:32.601251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078148ee-b0de-491c-a270-0f4c3b5bf8c0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:32.601944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078148ee-b0de-491c-a270-0f4c3b5bf8c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:32.603339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078148ee-b0de-491c-a270-0f4c3b5bf8c0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:32.611446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff4b62-e82f-4dc5-ac4b-a6fe673f8ce9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:32.613000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 449/911] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:11:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:32.615194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078148ee-b0de-491c-a270-0f4c3b5bf8c0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:32.662798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0112f-089b-4342-9553-45834d592d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:32.664033 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0112f-089b-4342-9553-45834d592d7b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:32.665025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0112f-089b-4342-9553-45834d592d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:32.665616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0112f-089b-4342-9553-45834d592d7b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:32.666471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0112f-089b-4342-9553-45834d592d7b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:32.668687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0112f-089b-4342-9553-45834d592d7b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c7c0112f-089b-4342-9553-45834d592d7b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:32.681867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:32.682849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 18:11:32.683770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:32.686918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 463/912] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Aug 26 18:11:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:32.693601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0112f-089b-4342-9553-45834d592d7b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:32.731200 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078148ee-b0de-491c-a270-0f4c3b5bf8c0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:32.771936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9624f2-45db-4fad-bedb-0f3b48d333e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:32.772899 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9624f2-45db-4fad-bedb-0f3b48d333e6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:32.773360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9624f2-45db-4fad-bedb-0f3b48d333e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:32.773702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9624f2-45db-4fad-bedb-0f3b48d333e6 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:32.774399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9624f2-45db-4fad-bedb-0f3b48d333e6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:32.774702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9624f2-45db-4fad-bedb-0f3b48d333e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:32.776066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9624f2-45db-4fad-bedb-0f3b48d333e6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:32.778774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:32.787978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 450/913] 10.222.0.45 () {56 vars in 1114 bytes} [Fri Aug 26 18:11:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:32.789574 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9483d9-2a79-4d48-af7d-32f383d4e785 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:32.790279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9483d9-2a79-4d48-af7d-32f383d4e785 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:32.790557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9483d9-2a79-4d48-af7d-32f383d4e785 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:32.796044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 451/914] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:32.796823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9483d9-2a79-4d48-af7d-32f383d4e785 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:32.815037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0112f-089b-4342-9553-45834d592d7b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:32.843329 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:32.855513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455faff2-ea4f-486f-a9e4-9abe3da19096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:32.856375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455faff2-ea4f-486f-a9e4-9abe3da19096 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:32.856375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455faff2-ea4f-486f-a9e4-9abe3da19096 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:32.856643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455faff2-ea4f-486f-a9e4-9abe3da19096 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:32.857353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455faff2-ea4f-486f-a9e4-9abe3da19096 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:32.857653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455faff2-ea4f-486f-a9e4-9abe3da19096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:32.859063 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455faff2-ea4f-486f-a9e4-9abe3da19096 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:32.864201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 464/915] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 26 18:11:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:32.865692 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e36cfb-9b11-494e-8637-df58e23ad104 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:32.866200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e36cfb-9b11-494e-8637-df58e23ad104 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:32.866734 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e36cfb-9b11-494e-8637-df58e23ad104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:32.884671 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-21e36cfb-9b11-494e-8637-df58e23ad104 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:32.885889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-21e36cfb-9b11-494e-8637-df58e23ad104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:32.908115 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9483d9-2a79-4d48-af7d-32f383d4e785 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:32.947191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db438339-599f-4629-8bb5-182412c4e449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:32.948200 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db438339-599f-4629-8bb5-182412c4e449 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:32.948621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db438339-599f-4629-8bb5-182412c4e449 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:32.949035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db438339-599f-4629-8bb5-182412c4e449 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:32.949950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db438339-599f-4629-8bb5-182412c4e449 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:32.952062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db438339-599f-4629-8bb5-182412c4e449 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:32.964961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 465/916] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:32.964961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e36cfb-9b11-494e-8637-df58e23ad104 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:32.991133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 452/917] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:11:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:11:33.072336 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e36cfb-9b11-494e-8637-df58e23ad104 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:33.096475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:33.119199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fe859-062b-49bf-9779-775ec5ae5877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:33.119827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fe859-062b-49bf-9779-775ec5ae5877 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:33.120105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fe859-062b-49bf-9779-775ec5ae5877 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:33.120376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fe859-062b-49bf-9779-775ec5ae5877 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:33.121113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fe859-062b-49bf-9779-775ec5ae5877 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:33.121472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fe859-062b-49bf-9779-775ec5ae5877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:33.123009 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fe859-062b-49bf-9779-775ec5ae5877 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:33.129065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 466/918] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 26 18:11:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:33.134644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db438339-599f-4629-8bb5-182412c4e449 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:33.199339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:33.223906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fe859-062b-49bf-9779-775ec5ae5877 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:33.256740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db438339-599f-4629-8bb5-182412c4e449 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:33.294160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1803c-bacf-4dad-8109-42518d7aaef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:33.295152 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1803c-bacf-4dad-8109-42518d7aaef3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:33.295570 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1803c-bacf-4dad-8109-42518d7aaef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:33.295962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1803c-bacf-4dad-8109-42518d7aaef3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:33.296669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1803c-bacf-4dad-8109-42518d7aaef3 None admin] RBAC: Adding query filter params (interface=public, service_id=dd4d7c95c3184eafbdf83d374bbb0c9e, region_id=RegionOne) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:33.297130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1803c-bacf-4dad-8109-42518d7aaef3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:33.299137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1803c-bacf-4dad-8109-42518d7aaef3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:33.310140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 453/919] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 26 18:11:33 2022] GET /identity/v3/endpoints?service_id=dd4d7c95c3184eafbdf83d374bbb0c9e&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:33.320749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1803c-bacf-4dad-8109-42518d7aaef3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:33.345624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fe859-062b-49bf-9779-775ec5ae5877 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:33.380401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f8a17-71f2-4651-bd1f-fc40e6b23330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:33.381077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f8a17-71f2-4651-bd1f-fc40e6b23330 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:33.381358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f8a17-71f2-4651-bd1f-fc40e6b23330 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:33.381634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f8a17-71f2-4651-bd1f-fc40e6b23330 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:33.392267 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f8a17-71f2-4651-bd1f-fc40e6b23330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-9c9f8a17-71f2-4651-bd1f-fc40e6b23330 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:33.397704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:33.398636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:33.399468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 467/920] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Aug 26 18:11:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:33.405007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f8a17-71f2-4651-bd1f-fc40e6b23330 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:33.430633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1803c-bacf-4dad-8109-42518d7aaef3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:33.447587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:33.456144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:33.473372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21abad9-9b96-415b-9ee7-c94b77bb4b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:33.473995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21abad9-9b96-415b-9ee7-c94b77bb4b28 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:33.474304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21abad9-9b96-415b-9ee7-c94b77bb4b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:33.474566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21abad9-9b96-415b-9ee7-c94b77bb4b28 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:33.475158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21abad9-9b96-415b-9ee7-c94b77bb4b28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:33.477016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21abad9-9b96-415b-9ee7-c94b77bb4b28 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:33.488756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 454/921] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 26 18:11:33 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:11:33.488756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c46615-3d07-4c83-9e10-bc48306c6da3 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:33.488756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c46615-3d07-4c83-9e10-bc48306c6da3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:33.488756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c46615-3d07-4c83-9e10-bc48306c6da3 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:33.488756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 455/922] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:33.491854 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0756b-df18-4f64-b2a7-2b095eabf66f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:33.492142 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0756b-df18-4f64-b2a7-2b095eabf66f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:33.492422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0756b-df18-4f64-b2a7-2b095eabf66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:33.515454 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2ce0756b-df18-4f64-b2a7-2b095eabf66f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:33.518692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2ce0756b-df18-4f64-b2a7-2b095eabf66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:33.533207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f8a17-71f2-4651-bd1f-fc40e6b23330 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:33.573450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cd0ce-cf08-4d15-b65a-b8f65b9dd2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:33.574082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cd0ce-cf08-4d15-b65a-b8f65b9dd2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:33.574362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cd0ce-cf08-4d15-b65a-b8f65b9dd2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:33.574634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cd0ce-cf08-4d15-b65a-b8f65b9dd2e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:33.575316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cd0ce-cf08-4d15-b65a-b8f65b9dd2e7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:33.575618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cd0ce-cf08-4d15-b65a-b8f65b9dd2e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:33.577137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cd0ce-cf08-4d15-b65a-b8f65b9dd2e7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:33.592892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 468/923] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 26 18:11:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:33.596264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cd0ce-cf08-4d15-b65a-b8f65b9dd2e7 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:33.619076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 456/924] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:11:33.706347 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cd0ce-cf08-4d15-b65a-b8f65b9dd2e7 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:33.708899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:33.742504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605c017-af71-41fa-afea-e3a61ad7fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:33.743149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605c017-af71-41fa-afea-e3a61ad7fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:33.743427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605c017-af71-41fa-afea-e3a61ad7fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:33.743697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605c017-af71-41fa-afea-e3a61ad7fdc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:33.754110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605c017-af71-41fa-afea-e3a61ad7fdc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:33.755582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605c017-af71-41fa-afea-e3a61ad7fdc1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-8605c017-af71-41fa-afea-e3a61ad7fdc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:33.770410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:33.771406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:33.772284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:33.772284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:33.772284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:33.772284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 469/925] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:33.781911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0756b-df18-4f64-b2a7-2b095eabf66f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:33.884817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0756b-df18-4f64-b2a7-2b095eabf66f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:33.894426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605c017-af71-41fa-afea-e3a61ad7fdc1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:33.900034 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:33.920704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a4bd5-9288-4eb8-bb62-0deee79a68d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:33.921628 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a4bd5-9288-4eb8-bb62-0deee79a68d5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:33.921628 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a4bd5-9288-4eb8-bb62-0deee79a68d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:33.921886 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a4bd5-9288-4eb8-bb62-0deee79a68d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:33.922526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a4bd5-9288-4eb8-bb62-0deee79a68d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:33.922830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a4bd5-9288-4eb8-bb62-0deee79a68d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:33.924201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a4bd5-9288-4eb8-bb62-0deee79a68d5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:33.936862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 457/926] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:33.942235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a4bd5-9288-4eb8-bb62-0deee79a68d5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:34.006868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605c017-af71-41fa-afea-e3a61ad7fdc1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:34.042632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda56a74-1976-46c3-a899-085c11ce5826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:34.043516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda56a74-1976-46c3-a899-085c11ce5826 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:34.044011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda56a74-1976-46c3-a899-085c11ce5826 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:34.044423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda56a74-1976-46c3-a899-085c11ce5826 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:34.044577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a4bd5-9288-4eb8-bb62-0deee79a68d5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:34.045334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda56a74-1976-46c3-a899-085c11ce5826 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:34.046993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda56a74-1976-46c3-a899-085c11ce5826 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-bda56a74-1976-46c3-a899-085c11ce5826 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:34.057562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:34.058771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:34.059601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:34.067341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 470/927] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 26 18:11:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:34.068587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda56a74-1976-46c3-a899-085c11ce5826 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:34.080934 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0e6d2-fb2f-42f2-a256-312aab7feef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:34.081579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0e6d2-fb2f-42f2-a256-312aab7feef4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:34.081861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0e6d2-fb2f-42f2-a256-312aab7feef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:34.082137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0e6d2-fb2f-42f2-a256-312aab7feef4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:34.090232 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0e6d2-fb2f-42f2-a256-312aab7feef4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:34.091815 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0e6d2-fb2f-42f2-a256-312aab7feef4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b8f0e6d2-fb2f-42f2-a256-312aab7feef4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:34.103919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:34.104974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:34.105955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:34.105955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:34.105955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:34.105955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:34.105955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:34.105955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:34.105955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:34.105955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:34.105955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 18:11:34.105955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:34.110131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 458/928] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 26 18:11:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:34.111008 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0e6d2-fb2f-42f2-a256-312aab7feef4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:34.141179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:34.147163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:34.202403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda56a74-1976-46c3-a899-085c11ce5826 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:34.217181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0e6d2-fb2f-42f2-a256-312aab7feef4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:34.247107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0292c-cb96-4fac-be60-a233e357097f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:34.248680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0292c-cb96-4fac-be60-a233e357097f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:34.249342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0292c-cb96-4fac-be60-a233e357097f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:34.249914 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0292c-cb96-4fac-be60-a233e357097f None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:34.250900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0292c-cb96-4fac-be60-a233e357097f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:34.251436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0292c-cb96-4fac-be60-a233e357097f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:34.253538 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0292c-cb96-4fac-be60-a233e357097f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:34.253648 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce50c5-8a3c-4cae-be32-5d7cefd61fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:34.254371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce50c5-8a3c-4cae-be32-5d7cefd61fdc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:34.254712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce50c5-8a3c-4cae-be32-5d7cefd61fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:34.255047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce50c5-8a3c-4cae-be32-5d7cefd61fdc None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:34.255965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce50c5-8a3c-4cae-be32-5d7cefd61fdc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:34.256429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce50c5-8a3c-4cae-be32-5d7cefd61fdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:34.258003 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce50c5-8a3c-4cae-be32-5d7cefd61fdc None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:34.265038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 471/929] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 26 18:11:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:34.270032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0292c-cb96-4fac-be60-a233e357097f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:34.281732 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 459/930] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Aug 26 18:11:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:34.292796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce50c5-8a3c-4cae-be32-5d7cefd61fdc None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:34.378911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:34.389122 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:34.398547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce50c5-8a3c-4cae-be32-5d7cefd61fdc None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:34.407198 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0292c-cb96-4fac-be60-a233e357097f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:34.434402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8471-4365-4cd6-9f46-f539c148ca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:34.435161 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8471-4365-4cd6-9f46-f539c148ca5c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:34.435514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8471-4365-4cd6-9f46-f539c148ca5c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:34.435855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8471-4365-4cd6-9f46-f539c148ca5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:34.446862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a8471-4365-4cd6-9f46-f539c148ca5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:34.448442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a8471-4365-4cd6-9f46-f539c148ca5c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:34.451168 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43776b-3f13-4014-ad77-9efe1e3a9200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:34.452190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43776b-3f13-4014-ad77-9efe1e3a9200 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:34.452645 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43776b-3f13-4014-ad77-9efe1e3a9200 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:34.452941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43776b-3f13-4014-ad77-9efe1e3a9200 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:34.453584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43776b-3f13-4014-ad77-9efe1e3a9200 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:34.453890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43776b-3f13-4014-ad77-9efe1e3a9200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:34.455278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43776b-3f13-4014-ad77-9efe1e3a9200 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:34.464898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 472/931] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 26 18:11:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:34.469172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43776b-3f13-4014-ad77-9efe1e3a9200 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-bd2a8471-4365-4cd6-9f46-f539c148ca5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:34.476443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:34.478568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:34.480463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:34.480463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:34.480463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:34.488753 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 460/932] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:34.488753 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8471-4365-4cd6-9f46-f539c148ca5c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:34.582930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43776b-3f13-4014-ad77-9efe1e3a9200 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:34.603903 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8471-4365-4cd6-9f46-f539c148ca5c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:34.620024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc0aa6-bf58-4331-9b03-490792141cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:34.620795 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc0aa6-bf58-4331-9b03-490792141cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:34.621081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc0aa6-bf58-4331-9b03-490792141cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:34.621353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc0aa6-bf58-4331-9b03-490792141cd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:34.622160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc0aa6-bf58-4331-9b03-490792141cd4 None admin] RBAC: Adding query filter params (interface=public, service_id=5a25d607636147ed83ed4bd9036c2750, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:34.622468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc0aa6-bf58-4331-9b03-490792141cd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:34.623944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc0aa6-bf58-4331-9b03-490792141cd4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:34.634428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 473/933] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 26 18:11:34 2022] GET /identity/v3/endpoints?service_id=5a25d607636147ed83ed4bd9036c2750&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:34.635332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc0aa6-bf58-4331-9b03-490792141cd4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:34.639396 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16882-20cd-406d-9a78-370c0c2ce68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:34.640097 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16882-20cd-406d-9a78-370c0c2ce68b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:34.640446 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16882-20cd-406d-9a78-370c0c2ce68b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:34.640875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16882-20cd-406d-9a78-370c0c2ce68b None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:34.641603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c16882-20cd-406d-9a78-370c0c2ce68b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:34.642025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c16882-20cd-406d-9a78-370c0c2ce68b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:34.643491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c16882-20cd-406d-9a78-370c0c2ce68b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:34.649786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:34.662535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 461/934] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:34.663703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16882-20cd-406d-9a78-370c0c2ce68b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:34.667741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:34.750558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc0aa6-bf58-4331-9b03-490792141cd4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:34.767248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16882-20cd-406d-9a78-370c0c2ce68b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:34.787265 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896dd50-d1fd-47d4-bdcf-4b4011e862d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:34.788265 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896dd50-d1fd-47d4-bdcf-4b4011e862d4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:34.788700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896dd50-d1fd-47d4-bdcf-4b4011e862d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:34.789163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896dd50-d1fd-47d4-bdcf-4b4011e862d4 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:34.789933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896dd50-d1fd-47d4-bdcf-4b4011e862d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:34.791616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896dd50-d1fd-47d4-bdcf-4b4011e862d4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:34.799035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 474/935] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 26 18:11:34 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:11:34.807997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c8684-f114-4007-a2da-d2c598cb5538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:34.808744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8684-f114-4007-a2da-d2c598cb5538 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:34.809109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8684-f114-4007-a2da-d2c598cb5538 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:34.809382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8684-f114-4007-a2da-d2c598cb5538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:34.817631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8684-f114-4007-a2da-d2c598cb5538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:34.819193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8684-f114-4007-a2da-d2c598cb5538 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a84c8684-f114-4007-a2da-d2c598cb5538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:34.832078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:34.833299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:34.834436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:34.834436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:34.834436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:34.834436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:34.834436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:34.834436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:34.834436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:34.834436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:34.834436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 462/936] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:34.839628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896dd50-d1fd-47d4-bdcf-4b4011e862d4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:34.923141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:34.952264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896dd50-d1fd-47d4-bdcf-4b4011e862d4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:34.989152 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d5d6-b4ff-45ac-bf59-a9c259de24ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:34.989834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d5d6-b4ff-45ac-bf59-a9c259de24ba None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:34.990117 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d5d6-b4ff-45ac-bf59-a9c259de24ba None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:34.990415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d5d6-b4ff-45ac-bf59-a9c259de24ba None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:34.991121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d5d6-b4ff-45ac-bf59-a9c259de24ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:34.991431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d5d6-b4ff-45ac-bf59-a9c259de24ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:34.992913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d5d6-b4ff-45ac-bf59-a9c259de24ba None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:35.005800 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 475/937] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:35.011836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c8684-f114-4007-a2da-d2c598cb5538 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:35.040524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e416ae-5732-449e-8b12-fffbf92abdb1 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:35.041149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e416ae-5732-449e-8b12-fffbf92abdb1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:35.041639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e416ae-5732-449e-8b12-fffbf92abdb1 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:35.043380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 476/938] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:11:35.049126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2a6db-7423-476b-97de-662d9d082bf5 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:35.049407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2a6db-7423-476b-97de-662d9d082bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:35.049685 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2a6db-7423-476b-97de-662d9d082bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:35.068894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0ab2a6db-7423-476b-97de-662d9d082bf5 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:35.070094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0ab2a6db-7423-476b-97de-662d9d082bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:35.087979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:35.139493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c8684-f114-4007-a2da-d2c598cb5538 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:35.153074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 477/939] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:11:35.176045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259cb5e-03fb-43c0-b69f-4bb98eacb8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:35.177403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259cb5e-03fb-43c0-b69f-4bb98eacb8e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:35.177843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259cb5e-03fb-43c0-b69f-4bb98eacb8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:35.178270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259cb5e-03fb-43c0-b69f-4bb98eacb8e3 None admin] PATH_INFO: `/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/7626e0cf57a74281b3cf5f3b31b5b79a/roles/5b7184a41c574ff3851c31ce9496e8ae` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:35.180615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259cb5e-03fb-43c0-b69f-4bb98eacb8e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2803c5ec5ecf4223836ddf75397cc095, user_id=7626e0cf57a74281b3cf5f3b31b5b79a, role_id=5b7184a41c574ff3851c31ce9496e8ae)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:35.182292 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259cb5e-03fb-43c0-b69f-4bb98eacb8e3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:35.204930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 463/940] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:11:35 2022] PUT /identity/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/7626e0cf57a74281b3cf5f3b31b5b79a/roles/5b7184a41c574ff3851c31ce9496e8ae => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:11:35.414771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2a6db-7423-476b-97de-662d9d082bf5 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:35.478958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:35.505823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fcccd-d62b-4d74-aa96-ab514bd56eaf None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:35.506104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fcccd-d62b-4d74-aa96-ab514bd56eaf None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:35.506378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fcccd-d62b-4d74-aa96-ab514bd56eaf None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:35.507847 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 464/941] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:11:35.512915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17e2c7-d219-41c3-976c-3befdd7b46a5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:35.513196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17e2c7-d219-41c3-976c-3befdd7b46a5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:35.513496 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17e2c7-d219-41c3-976c-3befdd7b46a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:35.522732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2a6db-7423-476b-97de-662d9d082bf5 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:35.536711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ce17e2c7-d219-41c3-976c-3befdd7b46a5 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:35.538514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ce17e2c7-d219-41c3-976c-3befdd7b46a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:35.559422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de08dd3-16ac-4757-8021-d92eaade008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:35.560038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de08dd3-16ac-4757-8021-d92eaade008d None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:35.560387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de08dd3-16ac-4757-8021-d92eaade008d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:35.560697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de08dd3-16ac-4757-8021-d92eaade008d None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:35.561493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de08dd3-16ac-4757-8021-d92eaade008d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:35.562943 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de08dd3-16ac-4757-8021-d92eaade008d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:35.565820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: WARNING keystone.server.flask.common [None req-9de08dd3-16ac-4757-8021-d92eaade008d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 26 18:11:35.585352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.sql.core [None req-9de08dd3-16ac-4757-8021-d92eaade008d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 18:11:35.585352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 18:11:35.585352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [parameters: {'id': 'bd77b509c2064017ba5e1f64ee1e97d9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 18:11:35.585352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81541) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-9de08dd3-16ac-4757-8021-d92eaade008d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bd77b509c2064017ba5e1f64ee1e97d9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bd77b509c2064017ba5e1f64ee1e97d9. Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application conn.query(q) Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 18:11:35.603870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application result.read() Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 26 18:11:35.604763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application next(self.gen) Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application yield resource Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application next(self.gen) Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise self.value Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application session.commit() Aug 26 18:11:35.605814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self.session.flush() Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application compat.raise_( Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 18:11:35.606712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 18:11:35.607654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application conn.query(q) Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application result.read() Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 18:11:35.610278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [parameters: {'id': 'bd77b509c2064017ba5e1f64ee1e97d9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:35.612375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:35.614380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:35.616637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:35.616637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 26 18:11:35.616637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 26 18:11:35.616637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:35.616637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:35.616637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 26 18:11:35.616637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 26 18:11:35.616637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bd77b509c2064017ba5e1f64ee1e97d9. Aug 26 18:11:35.616637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:35.616637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 478/942] 10.222.0.45 () {60 vars in 1140 bytes} [Fri Aug 26 18:11:35 2022] POST /identity/v3/projects => generated 262 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:35.616637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de08dd3-16ac-4757-8021-d92eaade008d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:35.636451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 465/943] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:11:35.714922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de08dd3-16ac-4757-8021-d92eaade008d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:35.736097 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:35.750483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b5702-1d33-4362-b1a5-9da768cf2ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:35.751533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b5702-1d33-4362-b1a5-9da768cf2ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:35.751808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b5702-1d33-4362-b1a5-9da768cf2ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:35.752118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b5702-1d33-4362-b1a5-9da768cf2ff4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:35.759239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b5702-1d33-4362-b1a5-9da768cf2ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:35.760929 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b5702-1d33-4362-b1a5-9da768cf2ff4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-180b5702-1d33-4362-b1a5-9da768cf2ff4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:35.772105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:35.773008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:35.774039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:35.774039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:35.774039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:35.774039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:35.774039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:35.774039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:35.774039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:35.774039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:35.774039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 479/944] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:35.779458 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17e2c7-d219-41c3-976c-3befdd7b46a5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:35.834808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:35.884836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17e2c7-d219-41c3-976c-3befdd7b46a5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:35.926987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818ef20-2156-4a0b-8c1d-a809c796ccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:35.928003 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818ef20-2156-4a0b-8c1d-a809c796ccc8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:35.928502 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818ef20-2156-4a0b-8c1d-a809c796ccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:35.929006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818ef20-2156-4a0b-8c1d-a809c796ccc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:35.929925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818ef20-2156-4a0b-8c1d-a809c796ccc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:35.930436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818ef20-2156-4a0b-8c1d-a809c796ccc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:35.932071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818ef20-2156-4a0b-8c1d-a809c796ccc8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:35.950510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 466/945] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:35.969642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b5702-1d33-4362-b1a5-9da768cf2ff4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:36.078924 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b5702-1d33-4362-b1a5-9da768cf2ff4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:36.120432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14824721-685c-43f6-90d7-cab5bf60152a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:36.121131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824721-685c-43f6-90d7-cab5bf60152a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:36.121409 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824721-685c-43f6-90d7-cab5bf60152a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:36.121702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824721-685c-43f6-90d7-cab5bf60152a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:36.122356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14824721-685c-43f6-90d7-cab5bf60152a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:36.123777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14824721-685c-43f6-90d7-cab5bf60152a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-14824721-685c-43f6-90d7-cab5bf60152a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:36.132972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:36.134018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:36.135005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 480/946] 10.222.0.45 () {56 vars in 1132 bytes} [Fri Aug 26 18:11:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:36.140235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818ef20-2156-4a0b-8c1d-a809c796ccc8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:36.244174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818ef20-2156-4a0b-8c1d-a809c796ccc8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:36.258325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:36.280740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1c4d8-05f7-431d-8d11-336dccd83462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:36.281369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1c4d8-05f7-431d-8d11-336dccd83462 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:36.281651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1c4d8-05f7-431d-8d11-336dccd83462 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:36.281925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1c4d8-05f7-431d-8d11-336dccd83462 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:36.282566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1c4d8-05f7-431d-8d11-336dccd83462 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:36.282870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1c4d8-05f7-431d-8d11-336dccd83462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:36.284261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1c4d8-05f7-431d-8d11-336dccd83462 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:36.289972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 467/947] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 26 18:11:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:36.295630 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14824721-685c-43f6-90d7-cab5bf60152a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:36.345158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:36.403401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14824721-685c-43f6-90d7-cab5bf60152a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:36.439079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52b7d0-6bd6-4219-ac01-0e1f84549292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:36.439762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b7d0-6bd6-4219-ac01-0e1f84549292 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:36.440368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b7d0-6bd6-4219-ac01-0e1f84549292 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:36.440657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b7d0-6bd6-4219-ac01-0e1f84549292 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:36.441352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52b7d0-6bd6-4219-ac01-0e1f84549292 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:36.441652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52b7d0-6bd6-4219-ac01-0e1f84549292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:36.443040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52b7d0-6bd6-4219-ac01-0e1f84549292 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:36.451626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 481/948] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 26 18:11:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:36.457297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1c4d8-05f7-431d-8d11-336dccd83462 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:36.583616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1c4d8-05f7-431d-8d11-336dccd83462 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:36.619468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cb6a3-bd58-4ff9-9171-2e5c9639e0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:36.620085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cb6a3-bd58-4ff9-9171-2e5c9639e0ae None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:36.620363 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cb6a3-bd58-4ff9-9171-2e5c9639e0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:36.620696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cb6a3-bd58-4ff9-9171-2e5c9639e0ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:36.621416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cb6a3-bd58-4ff9-9171-2e5c9639e0ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:36.622808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cb6a3-bd58-4ff9-9171-2e5c9639e0ae None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:36.645128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 468/949] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:11:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:11:36.793821 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be565a71-fd29-414a-a01f-b0572cb82b2c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:36.794005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be565a71-fd29-414a-a01f-b0572cb82b2c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:36.794278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be565a71-fd29-414a-a01f-b0572cb82b2c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:36.795854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 482/950] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:36.801414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca543b-92c8-4915-bec0-99d373747021 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:36.801686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca543b-92c8-4915-bec0-99d373747021 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:36.801951 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca543b-92c8-4915-bec0-99d373747021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:36.821702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-62ca543b-92c8-4915-bec0-99d373747021 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:36.822919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-62ca543b-92c8-4915-bec0-99d373747021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:36.851067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:36.899744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 469/951] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:37.168338 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be565a71-fd29-414a-a01f-b0572cb82b2c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:37.172431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03df3f-3466-46e3-b072-fd365f884602 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:37.172762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03df3f-3466-46e3-b072-fd365f884602 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:37.173037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03df3f-3466-46e3-b072-fd365f884602 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:37.174675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 470/952] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:37.179529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6f321-51f1-4d94-8b06-25496e6f306a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:37.179817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6f321-51f1-4d94-8b06-25496e6f306a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:37.180092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6f321-51f1-4d94-8b06-25496e6f306a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:37.198702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-48a6f321-51f1-4d94-8b06-25496e6f306a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:37.199886 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-48a6f321-51f1-4d94-8b06-25496e6f306a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:37.278487 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 471/953] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:11:37.286615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be565a71-fd29-414a-a01f-b0572cb82b2c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:37.298161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:37.321934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52a3b-0d7f-408f-8f2f-ce26ed36d544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:37.322578 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52a3b-0d7f-408f-8f2f-ce26ed36d544 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:37.322860 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52a3b-0d7f-408f-8f2f-ce26ed36d544 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:37.323137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52a3b-0d7f-408f-8f2f-ce26ed36d544 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:37.323729 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b52a3b-0d7f-408f-8f2f-ce26ed36d544 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:37.325157 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b52a3b-0d7f-408f-8f2f-ce26ed36d544 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-84b52a3b-0d7f-408f-8f2f-ce26ed36d544 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:37.334246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:37.335298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:37.336130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 483/954] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 26 18:11:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:37.341361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6f321-51f1-4d94-8b06-25496e6f306a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:37.433034 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:37.442834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6f321-51f1-4d94-8b06-25496e6f306a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:37.476449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912816f-aef2-468d-82ef-ab87847d7cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:37.477526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912816f-aef2-468d-82ef-ab87847d7cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:37.477806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912816f-aef2-468d-82ef-ab87847d7cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:37.478075 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912816f-aef2-468d-82ef-ab87847d7cb6 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:37.478713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912816f-aef2-468d-82ef-ab87847d7cb6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:37.479019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912816f-aef2-468d-82ef-ab87847d7cb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:37.480449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912816f-aef2-468d-82ef-ab87847d7cb6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:37.485815 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 472/955] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 26 18:11:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:37.494018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52a3b-0d7f-408f-8f2f-ce26ed36d544 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:37.554067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912816f-aef2-468d-82ef-ab87847d7cb6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:37.631234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52a3b-0d7f-408f-8f2f-ce26ed36d544 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:37.666316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44252c13-dd89-4c73-b969-5b94874b9cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:37.667298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44252c13-dd89-4c73-b969-5b94874b9cbe None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:37.667775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44252c13-dd89-4c73-b969-5b94874b9cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:37.668248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44252c13-dd89-4c73-b969-5b94874b9cbe None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:37.668826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912816f-aef2-468d-82ef-ab87847d7cb6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:37.669355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44252c13-dd89-4c73-b969-5b94874b9cbe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:37.670013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44252c13-dd89-4c73-b969-5b94874b9cbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:37.671810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44252c13-dd89-4c73-b969-5b94874b9cbe None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:37.677948 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 484/956] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 26 18:11:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:37.683223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44252c13-dd89-4c73-b969-5b94874b9cbe None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:37.710290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5c07-788d-4bb6-b9d0-d660fb3410e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:37.710937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5c07-788d-4bb6-b9d0-d660fb3410e7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:37.711220 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5c07-788d-4bb6-b9d0-d660fb3410e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:37.711496 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5c07-788d-4bb6-b9d0-d660fb3410e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:37.723029 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd5c07-788d-4bb6-b9d0-d660fb3410e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b6bd5c07-788d-4bb6-b9d0-d660fb3410e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:37.728806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:37.729763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:37.730626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 473/957] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Aug 26 18:11:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:37.737136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5c07-788d-4bb6-b9d0-d660fb3410e7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:37.738016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:37.754071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:37.817495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44252c13-dd89-4c73-b969-5b94874b9cbe None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:37.853765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd733e95-95cf-4fc6-b739-0774f8387ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:37.854533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd733e95-95cf-4fc6-b739-0774f8387ea6 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:37.854913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd733e95-95cf-4fc6-b739-0774f8387ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:37.855286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd733e95-95cf-4fc6-b739-0774f8387ea6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:37.856082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd733e95-95cf-4fc6-b739-0774f8387ea6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:37.857744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd733e95-95cf-4fc6-b739-0774f8387ea6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:37.873026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5c07-788d-4bb6-b9d0-d660fb3410e7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:37.886217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 485/958] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:11:37 2022] POST /identity/v3/endpoints => generated 349 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:11:37.921710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be30b35-1933-4fde-9bcd-217e81935482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:37.922687 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be30b35-1933-4fde-9bcd-217e81935482 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:37.923231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be30b35-1933-4fde-9bcd-217e81935482 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:37.923676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be30b35-1933-4fde-9bcd-217e81935482 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:37.924744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be30b35-1933-4fde-9bcd-217e81935482 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:37.925248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be30b35-1933-4fde-9bcd-217e81935482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:37.926833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be30b35-1933-4fde-9bcd-217e81935482 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:37.938180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 474/959] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 26 18:11:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:37.944402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd733e95-95cf-4fc6-b739-0774f8387ea6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:38.052265 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:38.063779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd733e95-95cf-4fc6-b739-0774f8387ea6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:38.104264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbed58-68d1-410c-b2f2-768feeaf2034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:38.104946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbed58-68d1-410c-b2f2-768feeaf2034 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:38.105248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbed58-68d1-410c-b2f2-768feeaf2034 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:38.105591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbed58-68d1-410c-b2f2-768feeaf2034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:38.117092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbed58-68d1-410c-b2f2-768feeaf2034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:38.118560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbed58-68d1-410c-b2f2-768feeaf2034 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:38.131188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c452a-cafd-4fcb-960a-6bca16edce48 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:38.131480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c452a-cafd-4fcb-960a-6bca16edce48 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:38.131759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c452a-cafd-4fcb-960a-6bca16edce48 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-29bbed58-68d1-410c-b2f2-768feeaf2034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:38.133438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:38.134396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:38.135303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:38.135303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:38.135303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:38.135476 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 475/960] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:11:38.135557 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 486/961] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:38.138606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f30dc-b113-4548-b3dd-18edc2ea6e28 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:38.138975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f30dc-b113-4548-b3dd-18edc2ea6e28 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:38.139158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f30dc-b113-4548-b3dd-18edc2ea6e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:38.142100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbed58-68d1-410c-b2f2-768feeaf2034 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:38.157191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1b1f30dc-b113-4548-b3dd-18edc2ea6e28 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:38.158544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1b1f30dc-b113-4548-b3dd-18edc2ea6e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:38.237573 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 476/962] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:38.265224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbed58-68d1-410c-b2f2-768feeaf2034 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:38.303683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf790a-39b3-4f97-9804-a2eff5b7c327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:38.304602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf790a-39b3-4f97-9804-a2eff5b7c327 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:38.305057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf790a-39b3-4f97-9804-a2eff5b7c327 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:38.305501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf790a-39b3-4f97-9804-a2eff5b7c327 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:38.306316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf790a-39b3-4f97-9804-a2eff5b7c327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:38.306767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf790a-39b3-4f97-9804-a2eff5b7c327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:38.308500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf790a-39b3-4f97-9804-a2eff5b7c327 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:38.322482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 487/963] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:38.330210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f30dc-b113-4548-b3dd-18edc2ea6e28 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:38.331439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:38.432516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f30dc-b113-4548-b3dd-18edc2ea6e28 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:38.467118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c114d8-4f9b-4dca-8ac5-21014a486d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:38.467757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c114d8-4f9b-4dca-8ac5-21014a486d16 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:38.468032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c114d8-4f9b-4dca-8ac5-21014a486d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:38.468298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c114d8-4f9b-4dca-8ac5-21014a486d16 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:38.475502 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c114d8-4f9b-4dca-8ac5-21014a486d16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:38.477278 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c114d8-4f9b-4dca-8ac5-21014a486d16 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b7c114d8-4f9b-4dca-8ac5-21014a486d16 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:38.489255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:38.490245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:38.491222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:38.491222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:38.491222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:38.491222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:38.491222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:38.491222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:38.491222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:38.491222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:38.491222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 18:11:38.491222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:38.491222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 477/964] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 26 18:11:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:38.496524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf790a-39b3-4f97-9804-a2eff5b7c327 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:38.500996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:38.535495 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c114d8-4f9b-4dca-8ac5-21014a486d16 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:38.604897 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf790a-39b3-4f97-9804-a2eff5b7c327 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:38.613088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:38.642622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc391dd0-b875-403d-ba39-a950cc532385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:38.643237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc391dd0-b875-403d-ba39-a950cc532385 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:38.643514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc391dd0-b875-403d-ba39-a950cc532385 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:38.643785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc391dd0-b875-403d-ba39-a950cc532385 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:38.644517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc391dd0-b875-403d-ba39-a950cc532385 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:38.644852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc391dd0-b875-403d-ba39-a950cc532385 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:38.646329 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc391dd0-b875-403d-ba39-a950cc532385 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:38.648637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c114d8-4f9b-4dca-8ac5-21014a486d16 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:38.663447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 488/965] 10.222.0.45 () {56 vars in 1149 bytes} [Fri Aug 26 18:11:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:38.669160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc711e-e34d-49f7-b055-864e463f3bcb None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:38.669449 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc711e-e34d-49f7-b055-864e463f3bcb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:38.669763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc711e-e34d-49f7-b055-864e463f3bcb None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:38.671026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 489/966] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:38.671726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc711e-e34d-49f7-b055-864e463f3bcb None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:38.687317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589d393-9458-4f5b-bf3f-9009d7970866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:38.688264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589d393-9458-4f5b-bf3f-9009d7970866 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:38.688756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589d393-9458-4f5b-bf3f-9009d7970866 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:38.689205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589d393-9458-4f5b-bf3f-9009d7970866 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:38.690163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589d393-9458-4f5b-bf3f-9009d7970866 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:38.691868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589d393-9458-4f5b-bf3f-9009d7970866 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:38.694756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: WARNING keystone.server.flask.common [None req-e589d393-9458-4f5b-bf3f-9009d7970866 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 26 18:11:38.707760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.sql.core [None req-e589d393-9458-4f5b-bf3f-9009d7970866 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 18:11:38.707760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 18:11:38.707760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [parameters: {'user_id': 'ad92241df4c64179b817ee92979acac5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 18:11:38.707760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81542) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-e589d393-9458-4f5b-bf3f-9009d7970866 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application conn.query(q) Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application result.read() Aug 26 18:11:38.715560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 18:11:38.716702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application next(self.gen) Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application yield resource Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application next(self.gen) Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise self.value Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application session.commit() Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 18:11:38.718221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.session.flush() Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application compat.raise_( Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 18:11:38.719400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 18:11:38.720291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application conn.query(q) Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application result.read() Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 18:11:38.721178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ad92241df4c64179b817ee92979acac5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:38.722150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 26 18:11:38.724742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 26 18:11:38.727745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 26 18:11:38.727745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 26 18:11:38.727745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 18:11:38.727745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 18:11:38.727745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 18:11:38.727745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:38.727745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 478/967] 10.222.0.45 () {60 vars in 1131 bytes} [Fri Aug 26 18:11:38 2022] POST /identity/v3/users => generated 160 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:38.727745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a46c0-5e3b-43f2-80df-4e2125da3523 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:38.727745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a46c0-5e3b-43f2-80df-4e2125da3523 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:38.727745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a46c0-5e3b-43f2-80df-4e2125da3523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:38.740452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-761a46c0-5e3b-43f2-80df-4e2125da3523 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:38.742163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-761a46c0-5e3b-43f2-80df-4e2125da3523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:38.748309 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:38.790620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc711e-e34d-49f7-b055-864e463f3bcb None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:38.813265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 479/968] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:38.821966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a46c0-5e3b-43f2-80df-4e2125da3523 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:38.825049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a48fb-df58-4001-9a41-490cb537bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:38.825667 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a48fb-df58-4001-9a41-490cb537bfa2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:38.826015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a48fb-df58-4001-9a41-490cb537bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:38.826292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a48fb-df58-4001-9a41-490cb537bfa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:38.892645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:38.900288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a48fb-df58-4001-9a41-490cb537bfa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:38.901798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a48fb-df58-4001-9a41-490cb537bfa2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:38.940663 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a46c0-5e3b-43f2-80df-4e2125da3523 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:38.964005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:38.976446 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380541-1a3d-4c19-ba3f-316cd435defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:38.977799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380541-1a3d-4c19-ba3f-316cd435defd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:38.978592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380541-1a3d-4c19-ba3f-316cd435defd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:38.979058 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380541-1a3d-4c19-ba3f-316cd435defd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:38.986997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb380541-1a3d-4c19-ba3f-316cd435defd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:38.989025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb380541-1a3d-4c19-ba3f-316cd435defd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-fb380541-1a3d-4c19-ba3f-316cd435defd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:39.001171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:39.002128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:39.003068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:39.003068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:39.003068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:39.003068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:39.003068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:39.003068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:39.003068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:39.003068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:39.003068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 18:11:39.003068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:39.005710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 480/969] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:11:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:39.009990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 490/970] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:11:39.015269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380541-1a3d-4c19-ba3f-316cd435defd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:39.016524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a48fb-df58-4001-9a41-490cb537bfa2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:39.133888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a48fb-df58-4001-9a41-490cb537bfa2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:39.139506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380541-1a3d-4c19-ba3f-316cd435defd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:39.154379 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:39.169795 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23866d04-d7a9-4d25-9977-1a6281a1198a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:39.170513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23866d04-d7a9-4d25-9977-1a6281a1198a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:39.170789 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23866d04-d7a9-4d25-9977-1a6281a1198a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:39.171065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23866d04-d7a9-4d25-9977-1a6281a1198a None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:39.171750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23866d04-d7a9-4d25-9977-1a6281a1198a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:39.172047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23866d04-d7a9-4d25-9977-1a6281a1198a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:39.173506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23866d04-d7a9-4d25-9977-1a6281a1198a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:39.176074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e8a7b-d8bc-4d88-a005-6eba60f2d9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:39.176704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e8a7b-d8bc-4d88-a005-6eba60f2d9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:39.177012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e8a7b-d8bc-4d88-a005-6eba60f2d9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:39.177286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e8a7b-d8bc-4d88-a005-6eba60f2d9e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:39.188044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e8a7b-d8bc-4d88-a005-6eba60f2d9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:39.189513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e8a7b-d8bc-4d88-a005-6eba60f2d9e0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ed8e8a7b-d8bc-4d88-a005-6eba60f2d9e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:39.204163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:39.205351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:39.206235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:39.206235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:39.206235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:39.206235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 481/971] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:39.206235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e8a7b-d8bc-4d88-a005-6eba60f2d9e0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:39.212324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 491/972] 10.222.0.45 () {56 vars in 1101 bytes} [Fri Aug 26 18:11:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:39.213421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23866d04-d7a9-4d25-9977-1a6281a1198a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:39.241713 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:39.317393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e8a7b-d8bc-4d88-a005-6eba60f2d9e0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:39.333400 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23866d04-d7a9-4d25-9977-1a6281a1198a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:39.355292 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f6720-7c17-4302-b9e3-accfc060d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:39.355998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6720-7c17-4302-b9e3-accfc060d2eb None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:39.356288 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6720-7c17-4302-b9e3-accfc060d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:39.356496 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6720-7c17-4302-b9e3-accfc060d2eb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:39.357218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f6720-7c17-4302-b9e3-accfc060d2eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:39.359456 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f6720-7c17-4302-b9e3-accfc060d2eb None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-471f6720-7c17-4302-b9e3-accfc060d2eb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:39.369340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:39.370952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:39.372369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 482/973] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:39.380386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f6720-7c17-4302-b9e3-accfc060d2eb None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:39.388177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a07f6-e2eb-4077-a3f1-10060e06573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:39.388878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a07f6-e2eb-4077-a3f1-10060e06573e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:39.389159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a07f6-e2eb-4077-a3f1-10060e06573e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:39.389433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a07f6-e2eb-4077-a3f1-10060e06573e None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:39.390082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a07f6-e2eb-4077-a3f1-10060e06573e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:39.390383 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a07f6-e2eb-4077-a3f1-10060e06573e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:39.392561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a07f6-e2eb-4077-a3f1-10060e06573e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:39.404379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 492/974] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:39.411562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a07f6-e2eb-4077-a3f1-10060e06573e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:39.426742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:39.513287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:39.518121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f6720-7c17-4302-b9e3-accfc060d2eb None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:39.541213 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a07f6-e2eb-4077-a3f1-10060e06573e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:39.554781 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6de3d9-24a0-422c-af55-d4ebd6e37a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:39.555469 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6de3d9-24a0-422c-af55-d4ebd6e37a56 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:39.555825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6de3d9-24a0-422c-af55-d4ebd6e37a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:39.556191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6de3d9-24a0-422c-af55-d4ebd6e37a56 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:39.556978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6de3d9-24a0-422c-af55-d4ebd6e37a56 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:39.557362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6de3d9-24a0-422c-af55-d4ebd6e37a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:39.558819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6de3d9-24a0-422c-af55-d4ebd6e37a56 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:39.566760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 483/975] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:39.572197 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6de3d9-24a0-422c-af55-d4ebd6e37a56 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:39.578166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e6c40-5d5b-47cf-8ff4-5064c37ee8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:39.578811 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e6c40-5d5b-47cf-8ff4-5064c37ee8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:39.579086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e6c40-5d5b-47cf-8ff4-5064c37ee8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:39.579351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e6c40-5d5b-47cf-8ff4-5064c37ee8c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:39.587567 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e6c40-5d5b-47cf-8ff4-5064c37ee8c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:39.589063 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e6c40-5d5b-47cf-8ff4-5064c37ee8c3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-088e6c40-5d5b-47cf-8ff4-5064c37ee8c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:39.601080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:39.602482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:39.603390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:39.603390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:39.603390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:39.603390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:39.603390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:39.603390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:39.603390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:39.603390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:39.603390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 493/976] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:39.609188 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e6c40-5d5b-47cf-8ff4-5064c37ee8c3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:39.677608 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:39.689579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6de3d9-24a0-422c-af55-d4ebd6e37a56 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:39.717764 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e6c40-5d5b-47cf-8ff4-5064c37ee8c3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:39.730422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271523d8-4b33-42e8-ab1b-8f20c8bb8adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:39.731038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271523d8-4b33-42e8-ab1b-8f20c8bb8adc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:39.731312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271523d8-4b33-42e8-ab1b-8f20c8bb8adc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:39.731582 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271523d8-4b33-42e8-ab1b-8f20c8bb8adc None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:39.732266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271523d8-4b33-42e8-ab1b-8f20c8bb8adc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:39.732564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271523d8-4b33-42e8-ab1b-8f20c8bb8adc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:39.733982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271523d8-4b33-42e8-ab1b-8f20c8bb8adc None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:39.748756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 484/977] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:39.765883 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ede83-07fa-4fbd-9c8b-a128d628618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:39.766607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ede83-07fa-4fbd-9c8b-a128d628618d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:39.766952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ede83-07fa-4fbd-9c8b-a128d628618d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:39.767309 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ede83-07fa-4fbd-9c8b-a128d628618d None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:39.768099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ede83-07fa-4fbd-9c8b-a128d628618d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:39.768466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ede83-07fa-4fbd-9c8b-a128d628618d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:39.770076 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ede83-07fa-4fbd-9c8b-a128d628618d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:39.781441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:39.789514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 494/978] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:39.791327 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271523d8-4b33-42e8-ab1b-8f20c8bb8adc None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:39.902967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271523d8-4b33-42e8-ab1b-8f20c8bb8adc None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:39.905122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0407d0-3324-4495-9936-cee612f21290 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:39.905414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0407d0-3324-4495-9936-cee612f21290 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:39.905689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0407d0-3324-4495-9936-cee612f21290 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:39.907060 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 495/979] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:11:39.912247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02481b6-f09e-47ad-9fbf-639c9a02a835 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:39.912530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02481b6-f09e-47ad-9fbf-639c9a02a835 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:39.912830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02481b6-f09e-47ad-9fbf-639c9a02a835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:39.930957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b02481b6-f09e-47ad-9fbf-639c9a02a835 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:39.932498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b02481b6-f09e-47ad-9fbf-639c9a02a835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:39.938872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5dc6f-1478-4d8d-854e-b7bd9f23169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:39.939483 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5dc6f-1478-4d8d-854e-b7bd9f23169b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:39.939757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5dc6f-1478-4d8d-854e-b7bd9f23169b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:39.940036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5dc6f-1478-4d8d-854e-b7bd9f23169b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:39.940759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5dc6f-1478-4d8d-854e-b7bd9f23169b None admin] RBAC: Adding query filter params (role.id=5b7184a41c574ff3851c31ce9496e8ae, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=7626e0cf57a74281b3cf5f3b31b5b79a) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:39.941077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5dc6f-1478-4d8d-854e-b7bd9f23169b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:39.942485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5dc6f-1478-4d8d-854e-b7bd9f23169b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:39.948593 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 485/980] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:39 2022] GET /identity/v3/role_assignments?user.id=7626e0cf57a74281b3cf5f3b31b5b79a&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5b7184a41c574ff3851c31ce9496e8ae => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:40.006922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 496/981] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:11:40.272222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5dc6f-1478-4d8d-854e-b7bd9f23169b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:40.298562 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:40.377756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5dc6f-1478-4d8d-854e-b7bd9f23169b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:40.414462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631f8da-208d-458d-b6dc-4f0464b452c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:40.415369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f8da-208d-458d-b6dc-4f0464b452c4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:40.415827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f8da-208d-458d-b6dc-4f0464b452c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:40.416245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f8da-208d-458d-b6dc-4f0464b452c4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:40.417027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631f8da-208d-458d-b6dc-4f0464b452c4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:40.418577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631f8da-208d-458d-b6dc-4f0464b452c4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-e631f8da-208d-458d-b6dc-4f0464b452c4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:40.427650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:40.428889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:40.429952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:40.432012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 486/982] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 26 18:11:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:40.438222 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02481b6-f09e-47ad-9fbf-639c9a02a835 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:40.550916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02481b6-f09e-47ad-9fbf-639c9a02a835 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:40.581429 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:40.587834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29584ca6-090d-429e-80ed-0496f1ae23c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:40.588452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29584ca6-090d-429e-80ed-0496f1ae23c6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:40.588741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29584ca6-090d-429e-80ed-0496f1ae23c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:40.589037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29584ca6-090d-429e-80ed-0496f1ae23c6 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:40.589735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29584ca6-090d-429e-80ed-0496f1ae23c6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:40.590043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29584ca6-090d-429e-80ed-0496f1ae23c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:40.591443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29584ca6-090d-429e-80ed-0496f1ae23c6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:40.596641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 497/983] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 26 18:11:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:40.602601 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631f8da-208d-458d-b6dc-4f0464b452c4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:40.688383 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:40.704907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631f8da-208d-458d-b6dc-4f0464b452c4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:40.739407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0dc51-7bd4-43bc-bb2d-8b4636606547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:40.740018 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0dc51-7bd4-43bc-bb2d-8b4636606547 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:40.740295 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0dc51-7bd4-43bc-bb2d-8b4636606547 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:40.740622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0dc51-7bd4-43bc-bb2d-8b4636606547 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:40.741295 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0dc51-7bd4-43bc-bb2d-8b4636606547 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:40.741598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0dc51-7bd4-43bc-bb2d-8b4636606547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:40.742970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0dc51-7bd4-43bc-bb2d-8b4636606547 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:40.748225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 487/984] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 26 18:11:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:40.753955 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29584ca6-090d-429e-80ed-0496f1ae23c6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:40.861930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29584ca6-090d-429e-80ed-0496f1ae23c6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:40.895654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bf70b-22c7-40e3-ac28-0e283c001823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:40.896268 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bf70b-22c7-40e3-ac28-0e283c001823 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:40.896550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bf70b-22c7-40e3-ac28-0e283c001823 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:40.896855 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bf70b-22c7-40e3-ac28-0e283c001823 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:40.897568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bf70b-22c7-40e3-ac28-0e283c001823 None admin] RBAC: Adding query filter params (interface=admin, service_id=5a25d607636147ed83ed4bd9036c2750, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:40.897882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bf70b-22c7-40e3-ac28-0e283c001823 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:40.899272 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bf70b-22c7-40e3-ac28-0e283c001823 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:40.904637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 498/985] 10.222.0.45 () {56 vars in 1249 bytes} [Fri Aug 26 18:11:40 2022] GET /identity/v3/endpoints?service_id=5a25d607636147ed83ed4bd9036c2750&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:40.910162 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0dc51-7bd4-43bc-bb2d-8b4636606547 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:41.012805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0dc51-7bd4-43bc-bb2d-8b4636606547 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:41.048747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84761b78-cbac-4ed4-bf17-c2562e7e7672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:41.049403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761b78-cbac-4ed4-bf17-c2562e7e7672 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:41.049683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761b78-cbac-4ed4-bf17-c2562e7e7672 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:41.049957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761b78-cbac-4ed4-bf17-c2562e7e7672 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:41.050568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84761b78-cbac-4ed4-bf17-c2562e7e7672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:41.051983 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84761b78-cbac-4ed4-bf17-c2562e7e7672 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:41.058377 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 488/986] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 26 18:11:40 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:11:41.641384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cbf09-6648-44b6-9c82-4abf4a8cdc43 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:41.641923 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cbf09-6648-44b6-9c82-4abf4a8cdc43 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:41.641923 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cbf09-6648-44b6-9c82-4abf4a8cdc43 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:41.643414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 499/987] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:41.648645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea04897-c57f-47ac-a445-00c849071355 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:41.649179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea04897-c57f-47ac-a445-00c849071355 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:41.649179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea04897-c57f-47ac-a445-00c849071355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:41.667712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fea04897-c57f-47ac-a445-00c849071355 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:41.668915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fea04897-c57f-47ac-a445-00c849071355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:41.679259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:41.739737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 489/988] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:41.858622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f45755-90c6-4bab-b888-68f5df040f07 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:41.858812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f45755-90c6-4bab-b888-68f5df040f07 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:41.859073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f45755-90c6-4bab-b888-68f5df040f07 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:41.860595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 500/989] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:41.865723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0154d-72c8-426c-852d-8b5b84bf70fa None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:41.866017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0154d-72c8-426c-852d-8b5b84bf70fa None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:41.866293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0154d-72c8-426c-852d-8b5b84bf70fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:41.885037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-76b0154d-72c8-426c-852d-8b5b84bf70fa None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:41.886225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-76b0154d-72c8-426c-852d-8b5b84bf70fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:41.955744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 490/990] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:42.001486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f45755-90c6-4bab-b888-68f5df040f07 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:42.062646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:42.107032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f45755-90c6-4bab-b888-68f5df040f07 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:42.144862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff93a3-465c-49d4-a008-ee7373131df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:42.145387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff93a3-465c-49d4-a008-ee7373131df6 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:42.145659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff93a3-465c-49d4-a008-ee7373131df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:42.145922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff93a3-465c-49d4-a008-ee7373131df6 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:42.146561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff93a3-465c-49d4-a008-ee7373131df6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:42.147938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff93a3-465c-49d4-a008-ee7373131df6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:42.165073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 501/991] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:11:42 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:11:42.226670 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0154d-72c8-426c-852d-8b5b84bf70fa None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:42.305641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:42.334791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0154d-72c8-426c-852d-8b5b84bf70fa None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:42.377650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ddaf5-3702-42d7-988e-c79301e94ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:42.378297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ddaf5-3702-42d7-988e-c79301e94ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:42.378579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ddaf5-3702-42d7-988e-c79301e94ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:42.378854 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ddaf5-3702-42d7-988e-c79301e94ac3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:42.379444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ddaf5-3702-42d7-988e-c79301e94ac3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:42.380842 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ddaf5-3702-42d7-988e-c79301e94ac3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-df0ddaf5-3702-42d7-988e-c79301e94ac3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:42.389817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:42.390844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:42.392314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 491/992] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Aug 26 18:11:42 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:42.397187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff93a3-465c-49d4-a008-ee7373131df6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:42.507772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff93a3-465c-49d4-a008-ee7373131df6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:42.527804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:42.546669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298fb93-df43-40ad-8e00-11b83235444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:42.547288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298fb93-df43-40ad-8e00-11b83235444e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:42.547562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298fb93-df43-40ad-8e00-11b83235444e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:42.547829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298fb93-df43-40ad-8e00-11b83235444e None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:42.548456 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298fb93-df43-40ad-8e00-11b83235444e None admin] RBAC: Adding query filter params (name=image) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:42.548752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298fb93-df43-40ad-8e00-11b83235444e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:42.550153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298fb93-df43-40ad-8e00-11b83235444e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:42.555379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 502/993] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:42.561247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ddaf5-3702-42d7-988e-c79301e94ac3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:42.668851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ddaf5-3702-42d7-988e-c79301e94ac3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:42.704046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f0f26-6688-4967-a26d-992c1627dbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:42.704655 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f0f26-6688-4967-a26d-992c1627dbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:42.704949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f0f26-6688-4967-a26d-992c1627dbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:42.705221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f0f26-6688-4967-a26d-992c1627dbb7 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:42.705862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f0f26-6688-4967-a26d-992c1627dbb7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:42.706167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f0f26-6688-4967-a26d-992c1627dbb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:42.707540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f0f26-6688-4967-a26d-992c1627dbb7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:42.708872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:42.713581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 492/994] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:42.949174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b862d-ac6a-4f66-b8dc-58174ea1c742 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:42.949714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b862d-ac6a-4f66-b8dc-58174ea1c742 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:42.949714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b862d-ac6a-4f66-b8dc-58174ea1c742 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:42.951238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 503/995] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:42.956345 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91202e-259e-4312-be7c-6345c0dc6fde None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:42.956637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91202e-259e-4312-be7c-6345c0dc6fde None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:42.956960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91202e-259e-4312-be7c-6345c0dc6fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:42.975647 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1b91202e-259e-4312-be7c-6345c0dc6fde None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:42.976863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1b91202e-259e-4312-be7c-6345c0dc6fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:43.055014 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 493/996] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:43.315918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b862d-ac6a-4f66-b8dc-58174ea1c742 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:43.423256 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b862d-ac6a-4f66-b8dc-58174ea1c742 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:43.456821 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716074a-152a-4049-8645-bf22e8f253d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:43.457456 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716074a-152a-4049-8645-bf22e8f253d3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:43.457735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716074a-152a-4049-8645-bf22e8f253d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:43.458008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716074a-152a-4049-8645-bf22e8f253d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:43.458597 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716074a-152a-4049-8645-bf22e8f253d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:43.459980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716074a-152a-4049-8645-bf22e8f253d3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3716074a-152a-4049-8645-bf22e8f253d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:43.468677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:43.469702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:43.473780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 504/997] 10.222.0.45 () {56 vars in 1126 bytes} [Fri Aug 26 18:11:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:43.475951 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91202e-259e-4312-be7c-6345c0dc6fde None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:43.587736 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91202e-259e-4312-be7c-6345c0dc6fde None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:43.614619 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:43.623873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3625471-15f0-480d-9205-f8bcc42d3606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:43.624494 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625471-15f0-480d-9205-f8bcc42d3606 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:43.624807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625471-15f0-480d-9205-f8bcc42d3606 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:43.625086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625471-15f0-480d-9205-f8bcc42d3606 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:43.625724 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3625471-15f0-480d-9205-f8bcc42d3606 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:43.626031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3625471-15f0-480d-9205-f8bcc42d3606 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:43.627399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3625471-15f0-480d-9205-f8bcc42d3606 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:43.632770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 494/998] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 26 18:11:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:43.638439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716074a-152a-4049-8645-bf22e8f253d3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:43.686469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:43.744223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716074a-152a-4049-8645-bf22e8f253d3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:43.781914 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c6418-4b54-483b-8ae3-1aa365af8907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:43.782533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c6418-4b54-483b-8ae3-1aa365af8907 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:43.782815 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c6418-4b54-483b-8ae3-1aa365af8907 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:43.783080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c6418-4b54-483b-8ae3-1aa365af8907 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:43.783715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c6418-4b54-483b-8ae3-1aa365af8907 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:43.784017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c6418-4b54-483b-8ae3-1aa365af8907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:43.785423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c6418-4b54-483b-8ae3-1aa365af8907 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:43.790554 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 505/999] 10.222.0.45 () {56 vars in 1122 bytes} [Fri Aug 26 18:11:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:43.796178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3625471-15f0-480d-9205-f8bcc42d3606 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:43.894686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3625471-15f0-480d-9205-f8bcc42d3606 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:43.928244 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7220b99-e4aa-4747-a4e3-19ebf7d41d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:43.928900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7220b99-e4aa-4747-a4e3-19ebf7d41d75 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:43.929166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7220b99-e4aa-4747-a4e3-19ebf7d41d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:43.929440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7220b99-e4aa-4747-a4e3-19ebf7d41d75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:43.930121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7220b99-e4aa-4747-a4e3-19ebf7d41d75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:43.931495 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7220b99-e4aa-4747-a4e3-19ebf7d41d75 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:43.949647 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 495/1000] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:11:43 2022] POST /identity/v3/endpoints => generated 325 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:11:44.088941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9796abd-ed7e-477b-8a49-8d1d7327538a None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:44.089457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9796abd-ed7e-477b-8a49-8d1d7327538a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:44.089563 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9796abd-ed7e-477b-8a49-8d1d7327538a None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:44.090855 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 506/1001] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:44.096641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b16bb4-a746-4068-ba2b-7ca8bda2a400 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:44.096967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b16bb4-a746-4068-ba2b-7ca8bda2a400 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:44.097275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b16bb4-a746-4068-ba2b-7ca8bda2a400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:44.116321 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-58b16bb4-a746-4068-ba2b-7ca8bda2a400 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:44.117539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-58b16bb4-a746-4068-ba2b-7ca8bda2a400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:44.166428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:44.194103 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 496/1002] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:44.455229 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9796abd-ed7e-477b-8a49-8d1d7327538a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:44.568862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9796abd-ed7e-477b-8a49-8d1d7327538a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:44.581951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:44.582569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1598-a3da-4abe-b99d-d1cbd7ca8e92 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:44.582856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1598-a3da-4abe-b99d-d1cbd7ca8e92 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:44.583147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1598-a3da-4abe-b99d-d1cbd7ca8e92 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:44.584505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 497/1003] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:11:44.589779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348012a-1367-4632-9f17-6693832a9f3e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:44.590183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348012a-1367-4632-9f17-6693832a9f3e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:44.590544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348012a-1367-4632-9f17-6693832a9f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:44.607480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b73d-c641-4c08-b1f3-c8ef3f7c34e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:44.608110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b73d-c641-4c08-b1f3-c8ef3f7c34e8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:44.608383 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b73d-c641-4c08-b1f3-c8ef3f7c34e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:44.608648 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b73d-c641-4c08-b1f3-c8ef3f7c34e8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:44.609255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4b73d-c641-4c08-b1f3-c8ef3f7c34e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:44.609948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a348012a-1367-4632-9f17-6693832a9f3e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:44.610625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4b73d-c641-4c08-b1f3-c8ef3f7c34e8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:44.611172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a348012a-1367-4632-9f17-6693832a9f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-2cd4b73d-c641-4c08-b1f3-c8ef3f7c34e8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:44.624043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:44.625106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 18:11:44.625957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:44.626721 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 507/1004] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:44.634381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b73d-c641-4c08-b1f3-c8ef3f7c34e8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:44.689167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 498/1005] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:11:44.737544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b73d-c641-4c08-b1f3-c8ef3f7c34e8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:44.770423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067228-e7df-46e3-b9af-f72803c22444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:44.771032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067228-e7df-46e3-b9af-f72803c22444 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:44.771309 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067228-e7df-46e3-b9af-f72803c22444 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:44.771578 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067228-e7df-46e3-b9af-f72803c22444 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:44.772189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55067228-e7df-46e3-b9af-f72803c22444 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:44.772492 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55067228-e7df-46e3-b9af-f72803c22444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:44.773925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55067228-e7df-46e3-b9af-f72803c22444 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:44.778753 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 508/1006] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:44.784526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348012a-1367-4632-9f17-6693832a9f3e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:44.889713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348012a-1367-4632-9f17-6693832a9f3e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:44.900596 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:44.926825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848909c-17c1-42ab-bc43-a1c622739ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:44.927439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848909c-17c1-42ab-bc43-a1c622739ebd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:44.927715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848909c-17c1-42ab-bc43-a1c622739ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:44.927987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848909c-17c1-42ab-bc43-a1c622739ebd None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:44.928626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848909c-17c1-42ab-bc43-a1c622739ebd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:44.928960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848909c-17c1-42ab-bc43-a1c622739ebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:44.930345 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848909c-17c1-42ab-bc43-a1c622739ebd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:44.935411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 499/1007] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:44.941248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067228-e7df-46e3-b9af-f72803c22444 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:44.949260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848909c-17c1-42ab-bc43-a1c622739ebd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:44.983385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:45.050333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067228-e7df-46e3-b9af-f72803c22444 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:45.055998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848909c-17c1-42ab-bc43-a1c622739ebd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:45.084882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9f2d2-bd02-44f4-926f-ef1f39287313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:45.085498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9f2d2-bd02-44f4-926f-ef1f39287313 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:45.085776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9f2d2-bd02-44f4-926f-ef1f39287313 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:45.086053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9f2d2-bd02-44f4-926f-ef1f39287313 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:45.086755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9f2d2-bd02-44f4-926f-ef1f39287313 None admin] RBAC: Adding query filter params (interface=public, service_id=cd0de7b2fb1d47599867fd0805fe918b, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:45.087060 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9f2d2-bd02-44f4-926f-ef1f39287313 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:45.088454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9f2d2-bd02-44f4-926f-ef1f39287313 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:45.091245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b446ade-b280-4cdb-bc1d-147bc386af02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:45.092107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b446ade-b280-4cdb-bc1d-147bc386af02 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:45.092568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b446ade-b280-4cdb-bc1d-147bc386af02 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:45.093033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b446ade-b280-4cdb-bc1d-147bc386af02 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:45.093615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 509/1008] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 26 18:11:44 2022] GET /identity/v3/endpoints?service_id=cd0de7b2fb1d47599867fd0805fe918b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:45.094410 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b446ade-b280-4cdb-bc1d-147bc386af02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:45.095777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b446ade-b280-4cdb-bc1d-147bc386af02 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:45.099069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9f2d2-bd02-44f4-926f-ef1f39287313 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:45.116757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 500/1009] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:11:44 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:11:45.212300 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9f2d2-bd02-44f4-926f-ef1f39287313 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:45.213950 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:45.257054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aad1a-653d-40ad-bb9c-ea716b574188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:45.257263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aad1a-653d-40ad-bb9c-ea716b574188 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:45.257545 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aad1a-653d-40ad-bb9c-ea716b574188 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:45.257818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aad1a-653d-40ad-bb9c-ea716b574188 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:45.258824 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aad1a-653d-40ad-bb9c-ea716b574188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:45.259782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aad1a-653d-40ad-bb9c-ea716b574188 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:45.267732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 510/1010] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 26 18:11:45 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:11:45.885211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5078cef-f023-422b-8ea8-7fec44dafbd0 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:45.885566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5078cef-f023-422b-8ea8-7fec44dafbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:45.885684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5078cef-f023-422b-8ea8-7fec44dafbd0 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:45.887105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 501/1011] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:45.892570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8ca95-9c92-4a99-9c8f-91fcba2be2b3 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:45.892895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8ca95-9c92-4a99-9c8f-91fcba2be2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:45.893137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8ca95-9c92-4a99-9c8f-91fcba2be2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:45.911283 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a5f8ca95-9c92-4a99-9c8f-91fcba2be2b3 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:45.912463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a5f8ca95-9c92-4a99-9c8f-91fcba2be2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:45.979502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 511/1012] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:45 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:46.239652 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5078cef-f023-422b-8ea8-7fec44dafbd0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:46.271739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:46.346392 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5078cef-f023-422b-8ea8-7fec44dafbd0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:46.379655 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb885fa-9bb5-48da-b5ba-1c0013d514e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:46.380281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb885fa-9bb5-48da-b5ba-1c0013d514e1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:46.380555 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb885fa-9bb5-48da-b5ba-1c0013d514e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:46.380854 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb885fa-9bb5-48da-b5ba-1c0013d514e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:46.381953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb885fa-9bb5-48da-b5ba-1c0013d514e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:46.383375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb885fa-9bb5-48da-b5ba-1c0013d514e1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:46.385137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 502/1013] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:46.390965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8ca95-9c92-4a99-9c8f-91fcba2be2b3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:46.486238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:46.497099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8ca95-9c92-4a99-9c8f-91fcba2be2b3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:46.536863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc2757-3f63-463c-af1c-33c46b2d3208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:46.537492 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc2757-3f63-463c-af1c-33c46b2d3208 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:46.537772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc2757-3f63-463c-af1c-33c46b2d3208 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:46.538046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc2757-3f63-463c-af1c-33c46b2d3208 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:46.538701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc2757-3f63-463c-af1c-33c46b2d3208 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:46.540152 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc2757-3f63-463c-af1c-33c46b2d3208 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:46.571743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 512/1014] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:11:46 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:11:47.042949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58877159-83dc-459f-9f20-371f6a2e1f42 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:47.043172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58877159-83dc-459f-9f20-371f6a2e1f42 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:47.043479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58877159-83dc-459f-9f20-371f6a2e1f42 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:47.045382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 503/1015] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:47.050598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbca271-f675-4498-a17d-9e7e5e60c271 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:47.050944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbca271-f675-4498-a17d-9e7e5e60c271 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:47.051223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbca271-f675-4498-a17d-9e7e5e60c271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:47.070780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3fbca271-f675-4498-a17d-9e7e5e60c271 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:47.071969 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3fbca271-f675-4498-a17d-9e7e5e60c271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:47.140683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15334e38-a4be-40e6-9644-8185898a25c1 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:47.140969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15334e38-a4be-40e6-9644-8185898a25c1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:47.141404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15334e38-a4be-40e6-9644-8185898a25c1 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:47.142913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 504/1016] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:11:47.147588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 513/1017] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:47 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:47.148959 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5851-c486-429f-96c6-01cf738af737 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:47.149250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5851-c486-429f-96c6-01cf738af737 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:47.149525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5851-c486-429f-96c6-01cf738af737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:47.168190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-690f5851-c486-429f-96c6-01cf738af737 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:47.169450 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-690f5851-c486-429f-96c6-01cf738af737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:47.240199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 505/1018] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:47 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:47.407708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbca271-f675-4498-a17d-9e7e5e60c271 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:47.487892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:47.513021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f5851-c486-429f-96c6-01cf738af737 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:47.518535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbca271-f675-4498-a17d-9e7e5e60c271 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:47.546794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:47.556770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5426b4-7a8b-4380-a526-b199d2c231a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:47.557428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5426b4-7a8b-4380-a526-b199d2c231a8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:47.558163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5426b4-7a8b-4380-a526-b199d2c231a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:47.558431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5426b4-7a8b-4380-a526-b199d2c231a8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:47.559014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5426b4-7a8b-4380-a526-b199d2c231a8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:47.561160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5426b4-7a8b-4380-a526-b199d2c231a8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-2b5426b4-7a8b-4380-a526-b199d2c231a8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:47.570526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:47.571632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:47.572497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 514/1019] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Aug 26 18:11:47 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:47.577627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5426b4-7a8b-4380-a526-b199d2c231a8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:47.622756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f5851-c486-429f-96c6-01cf738af737 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:47.662135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2a65f-12eb-4bc0-b9b2-a0700fc87d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:47.662784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2a65f-12eb-4bc0-b9b2-a0700fc87d2b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:47.662967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2a65f-12eb-4bc0-b9b2-a0700fc87d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:47.663237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2a65f-12eb-4bc0-b9b2-a0700fc87d2b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:47.663823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2a65f-12eb-4bc0-b9b2-a0700fc87d2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:47.665238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2a65f-12eb-4bc0-b9b2-a0700fc87d2b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-aae2a65f-12eb-4bc0-b9b2-a0700fc87d2b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:47.674102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:47.675176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:47.676022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 506/1020] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:47.681543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2a65f-12eb-4bc0-b9b2-a0700fc87d2b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:47.688025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5426b4-7a8b-4380-a526-b199d2c231a8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:47.723452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc0437-d25b-4ed5-a102-a04cc9dd1a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:47.724064 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc0437-d25b-4ed5-a102-a04cc9dd1a1f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:47.724344 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc0437-d25b-4ed5-a102-a04cc9dd1a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:47.724736 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc0437-d25b-4ed5-a102-a04cc9dd1a1f None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:47.725388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc0437-d25b-4ed5-a102-a04cc9dd1a1f None admin] RBAC: Adding query filter params (name=image) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:47.725689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc0437-d25b-4ed5-a102-a04cc9dd1a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:47.727198 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc0437-d25b-4ed5-a102-a04cc9dd1a1f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:47.737797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 515/1021] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:47.738481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc0437-d25b-4ed5-a102-a04cc9dd1a1f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:47.742719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:47.779427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:47.788047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2a65f-12eb-4bc0-b9b2-a0700fc87d2b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:47.824784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930fbd4-f491-423a-8caf-80840cf8aafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:47.825499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930fbd4-f491-423a-8caf-80840cf8aafd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:47.826028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930fbd4-f491-423a-8caf-80840cf8aafd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:47.826028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930fbd4-f491-423a-8caf-80840cf8aafd None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:47.826705 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930fbd4-f491-423a-8caf-80840cf8aafd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:47.827010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930fbd4-f491-423a-8caf-80840cf8aafd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:47.828385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930fbd4-f491-423a-8caf-80840cf8aafd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:47.833581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 507/1022] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:47.839148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930fbd4-f491-423a-8caf-80840cf8aafd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:47.846295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc0437-d25b-4ed5-a102-a04cc9dd1a1f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:47.884079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7268e42-7aa6-4870-ab13-c010b8ed2296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:47.885112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7268e42-7aa6-4870-ab13-c010b8ed2296 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:47.885548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7268e42-7aa6-4870-ab13-c010b8ed2296 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:47.885886 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7268e42-7aa6-4870-ab13-c010b8ed2296 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:47.886514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7268e42-7aa6-4870-ab13-c010b8ed2296 None admin] RBAC: Adding query filter params (type=image) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:47.886870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7268e42-7aa6-4870-ab13-c010b8ed2296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:47.888439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7268e42-7aa6-4870-ab13-c010b8ed2296 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:47.894455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 516/1023] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:47.900081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7268e42-7aa6-4870-ab13-c010b8ed2296 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:47.948157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930fbd4-f491-423a-8caf-80840cf8aafd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:47.973889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:47.984251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658444b-1640-438b-bb40-6a06a68b97fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:47.984902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658444b-1640-438b-bb40-6a06a68b97fa None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:47.985183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658444b-1640-438b-bb40-6a06a68b97fa None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:47.985456 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658444b-1640-438b-bb40-6a06a68b97fa None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:47.986432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658444b-1640-438b-bb40-6a06a68b97fa None admin] RBAC: Adding query filter params (type=compute) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:47.986432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658444b-1640-438b-bb40-6a06a68b97fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:47.987777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658444b-1640-438b-bb40-6a06a68b97fa None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:47.992568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 508/1024] 10.222.0.45 () {56 vars in 1112 bytes} [Fri Aug 26 18:11:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:47.998233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658444b-1640-438b-bb40-6a06a68b97fa None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:48.013772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7268e42-7aa6-4870-ab13-c010b8ed2296 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:48.022144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:48.050917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c825ed-59ca-45bd-a741-a88972c7fc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:48.051533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c825ed-59ca-45bd-a741-a88972c7fc7f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:48.051812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c825ed-59ca-45bd-a741-a88972c7fc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:48.052082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c825ed-59ca-45bd-a741-a88972c7fc7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:48.052889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c825ed-59ca-45bd-a741-a88972c7fc7f None admin] RBAC: Adding query filter params (interface=public, service_id=9f75cf779b8a41949e5c1ab37741003f, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:48.053114 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c825ed-59ca-45bd-a741-a88972c7fc7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:48.054651 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c825ed-59ca-45bd-a741-a88972c7fc7f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:48.059827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 517/1025] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 26 18:11:47 2022] GET /identity/v3/endpoints?service_id=9f75cf779b8a41949e5c1ab37741003f&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:48.065296 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c825ed-59ca-45bd-a741-a88972c7fc7f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:48.107954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658444b-1640-438b-bb40-6a06a68b97fa None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:48.143884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3ad05-e75d-4c99-9857-547c2adf959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:48.144467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3ad05-e75d-4c99-9857-547c2adf959b None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:48.144771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3ad05-e75d-4c99-9857-547c2adf959b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:48.145048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3ad05-e75d-4c99-9857-547c2adf959b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:48.145715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3ad05-e75d-4c99-9857-547c2adf959b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:48.147081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3ad05-e75d-4c99-9857-547c2adf959b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:48.169529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 509/1026] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:11:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:11:48.170540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c825ed-59ca-45bd-a741-a88972c7fc7f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:48.204912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:48.218843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30417a4d-6a43-4d51-8520-17f6f8fdab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:48.219481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30417a4d-6a43-4d51-8520-17f6f8fdab1f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:48.219759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30417a4d-6a43-4d51-8520-17f6f8fdab1f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:48.220030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30417a4d-6a43-4d51-8520-17f6f8fdab1f None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:48.220640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30417a4d-6a43-4d51-8520-17f6f8fdab1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:48.222129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30417a4d-6a43-4d51-8520-17f6f8fdab1f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:48.237118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 518/1027] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 26 18:11:48 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:11:48.514038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7411ee6-60b4-4042-a4cd-716360bc93a8 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:48.514535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7411ee6-60b4-4042-a4cd-716360bc93a8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:48.514535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7411ee6-60b4-4042-a4cd-716360bc93a8 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:48.517918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 510/1028] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:48.523741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5764b-eb45-44a2-9c05-030ee2c34209 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:48.524539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5764b-eb45-44a2-9c05-030ee2c34209 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:48.525042 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5764b-eb45-44a2-9c05-030ee2c34209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:48.544518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6af5764b-eb45-44a2-9c05-030ee2c34209 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:48.546130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6af5764b-eb45-44a2-9c05-030ee2c34209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:48.617401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 519/1029] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:48.884210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7411ee6-60b4-4042-a4cd-716360bc93a8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:48.970118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:48.996836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7411ee6-60b4-4042-a4cd-716360bc93a8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:49.032149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e1d79-c400-48a8-9d84-9003a607d156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:49.032804 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e1d79-c400-48a8-9d84-9003a607d156 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:49.033087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e1d79-c400-48a8-9d84-9003a607d156 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:49.033359 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e1d79-c400-48a8-9d84-9003a607d156 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:49.034510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e1d79-c400-48a8-9d84-9003a607d156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:49.035967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e1d79-c400-48a8-9d84-9003a607d156 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:49.037794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 511/1030] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:49.043572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5764b-eb45-44a2-9c05-030ee2c34209 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:49.148497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5764b-eb45-44a2-9c05-030ee2c34209 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:49.169463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:49.184994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47804e6a-69b4-4e2a-b476-8010785c0afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:49.185668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47804e6a-69b4-4e2a-b476-8010785c0afc None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:49.185949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47804e6a-69b4-4e2a-b476-8010785c0afc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:49.186221 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47804e6a-69b4-4e2a-b476-8010785c0afc None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:49.186889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47804e6a-69b4-4e2a-b476-8010785c0afc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:49.188384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47804e6a-69b4-4e2a-b476-8010785c0afc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:49.211073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 520/1031] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:11:49 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:11:50.162270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39a404-224b-4e1a-8e5a-e5e5d4ce69a3 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:50.162813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39a404-224b-4e1a-8e5a-e5e5d4ce69a3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:50.162813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39a404-224b-4e1a-8e5a-e5e5d4ce69a3 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:50.164327 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 512/1032] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:50.169423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93778625-e07b-403a-a0d2-5278b4db5180 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:50.169976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93778625-e07b-403a-a0d2-5278b4db5180 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:50.170062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93778625-e07b-403a-a0d2-5278b4db5180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:50.188410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-93778625-e07b-403a-a0d2-5278b4db5180 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:50.189638 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-93778625-e07b-403a-a0d2-5278b4db5180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:50.189766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee30fc-dd76-405e-aa79-28e1ea0d5720 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:50.189972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee30fc-dd76-405e-aa79-28e1ea0d5720 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:50.190257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee30fc-dd76-405e-aa79-28e1ea0d5720 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:50.191888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 513/1033] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:11:50.197007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7850301-b25a-48e8-bc47-df317715f252 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:50.197263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7850301-b25a-48e8-bc47-df317715f252 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:50.197552 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7850301-b25a-48e8-bc47-df317715f252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:50.216282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e7850301-b25a-48e8-bc47-df317715f252 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:50.217579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e7850301-b25a-48e8-bc47-df317715f252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:50.264826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 521/1034] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:50.290896 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 514/1035] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:11:50.527817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93778625-e07b-403a-a0d2-5278b4db5180 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:50.557986 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7850301-b25a-48e8-bc47-df317715f252 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:50.642940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:50.651935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93778625-e07b-403a-a0d2-5278b4db5180 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:50.660226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:50.667388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7850301-b25a-48e8-bc47-df317715f252 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:50.689353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b00d0-9149-4bd6-b2ef-6ecb8d780e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:50.689991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b00d0-9149-4bd6-b2ef-6ecb8d780e2c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:50.690268 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b00d0-9149-4bd6-b2ef-6ecb8d780e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:50.690541 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b00d0-9149-4bd6-b2ef-6ecb8d780e2c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:50.707984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b00d0-9149-4bd6-b2ef-6ecb8d780e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:50.710546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b8bd3-5484-49a2-b4cb-1367d2b821a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:50.711205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b8bd3-5484-49a2-b4cb-1367d2b821a0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:50.711489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b8bd3-5484-49a2-b4cb-1367d2b821a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:50.711768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b8bd3-5484-49a2-b4cb-1367d2b821a0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:50.712365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b8bd3-5484-49a2-b4cb-1367d2b821a0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:50.713784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b8bd3-5484-49a2-b4cb-1367d2b821a0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-ff0b00d0-9149-4bd6-b2ef-6ecb8d780e2c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:50.714715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:50.715642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:50.716497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:50.716497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:50.716497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:50.716497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:50.716497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:50.716497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:50.716497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:50.716497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:50.716497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:50.716497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:50.716497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 18:11:50.716497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:50.718228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 522/1036] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Aug 26 18:11:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:50.723794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b00d0-9149-4bd6-b2ef-6ecb8d780e2c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-e19b8bd3-5484-49a2-b4cb-1367d2b821a0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:50.725272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:50.726250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 18:11:50.727094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:50.731711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 515/1037] 10.222.0.45 () {56 vars in 1105 bytes} [Fri Aug 26 18:11:50 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:50.732656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b8bd3-5484-49a2-b4cb-1367d2b821a0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:50.825705 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b00d0-9149-4bd6-b2ef-6ecb8d780e2c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:50.840588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b8bd3-5484-49a2-b4cb-1367d2b821a0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:50.862184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22ef03-3c58-4c73-82a7-966d1ed56efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:50.863179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22ef03-3c58-4c73-82a7-966d1ed56efb None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:50.863657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22ef03-3c58-4c73-82a7-966d1ed56efb None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:50.864136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22ef03-3c58-4c73-82a7-966d1ed56efb None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:50.865038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22ef03-3c58-4c73-82a7-966d1ed56efb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:50.865540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22ef03-3c58-4c73-82a7-966d1ed56efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:50.867098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22ef03-3c58-4c73-82a7-966d1ed56efb None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:50.876557 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 523/1038] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 26 18:11:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:50.881854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22ef03-3c58-4c73-82a7-966d1ed56efb None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:50.883810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124716e3-258f-4830-9f66-5312bf1652d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:50.884406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124716e3-258f-4830-9f66-5312bf1652d8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:50.884739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124716e3-258f-4830-9f66-5312bf1652d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:50.885001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124716e3-258f-4830-9f66-5312bf1652d8 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:50.885626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124716e3-258f-4830-9f66-5312bf1652d8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:50.885929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124716e3-258f-4830-9f66-5312bf1652d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:50.887309 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124716e3-258f-4830-9f66-5312bf1652d8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:50.895901 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 516/1039] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:50.898257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124716e3-258f-4830-9f66-5312bf1652d8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:50.901937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:50.914725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:50.992976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22ef03-3c58-4c73-82a7-966d1ed56efb None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:51.002472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124716e3-258f-4830-9f66-5312bf1652d8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:51.031311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103585b9-4125-47b2-80f4-58d45119e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:51.032495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103585b9-4125-47b2-80f4-58d45119e15b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:51.033292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103585b9-4125-47b2-80f4-58d45119e15b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:51.034024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103585b9-4125-47b2-80f4-58d45119e15b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:51.037630 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5774c3-e55b-4df6-b3b3-f430f523eb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:51.038250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5774c3-e55b-4df6-b3b3-f430f523eb06 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:51.038533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5774c3-e55b-4df6-b3b3-f430f523eb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:51.038809 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5774c3-e55b-4df6-b3b3-f430f523eb06 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:51.039446 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5774c3-e55b-4df6-b3b3-f430f523eb06 None admin] RBAC: Adding query filter params (type=image) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:51.039752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5774c3-e55b-4df6-b3b3-f430f523eb06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:51.041157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5774c3-e55b-4df6-b3b3-f430f523eb06 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:51.050845 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 517/1040] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:51.051008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103585b9-4125-47b2-80f4-58d45119e15b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:51.051008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103585b9-4125-47b2-80f4-58d45119e15b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:51.052234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5774c3-e55b-4df6-b3b3-f430f523eb06 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-103585b9-4125-47b2-80f4-58d45119e15b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:51.065485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:51.066479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:51.067388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:51.067388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:51.067388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:51.069335 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 524/1041] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:51.072948 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103585b9-4125-47b2-80f4-58d45119e15b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:51.124407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:51.161545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5774c3-e55b-4df6-b3b3-f430f523eb06 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:51.162724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:51.182136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103585b9-4125-47b2-80f4-58d45119e15b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:51.195357 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a328ae9-13ac-4ac5-b02b-e882affae475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:51.195970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a328ae9-13ac-4ac5-b02b-e882affae475 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:51.196249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a328ae9-13ac-4ac5-b02b-e882affae475 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:51.196520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a328ae9-13ac-4ac5-b02b-e882affae475 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:51.197228 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a328ae9-13ac-4ac5-b02b-e882affae475 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:51.198603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a328ae9-13ac-4ac5-b02b-e882affae475 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:51.215609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe17ccd-8eee-42cc-88ab-cb66b00467cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:51.216217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe17ccd-8eee-42cc-88ab-cb66b00467cf None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:51.216494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe17ccd-8eee-42cc-88ab-cb66b00467cf None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:51.216819 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe17ccd-8eee-42cc-88ab-cb66b00467cf None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:51.217483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe17ccd-8eee-42cc-88ab-cb66b00467cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:51.217782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe17ccd-8eee-42cc-88ab-cb66b00467cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:51.218818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 518/1042] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:11:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:11:51.219165 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe17ccd-8eee-42cc-88ab-cb66b00467cf None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:51.219906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73494e79-4f2a-4109-9981-fb6778f87365 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:51.220193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73494e79-4f2a-4109-9981-fb6778f87365 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:51.220472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73494e79-4f2a-4109-9981-fb6778f87365 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:51.221867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 519/1043] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:51.227824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9b44f-5951-4d41-a960-fcb3d5e910ed None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:51.228112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9b44f-5951-4d41-a960-fcb3d5e910ed None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:51.228389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9b44f-5951-4d41-a960-fcb3d5e910ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:51.238652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 525/1044] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:51.239884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe17ccd-8eee-42cc-88ab-cb66b00467cf None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:51.247687 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-31d9b44f-5951-4d41-a960-fcb3d5e910ed None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:51.249291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-31d9b44f-5951-4d41-a960-fcb3d5e910ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:51.333889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 520/1045] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:11:51.354633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe17ccd-8eee-42cc-88ab-cb66b00467cf None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:51.395252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508599c3-923b-4777-92b1-443328e692b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:51.396184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508599c3-923b-4777-92b1-443328e692b2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:51.396461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508599c3-923b-4777-92b1-443328e692b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:51.396760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508599c3-923b-4777-92b1-443328e692b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:51.404645 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508599c3-923b-4777-92b1-443328e692b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:51.406228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508599c3-923b-4777-92b1-443328e692b2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:51.409093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-508599c3-923b-4777-92b1-443328e692b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:51.419873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:51.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:51.421890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:51.421890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:51.421890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:51.421890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:51.421890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:51.421890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:51.421890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:51.421890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:51.421890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:51.421890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:51.421890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 526/1046] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 26 18:11:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:51.426936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9b44f-5951-4d41-a960-fcb3d5e910ed None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:51.479224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:51.538180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9b44f-5951-4d41-a960-fcb3d5e910ed None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:51.574022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c68d4-e5ac-4a83-840d-2e2a1993a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:51.574636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c68d4-e5ac-4a83-840d-2e2a1993a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:51.574910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c68d4-e5ac-4a83-840d-2e2a1993a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:51.575175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c68d4-e5ac-4a83-840d-2e2a1993a3f5 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:51.575911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c68d4-e5ac-4a83-840d-2e2a1993a3f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:51.576241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c68d4-e5ac-4a83-840d-2e2a1993a3f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:51.577757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c68d4-e5ac-4a83-840d-2e2a1993a3f5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:51.595738 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 521/1047] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 26 18:11:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:51.601304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508599c3-923b-4777-92b1-443328e692b2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:51.601447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c68d4-e5ac-4a83-840d-2e2a1993a3f5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:51.707794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508599c3-923b-4777-92b1-443328e692b2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:51.711229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c68d4-e5ac-4a83-840d-2e2a1993a3f5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:51.721006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:51.746368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a728a-2573-4603-96fa-b3c9f61194dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:51.747010 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a728a-2573-4603-96fa-b3c9f61194dc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:51.747287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a728a-2573-4603-96fa-b3c9f61194dc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:51.747565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a728a-2573-4603-96fa-b3c9f61194dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:51.749661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f346a9-acd3-4154-a6cd-d76f7fbf9efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:51.750276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f346a9-acd3-4154-a6cd-d76f7fbf9efa None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:51.750556 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f346a9-acd3-4154-a6cd-d76f7fbf9efa None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:51.750826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f346a9-acd3-4154-a6cd-d76f7fbf9efa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:51.758846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a728a-2573-4603-96fa-b3c9f61194dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-bd9a728a-2573-4603-96fa-b3c9f61194dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:51.764088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:51.765092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:51.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 527/1048] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:51.771040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a728a-2573-4603-96fa-b3c9f61194dc None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:51.825710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f346a9-acd3-4154-a6cd-d76f7fbf9efa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:51.827288 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f346a9-acd3-4154-a6cd-d76f7fbf9efa None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:51.829299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:51.876966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a728a-2573-4603-96fa-b3c9f61194dc None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:51.913754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df6e71-bd03-4227-96b7-9cb37dd9089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:51.914460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df6e71-bd03-4227-96b7-9cb37dd9089a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:51.914738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df6e71-bd03-4227-96b7-9cb37dd9089a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:51.914976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df6e71-bd03-4227-96b7-9cb37dd9089a None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:51.915718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df6e71-bd03-4227-96b7-9cb37dd9089a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:51.916017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df6e71-bd03-4227-96b7-9cb37dd9089a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:51.917533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df6e71-bd03-4227-96b7-9cb37dd9089a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:51.926827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 528/1049] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:11:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:51.932403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df6e71-bd03-4227-96b7-9cb37dd9089a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:51.944877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 522/1050] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:11:51.945969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f346a9-acd3-4154-a6cd-d76f7fbf9efa None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:51.958231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:52.048213 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df6e71-bd03-4227-96b7-9cb37dd9089a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:52.059699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f346a9-acd3-4154-a6cd-d76f7fbf9efa None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:52.071314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:52.085302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1805a7-655c-4a89-864a-f7d66864d919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:52.085935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1805a7-655c-4a89-864a-f7d66864d919 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:52.086212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1805a7-655c-4a89-864a-f7d66864d919 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:52.086482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1805a7-655c-4a89-864a-f7d66864d919 None admin] PATH_INFO: `/v3/users/487f05a916c8454ab030db4884c4745c` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:52.094628 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc594a-16fd-4e79-8a0e-03c39b90b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:52.095299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc594a-16fd-4e79-8a0e-03c39b90b696 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:52.095581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc594a-16fd-4e79-8a0e-03c39b90b696 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:52.095853 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc594a-16fd-4e79-8a0e-03c39b90b696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:52.101430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1805a7-655c-4a89-864a-f7d66864d919 None admin] RBAC: Authorizing `identity:get_user(user_id=487f05a916c8454ab030db4884c4745c)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:52.103497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1805a7-655c-4a89-864a-f7d66864d919 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:52.105711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 529/1051] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:11:51 2022] GET /identity/v3/users/487f05a916c8454ab030db4884c4745c => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:52.111365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1805a7-655c-4a89-864a-f7d66864d919 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:52.111491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc594a-16fd-4e79-8a0e-03c39b90b696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:52.112907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc594a-16fd-4e79-8a0e-03c39b90b696 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-20dc594a-16fd-4e79-8a0e-03c39b90b696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:52.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:52.130439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:52.131428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:52.131428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:52.131428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:52.131428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 523/1052] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:52.135789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc594a-16fd-4e79-8a0e-03c39b90b696 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:52.198328 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:52.237737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1805a7-655c-4a89-864a-f7d66864d919 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:52.242212 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc594a-16fd-4e79-8a0e-03c39b90b696 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:52.288823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcefde-fb2d-424a-8315-27c3b28a791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:52.290125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcefde-fb2d-424a-8315-27c3b28a791a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:52.290808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcefde-fb2d-424a-8315-27c3b28a791a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:52.291450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcefde-fb2d-424a-8315-27c3b28a791a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:52.292979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b414e-c45d-4bc0-a40c-556ef9ad6b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:52.293909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b414e-c45d-4bc0-a40c-556ef9ad6b72 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:52.294463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b414e-c45d-4bc0-a40c-556ef9ad6b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:52.294843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b414e-c45d-4bc0-a40c-556ef9ad6b72 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:52.295530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b414e-c45d-4bc0-a40c-556ef9ad6b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:52.295835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b414e-c45d-4bc0-a40c-556ef9ad6b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:52.297248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b414e-c45d-4bc0-a40c-556ef9ad6b72 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:52.317047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 524/1053] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:52.317865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b414e-c45d-4bc0-a40c-556ef9ad6b72 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:52.355595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:52.378331 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcefde-fb2d-424a-8315-27c3b28a791a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:52.379914 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcefde-fb2d-424a-8315-27c3b28a791a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:52.428484 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b414e-c45d-4bc0-a40c-556ef9ad6b72 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:52.448937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:52.466632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373db06-e422-4334-970e-b308673adfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:52.467833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373db06-e422-4334-970e-b308673adfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:52.468112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373db06-e422-4334-970e-b308673adfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:52.468387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373db06-e422-4334-970e-b308673adfa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:52.475191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373db06-e422-4334-970e-b308673adfa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:52.476639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373db06-e422-4334-970e-b308673adfa7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b373db06-e422-4334-970e-b308673adfa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:52.488282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:52.489242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:52.490669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:52.490669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:52.490669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:52.490669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:52.490669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:52.490669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:52.490669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:52.490669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:52.490669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 525/1054] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:52.491854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 530/1055] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 18:11:52.491958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373db06-e422-4334-970e-b308673adfa7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:52.496398 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcefde-fb2d-424a-8315-27c3b28a791a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:52.584217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:52.606467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcefde-fb2d-424a-8315-27c3b28a791a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:52.611313 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373db06-e422-4334-970e-b308673adfa7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:52.646453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef74924-c9bd-4333-b0d5-4f686d33b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:52.646690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f02e49-b768-4774-9c4d-77910cb377e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:52.647075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef74924-c9bd-4333-b0d5-4f686d33b6ff None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:52.647182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f02e49-b768-4774-9c4d-77910cb377e0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:52.647348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef74924-c9bd-4333-b0d5-4f686d33b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:52.647449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f02e49-b768-4774-9c4d-77910cb377e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:52.647612 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef74924-c9bd-4333-b0d5-4f686d33b6ff None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:52.647762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f02e49-b768-4774-9c4d-77910cb377e0 None admin] PATH_INFO: `/v3/projects/46984fafe5d145baab3474d73f84ef4b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:52.648306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef74924-c9bd-4333-b0d5-4f686d33b6ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:52.648611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef74924-c9bd-4333-b0d5-4f686d33b6ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:52.648885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f02e49-b768-4774-9c4d-77910cb377e0 None admin] RBAC: Authorizing `identity:get_project(project_id=46984fafe5d145baab3474d73f84ef4b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:52.650103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef74924-c9bd-4333-b0d5-4f686d33b6ff None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:52.650307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f02e49-b768-4774-9c4d-77910cb377e0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:52.657217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 526/1056] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:11:52 2022] GET /identity/v3/projects/46984fafe5d145baab3474d73f84ef4b => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:52.658114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f02e49-b768-4774-9c4d-77910cb377e0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:52.672806 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 531/1057] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:52.673955 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef74924-c9bd-4333-b0d5-4f686d33b6ff None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:52.717676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:52.780757 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef74924-c9bd-4333-b0d5-4f686d33b6ff None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:52.782649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f02e49-b768-4774-9c4d-77910cb377e0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:52.817722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb1d13-0da6-40cb-864a-cb71fbdcf004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:52.818332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1d13-0da6-40cb-864a-cb71fbdcf004 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:52.818637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1d13-0da6-40cb-864a-cb71fbdcf004 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:52.818878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1d13-0da6-40cb-864a-cb71fbdcf004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:52.819603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb1d13-0da6-40cb-864a-cb71fbdcf004 None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=46984fafe5d145baab3474d73f84ef4b, user.id=487f05a916c8454ab030db4884c4745c) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:52.819912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb1d13-0da6-40cb-864a-cb71fbdcf004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:52.820782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933a2df-28d2-462c-a8e8-d32adb016c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:52.821371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb1d13-0da6-40cb-864a-cb71fbdcf004 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:52.821475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933a2df-28d2-462c-a8e8-d32adb016c6f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:52.821639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933a2df-28d2-462c-a8e8-d32adb016c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:52.821925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933a2df-28d2-462c-a8e8-d32adb016c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:52.822644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933a2df-28d2-462c-a8e8-d32adb016c6f None admin] RBAC: Adding query filter params (role.id=5b7184a41c574ff3851c31ce9496e8ae, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=3791df34c6e442aaabd90d7f5c2f3a1a) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:52.822931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933a2df-28d2-462c-a8e8-d32adb016c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:52.824354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933a2df-28d2-462c-a8e8-d32adb016c6f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:52.827171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 527/1058] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:52 2022] GET /identity/v3/role_assignments?user.id=487f05a916c8454ab030db4884c4745c&scope.project.id=46984fafe5d145baab3474d73f84ef4b&role.id=db572ad3d504403cbb227c2155c93eda => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:52.842931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 532/1059] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:52 2022] GET /identity/v3/role_assignments?user.id=3791df34c6e442aaabd90d7f5c2f3a1a&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5b7184a41c574ff3851c31ce9496e8ae => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:53.152068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46d56d-b60b-480d-8a1f-869cb31e28bf None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:53.152253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46d56d-b60b-480d-8a1f-869cb31e28bf None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:53.152512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46d56d-b60b-480d-8a1f-869cb31e28bf None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:53.154116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 528/1060] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:53.159343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f7a40-8856-44e9-b682-11922971d555 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:53.159591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f7a40-8856-44e9-b682-11922971d555 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:53.159903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f7a40-8856-44e9-b682-11922971d555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:53.168088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:53.179177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-086f7a40-8856-44e9-b682-11922971d555 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:53.180388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-086f7a40-8856-44e9-b682-11922971d555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:53.251398 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 533/1061] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:53.513058 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46d56d-b60b-480d-8a1f-869cb31e28bf None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:53.620532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46d56d-b60b-480d-8a1f-869cb31e28bf None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:53.633791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:53.656400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985203d-be79-43a5-9009-d858917b9e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:53.657043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985203d-be79-43a5-9009-d858917b9e65 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:53.657323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985203d-be79-43a5-9009-d858917b9e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:53.657599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985203d-be79-43a5-9009-d858917b9e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:53.726526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985203d-be79-43a5-9009-d858917b9e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:53.728292 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985203d-be79-43a5-9009-d858917b9e65 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:53.831154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 529/1062] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:11:53.837141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f7a40-8856-44e9-b682-11922971d555 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:53.941342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f7a40-8856-44e9-b682-11922971d555 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:53.974724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c396e-cdb8-4c5b-9753-54631b300f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:53.975360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c396e-cdb8-4c5b-9753-54631b300f72 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:53.975636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c396e-cdb8-4c5b-9753-54631b300f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:53.975899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c396e-cdb8-4c5b-9753-54631b300f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:53.978086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:53.988257 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c396e-cdb8-4c5b-9753-54631b300f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:53.989768 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c396e-cdb8-4c5b-9753-54631b300f72 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-d40c396e-cdb8-4c5b-9753-54631b300f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:54.005066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:54.006102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:54.007028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:54.007028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:54.007028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:54.011281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 534/1063] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:54.012828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985203d-be79-43a5-9009-d858917b9e65 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:54.028814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:54.116873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985203d-be79-43a5-9009-d858917b9e65 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:54.152033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bed510-6e24-4f3f-9c69-45f5def509fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:54.152651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bed510-6e24-4f3f-9c69-45f5def509fe None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:54.152951 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bed510-6e24-4f3f-9c69-45f5def509fe None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:54.153221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bed510-6e24-4f3f-9c69-45f5def509fe None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:54.153869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bed510-6e24-4f3f-9c69-45f5def509fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:54.154158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bed510-6e24-4f3f-9c69-45f5def509fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:54.155597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bed510-6e24-4f3f-9c69-45f5def509fe None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:54.167255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 530/1064] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:54.706689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b62af-1f00-41b5-9d60-1b7e93c31863 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:54.707271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b62af-1f00-41b5-9d60-1b7e93c31863 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:54.707271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b62af-1f00-41b5-9d60-1b7e93c31863 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:54.708574 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 535/1065] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:54.713989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047728e-64bf-4a7a-872b-213b81210b80 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:54.714424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047728e-64bf-4a7a-872b-213b81210b80 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:54.714528 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047728e-64bf-4a7a-872b-213b81210b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:54.723781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffa2a2-1a06-4f3e-94d6-a82a0667db19 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:54.724082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffa2a2-1a06-4f3e-94d6-a82a0667db19 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:54.724385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffa2a2-1a06-4f3e-94d6-a82a0667db19 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:54.725758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 536/1066] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:54.730912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882948e-bcd8-4f34-8541-ad72bcd75220 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:54.731193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882948e-bcd8-4f34-8541-ad72bcd75220 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:54.731464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882948e-bcd8-4f34-8541-ad72bcd75220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:54.735643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f047728e-64bf-4a7a-872b-213b81210b80 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:54.736865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f047728e-64bf-4a7a-872b-213b81210b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:54.750091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0882948e-bcd8-4f34-8541-ad72bcd75220 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:54.751273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0882948e-bcd8-4f34-8541-ad72bcd75220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:54.815565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 531/1067] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:54.818928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 537/1068] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:55.077167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047728e-64bf-4a7a-872b-213b81210b80 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:55.079343 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:55.094927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882948e-bcd8-4f34-8541-ad72bcd75220 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:55.177545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047728e-64bf-4a7a-872b-213b81210b80 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:55.201918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882948e-bcd8-4f34-8541-ad72bcd75220 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:55.211987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f41e03-1760-490a-9e84-cf505d65137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:55.212620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f41e03-1760-490a-9e84-cf505d65137c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:55.212961 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f41e03-1760-490a-9e84-cf505d65137c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:55.213230 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f41e03-1760-490a-9e84-cf505d65137c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:55.219023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:55.223182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f41e03-1760-490a-9e84-cf505d65137c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-78f41e03-1760-490a-9e84-cf505d65137c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:55.228333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:55.229479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:55.230337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 532/1069] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:55.235624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f41e03-1760-490a-9e84-cf505d65137c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:55.241440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f51b70-1cad-4ec9-9316-850332cf299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:55.242078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f51b70-1cad-4ec9-9316-850332cf299b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:55.242354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f51b70-1cad-4ec9-9316-850332cf299b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:55.242618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f51b70-1cad-4ec9-9316-850332cf299b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:55.253728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f51b70-1cad-4ec9-9316-850332cf299b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e3f51b70-1cad-4ec9-9316-850332cf299b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:55.258466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:55.259440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:55.260273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 538/1070] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Aug 26 18:11:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:55.265500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f51b70-1cad-4ec9-9316-850332cf299b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:55.298627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:55.336968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f41e03-1760-490a-9e84-cf505d65137c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:55.368383 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f51b70-1cad-4ec9-9316-850332cf299b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:55.370753 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d504de5-1eeb-426b-8630-92aae0f9a692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:55.371369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d504de5-1eeb-426b-8630-92aae0f9a692 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:55.371650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d504de5-1eeb-426b-8630-92aae0f9a692 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:55.371925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d504de5-1eeb-426b-8630-92aae0f9a692 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:55.372633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d504de5-1eeb-426b-8630-92aae0f9a692 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:55.373000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d504de5-1eeb-426b-8630-92aae0f9a692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:55.374427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d504de5-1eeb-426b-8630-92aae0f9a692 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:55.383051 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 533/1071] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:11:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:55.389109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d504de5-1eeb-426b-8630-92aae0f9a692 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:55.406678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b08a52-92a5-4ffa-9f17-b3beca8f6b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:55.407310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b08a52-92a5-4ffa-9f17-b3beca8f6b87 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:55.407585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b08a52-92a5-4ffa-9f17-b3beca8f6b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:55.407854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b08a52-92a5-4ffa-9f17-b3beca8f6b87 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:55.408527 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b08a52-92a5-4ffa-9f17-b3beca8f6b87 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:55.408882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b08a52-92a5-4ffa-9f17-b3beca8f6b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:55.410310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b08a52-92a5-4ffa-9f17-b3beca8f6b87 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:55.420422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 539/1072] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 26 18:11:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:55.426131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b08a52-92a5-4ffa-9f17-b3beca8f6b87 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:55.465472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:55.491701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d504de5-1eeb-426b-8630-92aae0f9a692 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:55.516023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:55.528185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7e872-45ff-4d30-a5e0-ae5298a66584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:55.528848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7e872-45ff-4d30-a5e0-ae5298a66584 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:55.529128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7e872-45ff-4d30-a5e0-ae5298a66584 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:55.529425 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7e872-45ff-4d30-a5e0-ae5298a66584 None admin] PATH_INFO: `/v3/users/487f05a916c8454ab030db4884c4745c` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:55.530613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7e872-45ff-4d30-a5e0-ae5298a66584 None admin] RBAC: Authorizing `identity:get_user(user_id=487f05a916c8454ab030db4884c4745c)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:55.531842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b08a52-92a5-4ffa-9f17-b3beca8f6b87 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:55.532057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7e872-45ff-4d30-a5e0-ae5298a66584 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:55.533713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 534/1073] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:11:55 2022] GET /identity/v3/users/487f05a916c8454ab030db4884c4745c => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:55.539421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7e872-45ff-4d30-a5e0-ae5298a66584 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:55.566752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a651c41-43b0-4335-be04-5b34128812f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:55.567409 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a651c41-43b0-4335-be04-5b34128812f8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:55.567681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a651c41-43b0-4335-be04-5b34128812f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:55.567950 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a651c41-43b0-4335-be04-5b34128812f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:55.578547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a651c41-43b0-4335-be04-5b34128812f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:55.580040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a651c41-43b0-4335-be04-5b34128812f8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-8a651c41-43b0-4335-be04-5b34128812f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:55.594544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:55.595659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:55.596818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:55.596818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:55.596818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:55.596818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 540/1074] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:55.601288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a651c41-43b0-4335-be04-5b34128812f8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:55.641325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7e872-45ff-4d30-a5e0-ae5298a66584 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:55.673671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4ac48-e453-4b49-a389-5d0ff2ceafed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:55.674576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4ac48-e453-4b49-a389-5d0ff2ceafed None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:55.674576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4ac48-e453-4b49-a389-5d0ff2ceafed None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:55.674838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4ac48-e453-4b49-a389-5d0ff2ceafed None admin] PATH_INFO: `/v3/projects/46984fafe5d145baab3474d73f84ef4b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:55.675944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4ac48-e453-4b49-a389-5d0ff2ceafed None admin] RBAC: Authorizing `identity:get_project(project_id=46984fafe5d145baab3474d73f84ef4b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:55.677415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4ac48-e453-4b49-a389-5d0ff2ceafed None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:55.679056 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 535/1075] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:11:55 2022] GET /identity/v3/projects/46984fafe5d145baab3474d73f84ef4b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:55.684840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4ac48-e453-4b49-a389-5d0ff2ceafed None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:55.689877 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:55.701534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a651c41-43b0-4335-be04-5b34128812f8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:55.735194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff5dfd-d24f-4ef7-a526-149a9c7dc2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:55.735848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff5dfd-d24f-4ef7-a526-149a9c7dc2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:55.736075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff5dfd-d24f-4ef7-a526-149a9c7dc2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:55.736353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff5dfd-d24f-4ef7-a526-149a9c7dc2a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:55.737027 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff5dfd-d24f-4ef7-a526-149a9c7dc2a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:55.737332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff5dfd-d24f-4ef7-a526-149a9c7dc2a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:55.738736 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff5dfd-d24f-4ef7-a526-149a9c7dc2a5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:55.742798 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:55.750444 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 541/1076] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:55.756257 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff5dfd-d24f-4ef7-a526-149a9c7dc2a5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:55.786300 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4ac48-e453-4b49-a389-5d0ff2ceafed None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:55.819551 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfe1e3-0be9-4499-b7cc-155efcd63023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:55.820219 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfe1e3-0be9-4499-b7cc-155efcd63023 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:55.820504 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfe1e3-0be9-4499-b7cc-155efcd63023 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:55.820804 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfe1e3-0be9-4499-b7cc-155efcd63023 None admin] PATH_INFO: `/v3/projects/46984fafe5d145baab3474d73f84ef4b/users/487f05a916c8454ab030db4884c4745c/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:55.822725 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfe1e3-0be9-4499-b7cc-155efcd63023 None admin] RBAC: Authorizing `identity:create_grant(project_id=46984fafe5d145baab3474d73f84ef4b, user_id=487f05a916c8454ab030db4884c4745c, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:55.824164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfe1e3-0be9-4499-b7cc-155efcd63023 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:55.838629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 536/1077] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:11:55 2022] PUT /identity/v3/projects/46984fafe5d145baab3474d73f84ef4b/users/487f05a916c8454ab030db4884c4745c/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:11:55.856941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff5dfd-d24f-4ef7-a526-149a9c7dc2a5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:55.896041 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804ec9d-6fb5-4f8a-871f-940cf9b30f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:55.896749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804ec9d-6fb5-4f8a-871f-940cf9b30f61 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:55.897032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804ec9d-6fb5-4f8a-871f-940cf9b30f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:55.897302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804ec9d-6fb5-4f8a-871f-940cf9b30f61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:55.905738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804ec9d-6fb5-4f8a-871f-940cf9b30f61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:55.907244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804ec9d-6fb5-4f8a-871f-940cf9b30f61 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1804ec9d-6fb5-4f8a-871f-940cf9b30f61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:55.920551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:55.921724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:55.922829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:55.922829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:55.922829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:55.922829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:55.922829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:55.922829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:55.922829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:55.922829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:55.922829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:55.922829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:55.922829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 542/1078] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 26 18:11:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:11:55.927897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfe1e3-0be9-4499-b7cc-155efcd63023 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:56.035872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfe1e3-0be9-4499-b7cc-155efcd63023 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:56.055408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:56.070666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428f748-8f04-4d82-b64f-239d214b7cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:56.071285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428f748-8f04-4d82-b64f-239d214b7cde None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:56.071566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428f748-8f04-4d82-b64f-239d214b7cde None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:56.071839 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428f748-8f04-4d82-b64f-239d214b7cde None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:56.072571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428f748-8f04-4d82-b64f-239d214b7cde None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:56.072921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428f748-8f04-4d82-b64f-239d214b7cde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:56.074352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428f748-8f04-4d82-b64f-239d214b7cde None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:56.091366 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 537/1079] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 26 18:11:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:56.097233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804ec9d-6fb5-4f8a-871f-940cf9b30f61 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:56.110466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:56.199981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804ec9d-6fb5-4f8a-871f-940cf9b30f61 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:56.234253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5701e-50b8-4ab9-acb3-176536a40523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:56.234880 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5701e-50b8-4ab9-acb3-176536a40523 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:56.235151 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5701e-50b8-4ab9-acb3-176536a40523 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:56.235417 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5701e-50b8-4ab9-acb3-176536a40523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:56.246099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5701e-50b8-4ab9-acb3-176536a40523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:56.247575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5701e-50b8-4ab9-acb3-176536a40523 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-a9e5701e-50b8-4ab9-acb3-176536a40523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:56.262123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:56.265255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:56.266203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:56.266203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:56.266203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:56.266203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 543/1080] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:56.269275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428f748-8f04-4d82-b64f-239d214b7cde None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:56.375633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428f748-8f04-4d82-b64f-239d214b7cde None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:56.410626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a7760-acf1-4c80-8e07-dad679013962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:56.411233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a7760-acf1-4c80-8e07-dad679013962 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:56.411514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a7760-acf1-4c80-8e07-dad679013962 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:56.411769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a7760-acf1-4c80-8e07-dad679013962 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:56.412435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a7760-acf1-4c80-8e07-dad679013962 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:56.412748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a7760-acf1-4c80-8e07-dad679013962 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:56.414138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a7760-acf1-4c80-8e07-dad679013962 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:56.426182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 538/1081] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:56.432001 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5701e-50b8-4ab9-acb3-176536a40523 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:56.496733 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:56.542013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5701e-50b8-4ab9-acb3-176536a40523 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:56.577592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d453e0-d0a4-4eaa-8c41-16921d937ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:56.578217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d453e0-d0a4-4eaa-8c41-16921d937ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:56.578496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d453e0-d0a4-4eaa-8c41-16921d937ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:56.578768 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d453e0-d0a4-4eaa-8c41-16921d937ac4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:56.585572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d453e0-d0a4-4eaa-8c41-16921d937ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:56.587028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d453e0-d0a4-4eaa-8c41-16921d937ac4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-f1d453e0-d0a4-4eaa-8c41-16921d937ac4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:11:56.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:56.599455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:56.600354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:11:56.600354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:11:56.600354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:11:56.600354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:11:56.600354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:11:56.600354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:11:56.600354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:11:56.600354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:56.600354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 544/1082] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:11:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:56.606179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a7760-acf1-4c80-8e07-dad679013962 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:56.648606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:56.710703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a7760-acf1-4c80-8e07-dad679013962 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:56.745758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f65c0-bc3c-42d6-9690-8d0cc60a3e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:56.746374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f65c0-bc3c-42d6-9690-8d0cc60a3e14 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:56.746640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f65c0-bc3c-42d6-9690-8d0cc60a3e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:56.746917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f65c0-bc3c-42d6-9690-8d0cc60a3e14 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:56.747615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f65c0-bc3c-42d6-9690-8d0cc60a3e14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:56.747921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f65c0-bc3c-42d6-9690-8d0cc60a3e14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:56.749408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f65c0-bc3c-42d6-9690-8d0cc60a3e14 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:56.761269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 539/1083] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:11:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:56.767661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d453e0-d0a4-4eaa-8c41-16921d937ac4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:56.869361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d453e0-d0a4-4eaa-8c41-16921d937ac4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:56.894438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:56.906770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a7ccb-a5df-4071-8d9e-df66d154f887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:56.907378 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a7ccb-a5df-4071-8d9e-df66d154f887 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:56.907660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a7ccb-a5df-4071-8d9e-df66d154f887 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:56.907934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a7ccb-a5df-4071-8d9e-df66d154f887 None admin] PATH_INFO: `/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/3791df34c6e442aaabd90d7f5c2f3a1a/roles/5b7184a41c574ff3851c31ce9496e8ae` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:56.910103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a7ccb-a5df-4071-8d9e-df66d154f887 None admin] RBAC: Authorizing `identity:create_grant(project_id=2803c5ec5ecf4223836ddf75397cc095, user_id=3791df34c6e442aaabd90d7f5c2f3a1a, role_id=5b7184a41c574ff3851c31ce9496e8ae)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:56.911557 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a7ccb-a5df-4071-8d9e-df66d154f887 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:56.925457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 545/1084] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:11:56 2022] PUT /identity/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/3791df34c6e442aaabd90d7f5c2f3a1a/roles/5b7184a41c574ff3851c31ce9496e8ae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:11:57.688226 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6f9a8-fc6d-4a18-a651-85a92fd5e50f None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:57.688481 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6f9a8-fc6d-4a18-a651-85a92fd5e50f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:57.688766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6f9a8-fc6d-4a18-a651-85a92fd5e50f None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:57.690151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 540/1085] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:57.695704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746b127-1ebd-4ff4-a067-f26e83f3f308 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:57.696057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746b127-1ebd-4ff4-a067-f26e83f3f308 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:57.696409 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746b127-1ebd-4ff4-a067-f26e83f3f308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:57.714659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b746b127-1ebd-4ff4-a067-f26e83f3f308 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:57.715824 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b746b127-1ebd-4ff4-a067-f26e83f3f308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:57.784068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 546/1086] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:58.050931 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6f9a8-fc6d-4a18-a651-85a92fd5e50f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:58.152528 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:58.157798 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6f9a8-fc6d-4a18-a651-85a92fd5e50f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:58.192968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a30fa5-ab57-4012-8f42-2fde985c47df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:58.193597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a30fa5-ab57-4012-8f42-2fde985c47df None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:58.193878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a30fa5-ab57-4012-8f42-2fde985c47df None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:58.194147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a30fa5-ab57-4012-8f42-2fde985c47df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:58.204840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a30fa5-ab57-4012-8f42-2fde985c47df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-08a30fa5-ab57-4012-8f42-2fde985c47df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:58.209744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:58.210703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:11:58.211565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 541/1087] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:58.217110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746b127-1ebd-4ff4-a067-f26e83f3f308 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:58.318512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746b127-1ebd-4ff4-a067-f26e83f3f308 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:58.331799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:58.355115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476edb2d-ed5e-4d6e-9cbd-602d37eec2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:58.355726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476edb2d-ed5e-4d6e-9cbd-602d37eec2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:58.356016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476edb2d-ed5e-4d6e-9cbd-602d37eec2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:58.356273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476edb2d-ed5e-4d6e-9cbd-602d37eec2e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:58.356978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476edb2d-ed5e-4d6e-9cbd-602d37eec2e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:58.357327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476edb2d-ed5e-4d6e-9cbd-602d37eec2e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:58.358719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476edb2d-ed5e-4d6e-9cbd-602d37eec2e0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:58.366789 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 547/1088] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:11:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:58.372646 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a30fa5-ab57-4012-8f42-2fde985c47df None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:58.471920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a30fa5-ab57-4012-8f42-2fde985c47df None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:58.509076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdff0cf-494a-4fc1-8115-4e9b9cb99fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:58.509708 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdff0cf-494a-4fc1-8115-4e9b9cb99fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:58.510043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdff0cf-494a-4fc1-8115-4e9b9cb99fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:58.510317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdff0cf-494a-4fc1-8115-4e9b9cb99fe4 None admin] PATH_INFO: `/v3/users/487f05a916c8454ab030db4884c4745c` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:58.511479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdff0cf-494a-4fc1-8115-4e9b9cb99fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=487f05a916c8454ab030db4884c4745c)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:58.512944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdff0cf-494a-4fc1-8115-4e9b9cb99fe4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:58.514588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 542/1089] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:11:58 2022] GET /identity/v3/users/487f05a916c8454ab030db4884c4745c => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:58.520844 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476edb2d-ed5e-4d6e-9cbd-602d37eec2e0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:58.625288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476edb2d-ed5e-4d6e-9cbd-602d37eec2e0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:58.661110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75063d1e-88b6-4dc8-a8d4-37a58a801d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:58.661720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063d1e-88b6-4dc8-a8d4-37a58a801d7e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:58.661997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063d1e-88b6-4dc8-a8d4-37a58a801d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:58.662265 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063d1e-88b6-4dc8-a8d4-37a58a801d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:58.704529 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:58.730179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75063d1e-88b6-4dc8-a8d4-37a58a801d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:58.731636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75063d1e-88b6-4dc8-a8d4-37a58a801d7e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:58.782468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b8a28-04d2-4f49-84c7-f859be867466 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:58.782729 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b8a28-04d2-4f49-84c7-f859be867466 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:58.783000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b8a28-04d2-4f49-84c7-f859be867466 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:58.784405 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 543/1090] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:11:58.790213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d09e0-059d-4faa-8ab2-9f59a8e98da6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:58.790506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d09e0-059d-4faa-8ab2-9f59a8e98da6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:58.790776 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d09e0-059d-4faa-8ab2-9f59a8e98da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:58.809632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-707d09e0-059d-4faa-8ab2-9f59a8e98da6 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:11:58.810924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-707d09e0-059d-4faa-8ab2-9f59a8e98da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:11:58.831445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 548/1091] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:11:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 18:11:58.832267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:58.837605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75063d1e-88b6-4dc8-a8d4-37a58a801d7e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:58.880263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 544/1092] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:11:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:11:58.910101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:58.935390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75063d1e-88b6-4dc8-a8d4-37a58a801d7e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:58.970428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0707642-9821-4edf-a5de-36370d7f9602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:58.971053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0707642-9821-4edf-a5de-36370d7f9602 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:58.971335 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0707642-9821-4edf-a5de-36370d7f9602 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:58.971606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0707642-9821-4edf-a5de-36370d7f9602 None admin] PATH_INFO: `/v3/projects/46984fafe5d145baab3474d73f84ef4b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:58.972760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0707642-9821-4edf-a5de-36370d7f9602 None admin] RBAC: Authorizing `identity:get_project(project_id=46984fafe5d145baab3474d73f84ef4b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:58.974227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0707642-9821-4edf-a5de-36370d7f9602 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:58.975863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 549/1093] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:11:58 2022] GET /identity/v3/projects/46984fafe5d145baab3474d73f84ef4b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:11:58.982524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d09e0-059d-4faa-8ab2-9f59a8e98da6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:59.081320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d09e0-059d-4faa-8ab2-9f59a8e98da6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:59.117065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9608e-f07b-40a8-b72d-db23984d009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:59.117677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9608e-f07b-40a8-b72d-db23984d009f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:59.117961 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9608e-f07b-40a8-b72d-db23984d009f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:59.118238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9608e-f07b-40a8-b72d-db23984d009f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:59.118975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9608e-f07b-40a8-b72d-db23984d009f None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=46984fafe5d145baab3474d73f84ef4b, user.id=487f05a916c8454ab030db4884c4745c) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:59.119289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9608e-f07b-40a8-b72d-db23984d009f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:59.120735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9608e-f07b-40a8-b72d-db23984d009f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:59.126569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 545/1094] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:11:58 2022] GET /identity/v3/role_assignments?user.id=487f05a916c8454ab030db4884c4745c&scope.project.id=46984fafe5d145baab3474d73f84ef4b&role.id=db572ad3d504403cbb227c2155c93eda => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:59.147946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0707642-9821-4edf-a5de-36370d7f9602 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:59.259403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0707642-9821-4edf-a5de-36370d7f9602 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:59.294067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f309be-7dad-46f8-9ea8-fac9e90500be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:59.294702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f309be-7dad-46f8-9ea8-fac9e90500be None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:59.294982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f309be-7dad-46f8-9ea8-fac9e90500be None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:59.295319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f309be-7dad-46f8-9ea8-fac9e90500be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:59.305896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f309be-7dad-46f8-9ea8-fac9e90500be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-20f309be-7dad-46f8-9ea8-fac9e90500be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:11:59.310643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:59.311820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:59.312882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 550/1095] 10.222.0.45 () {56 vars in 1120 bytes} [Fri Aug 26 18:11:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:59.317988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9608e-f07b-40a8-b72d-db23984d009f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:59.340470 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:59.417478 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9608e-f07b-40a8-b72d-db23984d009f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:59.450498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bdc97-a5af-4a0f-b4c7-5434d5c38b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:59.451112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bdc97-a5af-4a0f-b4c7-5434d5c38b95 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:59.451428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bdc97-a5af-4a0f-b4c7-5434d5c38b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:59.451707 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bdc97-a5af-4a0f-b4c7-5434d5c38b95 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:59.452382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bdc97-a5af-4a0f-b4c7-5434d5c38b95 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:59.452688 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bdc97-a5af-4a0f-b4c7-5434d5c38b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:59.454095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bdc97-a5af-4a0f-b4c7-5434d5c38b95 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:59.462752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 546/1096] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 26 18:11:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:59.468457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f309be-7dad-46f8-9ea8-fac9e90500be None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:59.471465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:59.575989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f309be-7dad-46f8-9ea8-fac9e90500be None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:59.610212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd35a1-b823-44b2-b559-0d2e9b9b801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:59.610844 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd35a1-b823-44b2-b559-0d2e9b9b801d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:59.611113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd35a1-b823-44b2-b559-0d2e9b9b801d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:59.611380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd35a1-b823-44b2-b559-0d2e9b9b801d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:59.622046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd35a1-b823-44b2-b559-0d2e9b9b801d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:59.623585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd35a1-b823-44b2-b559-0d2e9b9b801d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-71bd35a1-b823-44b2-b559-0d2e9b9b801d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:11:59.637460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:59.638430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:11:59.639570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:11:59.639570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:11:59.639570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:59.639570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 551/1097] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:59.644776 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bdc97-a5af-4a0f-b4c7-5434d5c38b95 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:59.726891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:59.746495 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bdc97-a5af-4a0f-b4c7-5434d5c38b95 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:59.781186 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568b329-137d-48a3-b415-a441c0d598c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:59.781795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568b329-137d-48a3-b415-a441c0d598c8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:59.782079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568b329-137d-48a3-b415-a441c0d598c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:59.782339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568b329-137d-48a3-b415-a441c0d598c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:59.782987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568b329-137d-48a3-b415-a441c0d598c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:11:59.783291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568b329-137d-48a3-b415-a441c0d598c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:59.784667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568b329-137d-48a3-b415-a441c0d598c8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:59.797352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 547/1098] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:11:59.803344 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd35a1-b823-44b2-b559-0d2e9b9b801d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:11:59.860609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:11:59.908050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd35a1-b823-44b2-b559-0d2e9b9b801d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:11:59.942320 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003560b-6786-4d8c-982a-118b6636122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:11:59.942936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003560b-6786-4d8c-982a-118b6636122e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:11:59.943208 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003560b-6786-4d8c-982a-118b6636122e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:11:59.943468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003560b-6786-4d8c-982a-118b6636122e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:11:59.950687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003560b-6786-4d8c-982a-118b6636122e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:11:59.952453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003560b-6786-4d8c-982a-118b6636122e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-2003560b-6786-4d8c-982a-118b6636122e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:11:59.963193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:11:59.964135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:11:59.965149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:11:59.965149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:11:59.965149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:11:59.965149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:11:59.965149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:11:59.965149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:11:59.965149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:11:59.965149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:11:59.965149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 18:11:59.965149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:11:59.965149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 552/1099] 10.222.0.45 () {56 vars in 1093 bytes} [Fri Aug 26 18:11:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:11:59.970403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568b329-137d-48a3-b415-a441c0d598c8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:00.070519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568b329-137d-48a3-b415-a441c0d598c8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:00.104564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1efba-21a6-4f11-99e9-4d96a8ece7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:00.105213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1efba-21a6-4f11-99e9-4d96a8ece7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:00.105456 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1efba-21a6-4f11-99e9-4d96a8ece7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:00.105731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1efba-21a6-4f11-99e9-4d96a8ece7b4 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:00.106460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1efba-21a6-4f11-99e9-4d96a8ece7b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:00.106767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1efba-21a6-4f11-99e9-4d96a8ece7b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:00.108223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1efba-21a6-4f11-99e9-4d96a8ece7b4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:00.122138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:00.126355 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 548/1100] 10.222.0.45 () {56 vars in 1133 bytes} [Fri Aug 26 18:11:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:00.132248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003560b-6786-4d8c-982a-118b6636122e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:00.234785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003560b-6786-4d8c-982a-118b6636122e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:00.248736 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:00.269602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b386c3-95f8-447a-b914-c818bb8692b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:00.270211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b386c3-95f8-447a-b914-c818bb8692b2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:00.270489 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b386c3-95f8-447a-b914-c818bb8692b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:00.270756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b386c3-95f8-447a-b914-c818bb8692b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:00.335195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b386c3-95f8-447a-b914-c818bb8692b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:00.336573 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b386c3-95f8-447a-b914-c818bb8692b2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:00.431967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 553/1101] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:12:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:12:00.437743 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1efba-21a6-4f11-99e9-4d96a8ece7b4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:00.541671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1efba-21a6-4f11-99e9-4d96a8ece7b4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:00.576830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834a650-06f2-439a-a6d7-1cd6a7487afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:00.577461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834a650-06f2-439a-a6d7-1cd6a7487afe None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:00.577771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834a650-06f2-439a-a6d7-1cd6a7487afe None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:00.578011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834a650-06f2-439a-a6d7-1cd6a7487afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:00.588441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834a650-06f2-439a-a6d7-1cd6a7487afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:00.589861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834a650-06f2-439a-a6d7-1cd6a7487afe None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-d834a650-06f2-439a-a6d7-1cd6a7487afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:12:00.605192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:12:00.606149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:12:00.607526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:12:00.607526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:12:00.607526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:12:00.607526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 549/1102] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:12:00.612170 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b386c3-95f8-447a-b914-c818bb8692b2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:00.628937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:00.715163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b386c3-95f8-447a-b914-c818bb8692b2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:00.750894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d45047-6366-427d-8efb-486c410faeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:00.751498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d45047-6366-427d-8efb-486c410faeff None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:00.751772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d45047-6366-427d-8efb-486c410faeff None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:00.752040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d45047-6366-427d-8efb-486c410faeff None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:00.752673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d45047-6366-427d-8efb-486c410faeff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:00.752998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d45047-6366-427d-8efb-486c410faeff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:00.754374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d45047-6366-427d-8efb-486c410faeff None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:00.770362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 554/1103] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:00.771404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834a650-06f2-439a-a6d7-1cd6a7487afe None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:00.832077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:00.881090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834a650-06f2-439a-a6d7-1cd6a7487afe None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:00.915881 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea9aad-1a17-43d3-b798-2196c8ab7f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:00.916504 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea9aad-1a17-43d3-b798-2196c8ab7f09 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:00.916807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea9aad-1a17-43d3-b798-2196c8ab7f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:00.917055 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea9aad-1a17-43d3-b798-2196c8ab7f09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:00.925905 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea9aad-1a17-43d3-b798-2196c8ab7f09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:00.927382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea9aad-1a17-43d3-b798-2196c8ab7f09 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ddea9aad-1a17-43d3-b798-2196c8ab7f09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:12:00.938826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:12:00.939938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:12:00.940884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:12:00.940884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:12:00.940884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:12:00.940884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:12:00.940884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:12:00.940884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:12:00.940884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:12:00.940884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:12:00.940884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 550/1104] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:12:00.946104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d45047-6366-427d-8efb-486c410faeff None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:01.023496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:01.036886 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a138754-6704-4939-be0b-4aae462142b3 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:01.037173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a138754-6704-4939-be0b-4aae462142b3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:01.037448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a138754-6704-4939-be0b-4aae462142b3 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:01.038790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 551/1105] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:01.043868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08117403-bdfb-4c92-931d-ee48a45dd3dd None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:01.044150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08117403-bdfb-4c92-931d-ee48a45dd3dd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:01.044428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08117403-bdfb-4c92-931d-ee48a45dd3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:01.050348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d45047-6366-427d-8efb-486c410faeff None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:01.062613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-08117403-bdfb-4c92-931d-ee48a45dd3dd None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:01.063808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-08117403-bdfb-4c92-931d-ee48a45dd3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:01.084301 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e5ed4-08f2-4c16-8997-b0bf3005564c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:01.084935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e5ed4-08f2-4c16-8997-b0bf3005564c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:01.085211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e5ed4-08f2-4c16-8997-b0bf3005564c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:01.085480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e5ed4-08f2-4c16-8997-b0bf3005564c None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:01.086169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e5ed4-08f2-4c16-8997-b0bf3005564c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:01.086473 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e5ed4-08f2-4c16-8997-b0bf3005564c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:01.087922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e5ed4-08f2-4c16-8997-b0bf3005564c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:01.100252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 555/1106] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:12:01.106658 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e5ed4-08f2-4c16-8997-b0bf3005564c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:01.131863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 552/1107] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:01.211452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e5ed4-08f2-4c16-8997-b0bf3005564c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:01.245414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd263d-d21b-4da0-9d2d-5b16fa0b292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:01.246017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd263d-d21b-4da0-9d2d-5b16fa0b292b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:01.246288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd263d-d21b-4da0-9d2d-5b16fa0b292b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:01.246556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd263d-d21b-4da0-9d2d-5b16fa0b292b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:01.247274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd263d-d21b-4da0-9d2d-5b16fa0b292b None admin] RBAC: Adding query filter params (role.id=5b7184a41c574ff3851c31ce9496e8ae, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=3791df34c6e442aaabd90d7f5c2f3a1a) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:01.247552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd263d-d21b-4da0-9d2d-5b16fa0b292b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:01.249141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd263d-d21b-4da0-9d2d-5b16fa0b292b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:01.250868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:01.255970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 556/1108] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:12:01 2022] GET /identity/v3/role_assignments?user.id=3791df34c6e442aaabd90d7f5c2f3a1a&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5b7184a41c574ff3851c31ce9496e8ae => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:12:01.400567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08117403-bdfb-4c92-931d-ee48a45dd3dd None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:01.450683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:01.511843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08117403-bdfb-4c92-931d-ee48a45dd3dd None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:01.546792 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e88a5-40e3-4b0b-b94b-0d5aa2deed42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:01.547444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e88a5-40e3-4b0b-b94b-0d5aa2deed42 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:01.547726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e88a5-40e3-4b0b-b94b-0d5aa2deed42 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:01.548001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e88a5-40e3-4b0b-b94b-0d5aa2deed42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:01.549261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e88a5-40e3-4b0b-b94b-0d5aa2deed42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:01.550717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e88a5-40e3-4b0b-b94b-0d5aa2deed42 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:01.552534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 553/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:12:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:01.558434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd263d-d21b-4da0-9d2d-5b16fa0b292b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:01.660982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd263d-d21b-4da0-9d2d-5b16fa0b292b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:01.694237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda33ec-5829-4a44-aed3-9c20013c09ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:01.694849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda33ec-5829-4a44-aed3-9c20013c09ee None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:01.695119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda33ec-5829-4a44-aed3-9c20013c09ee None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:01.695376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda33ec-5829-4a44-aed3-9c20013c09ee None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:01.696022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda33ec-5829-4a44-aed3-9c20013c09ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:01.697491 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda33ec-5829-4a44-aed3-9c20013c09ee None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:01.720216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 557/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:12:01 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:12:03.647504 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ff439-8e37-4582-ad88-87aee7c23f2b None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:03.648047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ff439-8e37-4582-ad88-87aee7c23f2b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:03.648047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ff439-8e37-4582-ad88-87aee7c23f2b None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:03.649467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 554/1111] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:03.655575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e64eb4-0fe1-41ba-bced-8fbb1bc982ce None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:03.656266 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e64eb4-0fe1-41ba-bced-8fbb1bc982ce None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:03.656384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e64eb4-0fe1-41ba-bced-8fbb1bc982ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:03.681582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-36e64eb4-0fe1-41ba-bced-8fbb1bc982ce None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:03.682768 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-36e64eb4-0fe1-41ba-bced-8fbb1bc982ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:03.735050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:03.755899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 558/1112] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:04.030833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ff439-8e37-4582-ad88-87aee7c23f2b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:04.150588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ff439-8e37-4582-ad88-87aee7c23f2b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:04.162961 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:04.195843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95b8a4-a75d-4cdf-a4c3-78178a93efa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:04.196488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95b8a4-a75d-4cdf-a4c3-78178a93efa3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:04.196766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95b8a4-a75d-4cdf-a4c3-78178a93efa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:04.197064 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95b8a4-a75d-4cdf-a4c3-78178a93efa3 None admin] PATH_INFO: `/v3/roles/db4150b658a14804af1bf240ea2e31f9` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:04.198863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95b8a4-a75d-4cdf-a4c3-78178a93efa3 None admin] RBAC: Authorizing `identity:get_role(role_id=db4150b658a14804af1bf240ea2e31f9)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:04.200761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95b8a4-a75d-4cdf-a4c3-78178a93efa3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:04.202221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 555/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:12:04 2022] GET /identity/v3/roles/db4150b658a14804af1bf240ea2e31f9 => generated 223 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:04.211956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e64eb4-0fe1-41ba-bced-8fbb1bc982ce None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:04.328646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e64eb4-0fe1-41ba-bced-8fbb1bc982ce None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:04.380234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff6eb7-1e51-40b0-a27f-67566c7f8b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:04.380885 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6eb7-1e51-40b0-a27f-67566c7f8b0c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:04.381159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6eb7-1e51-40b0-a27f-67566c7f8b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:04.381423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6eb7-1e51-40b0-a27f-67566c7f8b0c None admin] PATH_INFO: `/v3/users/02f1fdb473a241c787db00468aaddaab` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:04.396530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff6eb7-1e51-40b0-a27f-67566c7f8b0c None admin] RBAC: Authorizing `identity:get_user(user_id=02f1fdb473a241c787db00468aaddaab)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:04.398037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff6eb7-1e51-40b0-a27f-67566c7f8b0c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:04.399644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 559/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:12:04 2022] GET /identity/v3/users/02f1fdb473a241c787db00468aaddaab => generated 286 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:04.409391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95b8a4-a75d-4cdf-a4c3-78178a93efa3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:04.523637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95b8a4-a75d-4cdf-a4c3-78178a93efa3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:04.558436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98874a20-0a98-43d3-ae8c-bd8d37fd2f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:04.559036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98874a20-0a98-43d3-ae8c-bd8d37fd2f37 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:04.559315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98874a20-0a98-43d3-ae8c-bd8d37fd2f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:04.559587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98874a20-0a98-43d3-ae8c-bd8d37fd2f37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:04.606183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:04.630001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98874a20-0a98-43d3-ae8c-bd8d37fd2f37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:04.631452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98874a20-0a98-43d3-ae8c-bd8d37fd2f37 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:04.733485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 556/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:12:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:12:04.739977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff6eb7-1e51-40b0-a27f-67566c7f8b0c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:04.782617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:04.858754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff6eb7-1e51-40b0-a27f-67566c7f8b0c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:04.898102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33994c8-bfd8-4978-b6de-71e310261537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:04.898725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33994c8-bfd8-4978-b6de-71e310261537 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:04.899000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33994c8-bfd8-4978-b6de-71e310261537 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:04.899270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33994c8-bfd8-4978-b6de-71e310261537 None admin] PATH_INFO: `/v3/projects/46984fafe5d145baab3474d73f84ef4b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:04.900446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33994c8-bfd8-4978-b6de-71e310261537 None admin] RBAC: Authorizing `identity:get_project(project_id=46984fafe5d145baab3474d73f84ef4b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:04.901921 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33994c8-bfd8-4978-b6de-71e310261537 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:04.903566 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 560/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:12:04 2022] GET /identity/v3/projects/46984fafe5d145baab3474d73f84ef4b => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:04.910180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98874a20-0a98-43d3-ae8c-bd8d37fd2f37 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:04.997643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:05.026199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98874a20-0a98-43d3-ae8c-bd8d37fd2f37 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:05.061525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658232cc-b657-407e-989b-fb44b833dfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:05.062218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658232cc-b657-407e-989b-fb44b833dfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:05.062596 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658232cc-b657-407e-989b-fb44b833dfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:05.062982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658232cc-b657-407e-989b-fb44b833dfe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:05.063790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658232cc-b657-407e-989b-fb44b833dfe5 None admin] RBAC: Adding query filter params (role.id=db4150b658a14804af1bf240ea2e31f9, scope.project.id=46984fafe5d145baab3474d73f84ef4b, user.id=02f1fdb473a241c787db00468aaddaab) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:05.064184 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658232cc-b657-407e-989b-fb44b833dfe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:05.065749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658232cc-b657-407e-989b-fb44b833dfe5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:05.071326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 557/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:12:04 2022] GET /identity/v3/role_assignments?user.id=02f1fdb473a241c787db00468aaddaab&scope.project.id=46984fafe5d145baab3474d73f84ef4b&role.id=db4150b658a14804af1bf240ea2e31f9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:06.926598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a5139-f5ff-4e19-a69b-930500ff832c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:06.927262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a5139-f5ff-4e19-a69b-930500ff832c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:06.927262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a5139-f5ff-4e19-a69b-930500ff832c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:06.928656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 561/1118] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:12:06.934867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da72b6-ad8a-42bd-bcdf-3818eea9f66a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:06.935638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da72b6-ad8a-42bd-bcdf-3818eea9f66a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:06.935792 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da72b6-ad8a-42bd-bcdf-3818eea9f66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:06.955075 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a7da72b6-ad8a-42bd-bcdf-3818eea9f66a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:06.956251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a7da72b6-ad8a-42bd-bcdf-3818eea9f66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:07.029420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 558/1119] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:07.291469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a5139-f5ff-4e19-a69b-930500ff832c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:07.406259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a5139-f5ff-4e19-a69b-930500ff832c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:07.418015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:07.443903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622b403-3c09-4383-946c-e66b9b6daaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:07.444524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b403-3c09-4383-946c-e66b9b6daaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:07.444829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b403-3c09-4383-946c-e66b9b6daaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:07.445099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b403-3c09-4383-946c-e66b9b6daaa0 None admin] PATH_INFO: `/v3/roles/db4150b658a14804af1bf240ea2e31f9` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:07.446530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622b403-3c09-4383-946c-e66b9b6daaa0 None admin] RBAC: Authorizing `identity:get_role(role_id=db4150b658a14804af1bf240ea2e31f9)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:07.447914 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622b403-3c09-4383-946c-e66b9b6daaa0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:07.449278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 562/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:12:07 2022] GET /identity/v3/roles/db4150b658a14804af1bf240ea2e31f9 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:07.455529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da72b6-ad8a-42bd-bcdf-3818eea9f66a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:07.538660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:07.575052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da72b6-ad8a-42bd-bcdf-3818eea9f66a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:07.614850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79d831-ecf0-4722-9a59-c47c9afb4b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:07.615480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d831-ecf0-4722-9a59-c47c9afb4b3c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:07.615757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d831-ecf0-4722-9a59-c47c9afb4b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:07.616030 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d831-ecf0-4722-9a59-c47c9afb4b3c None admin] PATH_INFO: `/v3/users/02f1fdb473a241c787db00468aaddaab` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:07.617309 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79d831-ecf0-4722-9a59-c47c9afb4b3c None admin] RBAC: Authorizing `identity:get_user(user_id=02f1fdb473a241c787db00468aaddaab)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:07.618750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79d831-ecf0-4722-9a59-c47c9afb4b3c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:07.620404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 559/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:12:07 2022] GET /identity/v3/users/02f1fdb473a241c787db00468aaddaab => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:07.626549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622b403-3c09-4383-946c-e66b9b6daaa0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:07.732544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622b403-3c09-4383-946c-e66b9b6daaa0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:07.769104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a5f08-5ca6-4982-aaf5-26c8c3a3d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:07.769725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a5f08-5ca6-4982-aaf5-26c8c3a3d588 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:07.770006 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a5f08-5ca6-4982-aaf5-26c8c3a3d588 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:07.770274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a5f08-5ca6-4982-aaf5-26c8c3a3d588 None admin] PATH_INFO: `/v3/projects/46984fafe5d145baab3474d73f84ef4b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:07.771523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a5f08-5ca6-4982-aaf5-26c8c3a3d588 None admin] RBAC: Authorizing `identity:get_project(project_id=46984fafe5d145baab3474d73f84ef4b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:07.772999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a5f08-5ca6-4982-aaf5-26c8c3a3d588 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:07.774624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 563/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:12:07 2022] GET /identity/v3/projects/46984fafe5d145baab3474d73f84ef4b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:07.781297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79d831-ecf0-4722-9a59-c47c9afb4b3c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:07.920092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79d831-ecf0-4722-9a59-c47c9afb4b3c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:07.957906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230eca9-5e14-4eb4-b466-ea739571f804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:07.958547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230eca9-5e14-4eb4-b466-ea739571f804 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:07.958832 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230eca9-5e14-4eb4-b466-ea739571f804 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:07.959098 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230eca9-5e14-4eb4-b466-ea739571f804 None admin] PATH_INFO: `/v3/projects/46984fafe5d145baab3474d73f84ef4b/users/02f1fdb473a241c787db00468aaddaab/roles/db4150b658a14804af1bf240ea2e31f9` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:07.961591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230eca9-5e14-4eb4-b466-ea739571f804 None admin] RBAC: Authorizing `identity:create_grant(project_id=46984fafe5d145baab3474d73f84ef4b, user_id=02f1fdb473a241c787db00468aaddaab, role_id=db4150b658a14804af1bf240ea2e31f9)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:07.963030 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230eca9-5e14-4eb4-b466-ea739571f804 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:07.976963 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:07.984891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 560/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:12:07 2022] PUT /identity/v3/projects/46984fafe5d145baab3474d73f84ef4b/users/02f1fdb473a241c787db00468aaddaab/roles/db4150b658a14804af1bf240ea2e31f9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:12:09.863380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f08ba-148d-424f-9ce7-ead7afab2ae3 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:09.863912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f08ba-148d-424f-9ce7-ead7afab2ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:09.863912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f08ba-148d-424f-9ce7-ead7afab2ae3 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:09.865261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 564/1124] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:09.871639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc613fea-fa4d-4146-a2f0-e8e6278da437 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:09.872364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc613fea-fa4d-4146-a2f0-e8e6278da437 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:09.872520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc613fea-fa4d-4146-a2f0-e8e6278da437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:09.892564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-bc613fea-fa4d-4146-a2f0-e8e6278da437 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:09.893784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bc613fea-fa4d-4146-a2f0-e8e6278da437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:09.968020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 561/1125] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:10.242385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f08ba-148d-424f-9ce7-ead7afab2ae3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:10.294206 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:10.350410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f08ba-148d-424f-9ce7-ead7afab2ae3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:10.385904 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2077aca-7b5d-4902-9751-e178f228d0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:10.386519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2077aca-7b5d-4902-9751-e178f228d0be None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:10.386795 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2077aca-7b5d-4902-9751-e178f228d0be None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:10.387066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2077aca-7b5d-4902-9751-e178f228d0be None admin] PATH_INFO: `/v3/roles/db4150b658a14804af1bf240ea2e31f9` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:10.388510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2077aca-7b5d-4902-9751-e178f228d0be None admin] RBAC: Authorizing `identity:get_role(role_id=db4150b658a14804af1bf240ea2e31f9)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:10.389994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2077aca-7b5d-4902-9751-e178f228d0be None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:10.391327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 565/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:12:10 2022] GET /identity/v3/roles/db4150b658a14804af1bf240ea2e31f9 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:10.398334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc613fea-fa4d-4146-a2f0-e8e6278da437 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:10.520835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc613fea-fa4d-4146-a2f0-e8e6278da437 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:10.559236 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:10.566569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d3e2c-32b3-4b8f-bd20-580027ec7647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:10.567211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d3e2c-32b3-4b8f-bd20-580027ec7647 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:10.567490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d3e2c-32b3-4b8f-bd20-580027ec7647 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:10.567759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d3e2c-32b3-4b8f-bd20-580027ec7647 None admin] PATH_INFO: `/v3/users/02f1fdb473a241c787db00468aaddaab` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:10.568947 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d3e2c-32b3-4b8f-bd20-580027ec7647 None admin] RBAC: Authorizing `identity:get_user(user_id=02f1fdb473a241c787db00468aaddaab)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:10.570404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d3e2c-32b3-4b8f-bd20-580027ec7647 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:10.571968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 562/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:12:10 2022] GET /identity/v3/users/02f1fdb473a241c787db00468aaddaab => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:10.578101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2077aca-7b5d-4902-9751-e178f228d0be None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:10.698842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2077aca-7b5d-4902-9751-e178f228d0be None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:10.712907 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:10.735515 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7aed89-7591-4533-93b5-7832c8d6a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:10.736123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7aed89-7591-4533-93b5-7832c8d6a969 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:10.736398 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7aed89-7591-4533-93b5-7832c8d6a969 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:10.736665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7aed89-7591-4533-93b5-7832c8d6a969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:10.810812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7aed89-7591-4533-93b5-7832c8d6a969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:10.812293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7aed89-7591-4533-93b5-7832c8d6a969 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:10.915313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 566/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:12:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:12:10.922243 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d3e2c-32b3-4b8f-bd20-580027ec7647 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:11.032453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d3e2c-32b3-4b8f-bd20-580027ec7647 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:11.070398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bbb1f-9879-4f8e-ad6c-2fe4aa326d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:11.070956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bbb1f-9879-4f8e-ad6c-2fe4aa326d14 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:11.071230 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bbb1f-9879-4f8e-ad6c-2fe4aa326d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:11.071505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bbb1f-9879-4f8e-ad6c-2fe4aa326d14 None admin] PATH_INFO: `/v3/projects/46984fafe5d145baab3474d73f84ef4b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:11.072652 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bbb1f-9879-4f8e-ad6c-2fe4aa326d14 None admin] RBAC: Authorizing `identity:get_project(project_id=46984fafe5d145baab3474d73f84ef4b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:11.074146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bbb1f-9879-4f8e-ad6c-2fe4aa326d14 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:11.075809 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 563/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:12:10 2022] GET /identity/v3/projects/46984fafe5d145baab3474d73f84ef4b => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:11.082592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7aed89-7591-4533-93b5-7832c8d6a969 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:11.097912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:11.194587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7aed89-7591-4533-93b5-7832c8d6a969 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:11.230280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3829c-44fe-46d2-a777-91847ea7a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:11.230880 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3829c-44fe-46d2-a777-91847ea7a244 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:11.231158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3829c-44fe-46d2-a777-91847ea7a244 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:11.231427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3829c-44fe-46d2-a777-91847ea7a244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:11.232150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3829c-44fe-46d2-a777-91847ea7a244 None admin] RBAC: Adding query filter params (role.id=db4150b658a14804af1bf240ea2e31f9, scope.project.id=46984fafe5d145baab3474d73f84ef4b, user.id=02f1fdb473a241c787db00468aaddaab) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:11.232462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3829c-44fe-46d2-a777-91847ea7a244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:11.233998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3829c-44fe-46d2-a777-91847ea7a244 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:11.242043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 567/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:12:11 2022] GET /identity/v3/role_assignments?user.id=02f1fdb473a241c787db00468aaddaab&scope.project.id=46984fafe5d145baab3474d73f84ef4b&role.id=db4150b658a14804af1bf240ea2e31f9 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:13.146898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a99de-c492-438e-97c4-07073f9505f4 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:13.147480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a99de-c492-438e-97c4-07073f9505f4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:13.147480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a99de-c492-438e-97c4-07073f9505f4 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:13.149618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 564/1131] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:13.158123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750cb86-7544-47d1-a595-7dea51fe2911 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:13.158514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750cb86-7544-47d1-a595-7dea51fe2911 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:13.158722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750cb86-7544-47d1-a595-7dea51fe2911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:13.187290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3750cb86-7544-47d1-a595-7dea51fe2911 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:13.188485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3750cb86-7544-47d1-a595-7dea51fe2911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:13.262810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 568/1132] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:13.539441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a99de-c492-438e-97c4-07073f9505f4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:13.609984 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:13.649673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a99de-c492-438e-97c4-07073f9505f4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:13.685342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d76c0-c939-4a91-8d2f-38a1d9ca7838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:13.685959 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d76c0-c939-4a91-8d2f-38a1d9ca7838 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:13.686289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d76c0-c939-4a91-8d2f-38a1d9ca7838 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:13.686575 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d76c0-c939-4a91-8d2f-38a1d9ca7838 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:13.687720 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d76c0-c939-4a91-8d2f-38a1d9ca7838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:13.689200 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d76c0-c939-4a91-8d2f-38a1d9ca7838 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:13.690771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 565/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:12:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:13.699502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750cb86-7544-47d1-a595-7dea51fe2911 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:13.710427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:13.801468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750cb86-7544-47d1-a595-7dea51fe2911 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:13.836155 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe7ba2-7dc0-4428-a9ac-65565943641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:13.836755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe7ba2-7dc0-4428-a9ac-65565943641b None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:13.837055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe7ba2-7dc0-4428-a9ac-65565943641b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:13.837324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe7ba2-7dc0-4428-a9ac-65565943641b None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:13.837975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe7ba2-7dc0-4428-a9ac-65565943641b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:13.839405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe7ba2-7dc0-4428-a9ac-65565943641b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:13.874623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 569/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:12:13 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:12:15.786955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701b13b-9baa-411f-ade8-6baec8f085d0 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:15.787467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701b13b-9baa-411f-ade8-6baec8f085d0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:15.787467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701b13b-9baa-411f-ade8-6baec8f085d0 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:15.788790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 566/1135] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:15.794474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac429a0c-bcce-4f27-90bf-ed0a7a744120 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:15.794936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac429a0c-bcce-4f27-90bf-ed0a7a744120 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:15.795025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac429a0c-bcce-4f27-90bf-ed0a7a744120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:15.813795 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ac429a0c-bcce-4f27-90bf-ed0a7a744120 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:15.815019 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ac429a0c-bcce-4f27-90bf-ed0a7a744120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:15.873624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:15.888604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 570/1136] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:16.156945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701b13b-9baa-411f-ade8-6baec8f085d0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:16.268314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701b13b-9baa-411f-ade8-6baec8f085d0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:16.303429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffbb85-3a4a-420f-a8a6-80a4240944c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:16.304046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffbb85-3a4a-420f-a8a6-80a4240944c2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:16.304330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffbb85-3a4a-420f-a8a6-80a4240944c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:16.304600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffbb85-3a4a-420f-a8a6-80a4240944c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:16.305859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffbb85-3a4a-420f-a8a6-80a4240944c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:16.307293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffbb85-3a4a-420f-a8a6-80a4240944c2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:16.308951 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 567/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:12:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:16.315036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac429a0c-bcce-4f27-90bf-ed0a7a744120 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:16.417800 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac429a0c-bcce-4f27-90bf-ed0a7a744120 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:16.462491 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf209a5e-f9a7-407a-bbc3-d2c100483466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:16.463105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf209a5e-f9a7-407a-bbc3-d2c100483466 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:16.463404 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf209a5e-f9a7-407a-bbc3-d2c100483466 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:16.463672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf209a5e-f9a7-407a-bbc3-d2c100483466 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:16.464331 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf209a5e-f9a7-407a-bbc3-d2c100483466 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:16.465847 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf209a5e-f9a7-407a-bbc3-d2c100483466 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:16.489983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 571/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:12:16 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:12:18.414746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aa985-6196-4c0a-9ecb-782532078e1a None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:18.415640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aa985-6196-4c0a-9ecb-782532078e1a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:18.415640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aa985-6196-4c0a-9ecb-782532078e1a None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:18.417851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 568/1139] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:18.424388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2c42f-c2c6-481e-8d39-62b3fb568931 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:18.424874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2c42f-c2c6-481e-8d39-62b3fb568931 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:18.424977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2c42f-c2c6-481e-8d39-62b3fb568931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:18.448689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8ef2c42f-c2c6-481e-8d39-62b3fb568931 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:18.449940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8ef2c42f-c2c6-481e-8d39-62b3fb568931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:18.508110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:18.537437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 572/1140] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:18.804668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aa985-6196-4c0a-9ecb-782532078e1a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:18.808297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:18.918928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aa985-6196-4c0a-9ecb-782532078e1a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:18.953985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f5601-d694-4d99-b224-ca42bd7a9ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:18.954611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f5601-d694-4d99-b224-ca42bd7a9ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:18.954891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f5601-d694-4d99-b224-ca42bd7a9ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:18.955159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f5601-d694-4d99-b224-ca42bd7a9ec4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:18.965135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f5601-d694-4d99-b224-ca42bd7a9ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-773f5601-d694-4d99-b224-ca42bd7a9ec4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:12:18.969985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:12:18.971090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:12:18.971998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 569/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:12:18.978202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2c42f-c2c6-481e-8d39-62b3fb568931 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:19.095388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2c42f-c2c6-481e-8d39-62b3fb568931 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:19.131396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb7879-9bc5-4756-a2f9-cef8b6d23e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:19.132001 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb7879-9bc5-4756-a2f9-cef8b6d23e08 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:19.132276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb7879-9bc5-4756-a2f9-cef8b6d23e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:19.132547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb7879-9bc5-4756-a2f9-cef8b6d23e08 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:19.133240 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb7879-9bc5-4756-a2f9-cef8b6d23e08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:19.133547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb7879-9bc5-4756-a2f9-cef8b6d23e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:19.134931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb7879-9bc5-4756-a2f9-cef8b6d23e08 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:19.143483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 573/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:19.152182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f5601-d694-4d99-b224-ca42bd7a9ec4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:19.215178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:19.254919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f5601-d694-4d99-b224-ca42bd7a9ec4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:19.289966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20162cd-f597-482e-8e39-6a477569ed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:19.290583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20162cd-f597-482e-8e39-6a477569ed60 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:19.290864 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20162cd-f597-482e-8e39-6a477569ed60 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:19.291142 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20162cd-f597-482e-8e39-6a477569ed60 None admin] PATH_INFO: `/v3/users/441c3019cee6412cbfc660695d97a2bc` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:19.305477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20162cd-f597-482e-8e39-6a477569ed60 None admin] RBAC: Authorizing `identity:get_user(user_id=441c3019cee6412cbfc660695d97a2bc)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:19.306929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20162cd-f597-482e-8e39-6a477569ed60 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:19.308520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 570/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:12:19 2022] GET /identity/v3/users/441c3019cee6412cbfc660695d97a2bc => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:19.314878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb7879-9bc5-4756-a2f9-cef8b6d23e08 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:19.360770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:19.429862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb7879-9bc5-4756-a2f9-cef8b6d23e08 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:19.465054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccb820-cd4c-439b-8e38-3ea6e2f4e013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:19.465656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccb820-cd4c-439b-8e38-3ea6e2f4e013 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:19.465934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccb820-cd4c-439b-8e38-3ea6e2f4e013 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:19.466204 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccb820-cd4c-439b-8e38-3ea6e2f4e013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:19.536054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ccb820-cd4c-439b-8e38-3ea6e2f4e013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:19.537556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ccb820-cd4c-439b-8e38-3ea6e2f4e013 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:19.577060 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:19.643915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 574/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:12:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:12:19.650025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20162cd-f597-482e-8e39-6a477569ed60 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:19.750919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20162cd-f597-482e-8e39-6a477569ed60 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:19.785781 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:19.804393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d3b20-d2c2-4af2-a2c6-de171df6ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:19.805383 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d3b20-d2c2-4af2-a2c6-de171df6ea96 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:19.805873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d3b20-d2c2-4af2-a2c6-de171df6ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:19.806267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d3b20-d2c2-4af2-a2c6-de171df6ea96 None admin] PATH_INFO: `/v3/projects/7261ee3c3a2044409dc655db0b0ca5f9` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:19.808046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d3b20-d2c2-4af2-a2c6-de171df6ea96 None admin] RBAC: Authorizing `identity:get_project(project_id=7261ee3c3a2044409dc655db0b0ca5f9)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:19.810420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d3b20-d2c2-4af2-a2c6-de171df6ea96 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:19.812835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 571/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:12:19 2022] GET /identity/v3/projects/7261ee3c3a2044409dc655db0b0ca5f9 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:19.819295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccb820-cd4c-439b-8e38-3ea6e2f4e013 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:19.922262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccb820-cd4c-439b-8e38-3ea6e2f4e013 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:19.957236 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b58e7-9a1f-4532-901f-bbc9f4a5f764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:19.957830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b58e7-9a1f-4532-901f-bbc9f4a5f764 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:19.958104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b58e7-9a1f-4532-901f-bbc9f4a5f764 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:19.958374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b58e7-9a1f-4532-901f-bbc9f4a5f764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:19.959090 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b58e7-9a1f-4532-901f-bbc9f4a5f764 None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=7261ee3c3a2044409dc655db0b0ca5f9, user.id=441c3019cee6412cbfc660695d97a2bc) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:19.959393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b58e7-9a1f-4532-901f-bbc9f4a5f764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:19.960860 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b58e7-9a1f-4532-901f-bbc9f4a5f764 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:19.966292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 575/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:12:19 2022] GET /identity/v3/role_assignments?user.id=441c3019cee6412cbfc660695d97a2bc&scope.project.id=7261ee3c3a2044409dc655db0b0ca5f9&role.id=db572ad3d504403cbb227c2155c93eda => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:21.821511 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eec723-c042-467d-87a0-6d70aa824bee None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:21.822348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eec723-c042-467d-87a0-6d70aa824bee None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:21.822348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eec723-c042-467d-87a0-6d70aa824bee None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:21.824419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 572/1147] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:21.830839 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807025d-c281-4dfb-8550-719dd1639265 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:21.831273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807025d-c281-4dfb-8550-719dd1639265 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:21.831404 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807025d-c281-4dfb-8550-719dd1639265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:21.841490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:21.856523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f807025d-c281-4dfb-8550-719dd1639265 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:21.857775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f807025d-c281-4dfb-8550-719dd1639265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:21.930740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 576/1148] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:22.206967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eec723-c042-467d-87a0-6d70aa824bee None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:22.320050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eec723-c042-467d-87a0-6d70aa824bee None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:22.354575 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c3fe6-f3cc-4fa4-9ea5-ddf5b534535e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:22.355209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c3fe6-f3cc-4fa4-9ea5-ddf5b534535e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:22.355484 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c3fe6-f3cc-4fa4-9ea5-ddf5b534535e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:22.355750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c3fe6-f3cc-4fa4-9ea5-ddf5b534535e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:22.366021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c3fe6-f3cc-4fa4-9ea5-ddf5b534535e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b57c3fe6-f3cc-4fa4-9ea5-ddf5b534535e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:12:22.370702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:12:22.371831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:12:22.372825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 573/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:12:22.378911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807025d-c281-4dfb-8550-719dd1639265 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:22.497375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807025d-c281-4dfb-8550-719dd1639265 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:22.526349 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:22.532585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aa771-ea96-494a-bacf-354b3de1dc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:22.533259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aa771-ea96-494a-bacf-354b3de1dc0d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:22.533535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aa771-ea96-494a-bacf-354b3de1dc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:22.533820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aa771-ea96-494a-bacf-354b3de1dc0d None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:22.534484 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aa771-ea96-494a-bacf-354b3de1dc0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:22.534787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aa771-ea96-494a-bacf-354b3de1dc0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:22.536177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aa771-ea96-494a-bacf-354b3de1dc0d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:22.544748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 577/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:22.551021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c3fe6-f3cc-4fa4-9ea5-ddf5b534535e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:22.603212 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:22.659303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c3fe6-f3cc-4fa4-9ea5-ddf5b534535e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:22.695303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324b15f-03fb-43e5-86d0-a27f31021a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:22.695929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324b15f-03fb-43e5-86d0-a27f31021a0d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:22.696165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324b15f-03fb-43e5-86d0-a27f31021a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:22.696466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324b15f-03fb-43e5-86d0-a27f31021a0d None admin] PATH_INFO: `/v3/users/441c3019cee6412cbfc660695d97a2bc` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:22.697744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324b15f-03fb-43e5-86d0-a27f31021a0d None admin] RBAC: Authorizing `identity:get_user(user_id=441c3019cee6412cbfc660695d97a2bc)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:22.699177 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324b15f-03fb-43e5-86d0-a27f31021a0d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:22.700808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 574/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:12:22 2022] GET /identity/v3/users/441c3019cee6412cbfc660695d97a2bc => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:12:22.709872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aa771-ea96-494a-bacf-354b3de1dc0d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:22.822507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aa771-ea96-494a-bacf-354b3de1dc0d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:22.857438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce9a5c-1371-427e-8255-2e93f2e460bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:22.858118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce9a5c-1371-427e-8255-2e93f2e460bf None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:22.858433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce9a5c-1371-427e-8255-2e93f2e460bf None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:22.858702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce9a5c-1371-427e-8255-2e93f2e460bf None admin] PATH_INFO: `/v3/projects/7261ee3c3a2044409dc655db0b0ca5f9` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:22.859937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce9a5c-1371-427e-8255-2e93f2e460bf None admin] RBAC: Authorizing `identity:get_project(project_id=7261ee3c3a2044409dc655db0b0ca5f9)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:22.861431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce9a5c-1371-427e-8255-2e93f2e460bf None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:22.863926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 578/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:12:22 2022] GET /identity/v3/projects/7261ee3c3a2044409dc655db0b0ca5f9 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:22.870178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324b15f-03fb-43e5-86d0-a27f31021a0d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:22.978473 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324b15f-03fb-43e5-86d0-a27f31021a0d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:22.995793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:23.014185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb468739-c428-41a3-8327-8cfd42dc1bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:23.014881 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb468739-c428-41a3-8327-8cfd42dc1bc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:23.015170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb468739-c428-41a3-8327-8cfd42dc1bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:23.015444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb468739-c428-41a3-8327-8cfd42dc1bc7 None admin] PATH_INFO: `/v3/projects/7261ee3c3a2044409dc655db0b0ca5f9/users/441c3019cee6412cbfc660695d97a2bc/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:23.017398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb468739-c428-41a3-8327-8cfd42dc1bc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7261ee3c3a2044409dc655db0b0ca5f9, user_id=441c3019cee6412cbfc660695d97a2bc, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:23.018835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb468739-c428-41a3-8327-8cfd42dc1bc7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:23.034626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 575/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:12:22 2022] PUT /identity/v3/projects/7261ee3c3a2044409dc655db0b0ca5f9/users/441c3019cee6412cbfc660695d97a2bc/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:12:24.919613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec26ca-0ce5-40a2-89ac-9bbcf999666c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:24.920414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec26ca-0ce5-40a2-89ac-9bbcf999666c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:24.920414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec26ca-0ce5-40a2-89ac-9bbcf999666c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:24.922300 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 579/1154] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:24.930936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bd066-5606-4041-af77-a174479dcc8b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:24.931354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bd066-5606-4041-af77-a174479dcc8b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:24.931505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bd066-5606-4041-af77-a174479dcc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:24.952930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-143bd066-5606-4041-af77-a174479dcc8b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:24.954122 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-143bd066-5606-4041-af77-a174479dcc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:25.036041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 576/1155] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:25.298280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec26ca-0ce5-40a2-89ac-9bbcf999666c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:25.365226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:25.421625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec26ca-0ce5-40a2-89ac-9bbcf999666c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:25.457709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286276-9fa8-4494-b434-757740ebb2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:25.458323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286276-9fa8-4494-b434-757740ebb2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:25.458598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286276-9fa8-4494-b434-757740ebb2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:25.458857 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286276-9fa8-4494-b434-757740ebb2f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:25.469649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b286276-9fa8-4494-b434-757740ebb2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1b286276-9fa8-4494-b434-757740ebb2f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:12:25.477302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:12:25.478371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:12:25.479767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 580/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:12:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:12:25.486738 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bd066-5606-4041-af77-a174479dcc8b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:25.590572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bd066-5606-4041-af77-a174479dcc8b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:25.597874 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:25.626456 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c940a-d6c8-49ad-bd3e-27bbc1a483d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:25.627057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c940a-d6c8-49ad-bd3e-27bbc1a483d4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:25.627332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c940a-d6c8-49ad-bd3e-27bbc1a483d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:25.627602 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c940a-d6c8-49ad-bd3e-27bbc1a483d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:25.628254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c940a-d6c8-49ad-bd3e-27bbc1a483d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:25.628555 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c940a-d6c8-49ad-bd3e-27bbc1a483d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:25.629953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c940a-d6c8-49ad-bd3e-27bbc1a483d4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:25.638026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 577/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:12:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:25.644183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286276-9fa8-4494-b434-757740ebb2f8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:25.750213 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286276-9fa8-4494-b434-757740ebb2f8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:25.773664 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:25.786846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbeebd-8eae-43f7-916d-9732c63329d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:25.787475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbeebd-8eae-43f7-916d-9732c63329d5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:25.787754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbeebd-8eae-43f7-916d-9732c63329d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:25.788028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbeebd-8eae-43f7-916d-9732c63329d5 None admin] PATH_INFO: `/v3/users/441c3019cee6412cbfc660695d97a2bc` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:25.789236 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbeebd-8eae-43f7-916d-9732c63329d5 None admin] RBAC: Authorizing `identity:get_user(user_id=441c3019cee6412cbfc660695d97a2bc)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:25.790684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbeebd-8eae-43f7-916d-9732c63329d5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:25.792286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 581/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:12:25 2022] GET /identity/v3/users/441c3019cee6412cbfc660695d97a2bc => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:25.799144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c940a-d6c8-49ad-bd3e-27bbc1a483d4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:25.910185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c940a-d6c8-49ad-bd3e-27bbc1a483d4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:25.944842 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf3ab0-03ae-431e-87c1-4a563ff17cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:25.945464 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf3ab0-03ae-431e-87c1-4a563ff17cbe None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:25.945707 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf3ab0-03ae-431e-87c1-4a563ff17cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:25.945965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf3ab0-03ae-431e-87c1-4a563ff17cbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:25.983745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:26.031952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf3ab0-03ae-431e-87c1-4a563ff17cbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:26.033441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf3ab0-03ae-431e-87c1-4a563ff17cbe None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:26.138252 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 578/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:12:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:12:26.144500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbeebd-8eae-43f7-916d-9732c63329d5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:26.253174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbeebd-8eae-43f7-916d-9732c63329d5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:26.292372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdef3e-9466-4bbf-afa2-271f075b292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:26.293025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdef3e-9466-4bbf-afa2-271f075b292a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:26.293300 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdef3e-9466-4bbf-afa2-271f075b292a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:26.293566 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdef3e-9466-4bbf-afa2-271f075b292a None admin] PATH_INFO: `/v3/projects/7261ee3c3a2044409dc655db0b0ca5f9` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:26.294748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdef3e-9466-4bbf-afa2-271f075b292a None admin] RBAC: Authorizing `identity:get_project(project_id=7261ee3c3a2044409dc655db0b0ca5f9)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:26.296257 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdef3e-9466-4bbf-afa2-271f075b292a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:26.297943 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 582/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:12:26 2022] GET /identity/v3/projects/7261ee3c3a2044409dc655db0b0ca5f9 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:26.304501 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf3ab0-03ae-431e-87c1-4a563ff17cbe None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:26.384688 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:26.420735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf3ab0-03ae-431e-87c1-4a563ff17cbe None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:26.455535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17815a-c4ce-4b6e-af06-1644db89b516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:26.456129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17815a-c4ce-4b6e-af06-1644db89b516 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:26.456402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17815a-c4ce-4b6e-af06-1644db89b516 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:26.456666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17815a-c4ce-4b6e-af06-1644db89b516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:26.457426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17815a-c4ce-4b6e-af06-1644db89b516 None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=7261ee3c3a2044409dc655db0b0ca5f9, user.id=441c3019cee6412cbfc660695d97a2bc) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:26.457728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17815a-c4ce-4b6e-af06-1644db89b516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:26.459156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17815a-c4ce-4b6e-af06-1644db89b516 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:26.465061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 579/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:12:26 2022] GET /identity/v3/role_assignments?user.id=441c3019cee6412cbfc660695d97a2bc&scope.project.id=7261ee3c3a2044409dc655db0b0ca5f9&role.id=db572ad3d504403cbb227c2155c93eda => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:28.359875 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094c260-7786-4e91-bbe1-f7b4c2fe4cac None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:28.360432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094c260-7786-4e91-bbe1-f7b4c2fe4cac None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:28.360432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094c260-7786-4e91-bbe1-f7b4c2fe4cac None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:28.361791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 583/1162] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:28.368215 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f648b-0c9c-4bac-9e40-e8de572a63b5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:28.368975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f648b-0c9c-4bac-9e40-e8de572a63b5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:28.369145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f648b-0c9c-4bac-9e40-e8de572a63b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:28.395833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fb9f648b-0c9c-4bac-9e40-e8de572a63b5 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:28.397073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fb9f648b-0c9c-4bac-9e40-e8de572a63b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:28.479043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 580/1163] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:28.741927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094c260-7786-4e91-bbe1-f7b4c2fe4cac None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:28.810690 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:28.859343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094c260-7786-4e91-bbe1-f7b4c2fe4cac None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:28.896264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c06ef8-26ca-4231-98f8-901602c0e347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:28.896893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c06ef8-26ca-4231-98f8-901602c0e347 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:28.897172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c06ef8-26ca-4231-98f8-901602c0e347 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:28.897444 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c06ef8-26ca-4231-98f8-901602c0e347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:28.965236 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c06ef8-26ca-4231-98f8-901602c0e347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:28.966694 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c06ef8-26ca-4231-98f8-901602c0e347 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:29.025929 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:29.069121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 584/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:12:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:12:29.075262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f648b-0c9c-4bac-9e40-e8de572a63b5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:29.141489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:29.201095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f648b-0c9c-4bac-9e40-e8de572a63b5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:29.236897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a86ff5-013a-4549-bc14-e86f353dc7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:29.237524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a86ff5-013a-4549-bc14-e86f353dc7dc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:29.237798 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a86ff5-013a-4549-bc14-e86f353dc7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:29.238064 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a86ff5-013a-4549-bc14-e86f353dc7dc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:29.245294 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a86ff5-013a-4549-bc14-e86f353dc7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:29.246740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a86ff5-013a-4549-bc14-e86f353dc7dc None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-85a86ff5-013a-4549-bc14-e86f353dc7dc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:12:29.258675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:12:29.259856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:12:29.261699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 581/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 26 18:12:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:12:29.268258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c06ef8-26ca-4231-98f8-901602c0e347 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:29.381144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c06ef8-26ca-4231-98f8-901602c0e347 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:29.417973 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129864c1-6472-4fb3-af0c-2c4c9dc61262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:29.418580 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129864c1-6472-4fb3-af0c-2c4c9dc61262 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:29.418860 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129864c1-6472-4fb3-af0c-2c4c9dc61262 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:29.419133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129864c1-6472-4fb3-af0c-2c4c9dc61262 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:29.419780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129864c1-6472-4fb3-af0c-2c4c9dc61262 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:29.420088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129864c1-6472-4fb3-af0c-2c4c9dc61262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:29.421532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129864c1-6472-4fb3-af0c-2c4c9dc61262 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:29.429079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 585/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Fri Aug 26 18:12:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:31.321283 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1439de1-a5da-4956-91af-0dbcff42dfd7 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:31.321873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1439de1-a5da-4956-91af-0dbcff42dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:31.321873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1439de1-a5da-4956-91af-0dbcff42dfd7 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:31.323196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 582/1167] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:31.329732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984554e-2f75-4469-90ca-3ff08b588a0a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:31.330370 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984554e-2f75-4469-90ca-3ff08b588a0a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:31.330510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984554e-2f75-4469-90ca-3ff08b588a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:31.359436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8984554e-2f75-4469-90ca-3ff08b588a0a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:31.360647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8984554e-2f75-4469-90ca-3ff08b588a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:31.378613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:31.440368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 586/1168] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:31.709647 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1439de1-a5da-4956-91af-0dbcff42dfd7 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:31.821914 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1439de1-a5da-4956-91af-0dbcff42dfd7 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:31.846463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:31.859569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666b1a8-1582-4d95-8978-d49a6191eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:31.860165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b1a8-1582-4d95-8978-d49a6191eea8 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:31.860446 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b1a8-1582-4d95-8978-d49a6191eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:31.860710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b1a8-1582-4d95-8978-d49a6191eea8 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:31.861409 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666b1a8-1582-4d95-8978-d49a6191eea8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:31.862761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666b1a8-1582-4d95-8978-d49a6191eea8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:31.885773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 583/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Fri Aug 26 18:12:31 2022] POST /identity/v3/domains => generated 267 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:12:33.811670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038db08-2367-47cd-b114-e54db54fa611 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:33.812251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038db08-2367-47cd-b114-e54db54fa611 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:33.812251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038db08-2367-47cd-b114-e54db54fa611 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:33.813675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 587/1170] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:33.820081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf54c7c-49d1-4354-a159-97b1a9ac4cbe None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:33.820773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf54c7c-49d1-4354-a159-97b1a9ac4cbe None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:33.820938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf54c7c-49d1-4354-a159-97b1a9ac4cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:33.846659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-adf54c7c-49d1-4354-a159-97b1a9ac4cbe None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:33.847898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-adf54c7c-49d1-4354-a159-97b1a9ac4cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:33.917987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 584/1171] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:34.187428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038db08-2367-47cd-b114-e54db54fa611 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:34.303527 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038db08-2367-47cd-b114-e54db54fa611 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:34.336803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d599441-2035-495d-9aca-6cbedffe378e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:34.337462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d599441-2035-495d-9aca-6cbedffe378e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:34.337739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d599441-2035-495d-9aca-6cbedffe378e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:34.338004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d599441-2035-495d-9aca-6cbedffe378e None admin] PATH_INFO: `/v3/domains/d36b8688ef724b0bbc20044b3a7e3d83` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:34.348190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d599441-2035-495d-9aca-6cbedffe378e None admin] RBAC: Authorizing `identity:get_domain(domain_id=d36b8688ef724b0bbc20044b3a7e3d83)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:34.349677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d599441-2035-495d-9aca-6cbedffe378e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:34.351279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 588/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Fri Aug 26 18:12:34 2022] GET /identity/v3/domains/d36b8688ef724b0bbc20044b3a7e3d83 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:34.358366 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf54c7c-49d1-4354-a159-97b1a9ac4cbe None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:34.480095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf54c7c-49d1-4354-a159-97b1a9ac4cbe None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:34.494031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:34.522686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b02327-6420-4429-9524-593f148f4301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:34.523306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b02327-6420-4429-9524-593f148f4301 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:34.523586 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b02327-6420-4429-9524-593f148f4301 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:34.523855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b02327-6420-4429-9524-593f148f4301 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:34.524490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b02327-6420-4429-9524-593f148f4301 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:34.525966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b02327-6420-4429-9524-593f148f4301 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:34.555440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 585/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:12:34 2022] POST /identity/v3/projects => generated 361 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:12:36.481962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042bbc0-e1ec-4c11-9e1b-58b57c342fba None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:36.482622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042bbc0-e1ec-4c11-9e1b-58b57c342fba None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:36.482622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042bbc0-e1ec-4c11-9e1b-58b57c342fba None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:36.483975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 589/1174] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:36.490255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d1ec-badf-4eab-b7e1-837435875032 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:36.490730 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d1ec-badf-4eab-b7e1-837435875032 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:36.490834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d1ec-badf-4eab-b7e1-837435875032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:36.518747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e271d1ec-badf-4eab-b7e1-837435875032 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:36.520470 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e271d1ec-badf-4eab-b7e1-837435875032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:36.601499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 586/1175] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:36.873996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042bbc0-e1ec-4c11-9e1b-58b57c342fba None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:36.895783 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:36.992423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042bbc0-e1ec-4c11-9e1b-58b57c342fba None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:37.028012 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59545a-d081-40d5-a2d3-13c3b8901c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:37.028630 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59545a-d081-40d5-a2d3-13c3b8901c4a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:37.028946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59545a-d081-40d5-a2d3-13c3b8901c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:37.029220 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59545a-d081-40d5-a2d3-13c3b8901c4a None admin] PATH_INFO: `/v3/domains/d36b8688ef724b0bbc20044b3a7e3d83` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:37.030419 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59545a-d081-40d5-a2d3-13c3b8901c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=d36b8688ef724b0bbc20044b3a7e3d83)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:37.031898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59545a-d081-40d5-a2d3-13c3b8901c4a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:37.033529 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 590/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Fri Aug 26 18:12:36 2022] GET /identity/v3/domains/d36b8688ef724b0bbc20044b3a7e3d83 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:37.039493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d1ec-badf-4eab-b7e1-837435875032 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:37.148108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:37.156100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d1ec-badf-4eab-b7e1-837435875032 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:37.192216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e305ac-c24d-4b61-a488-3f38fc9426ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:37.192836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e305ac-c24d-4b61-a488-3f38fc9426ba None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:37.193114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e305ac-c24d-4b61-a488-3f38fc9426ba None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:37.193365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e305ac-c24d-4b61-a488-3f38fc9426ba None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:37.194005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e305ac-c24d-4b61-a488-3f38fc9426ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:37.195445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e305ac-c24d-4b61-a488-3f38fc9426ba None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:37.219601 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 587/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:12:37 2022] POST /identity/v3/users => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:12:39.138869 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addf329-d0da-46b5-8daa-b7b217309423 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:39.139464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addf329-d0da-46b5-8daa-b7b217309423 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:39.139464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addf329-d0da-46b5-8daa-b7b217309423 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:39.140773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 591/1178] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:39.147196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1666f9-5bd2-4f13-bf96-b110d46ad281 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:39.147956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1666f9-5bd2-4f13-bf96-b110d46ad281 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:39.148080 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1666f9-5bd2-4f13-bf96-b110d46ad281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:39.169605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cd1666f9-5bd2-4f13-bf96-b110d46ad281 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:39.170779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cd1666f9-5bd2-4f13-bf96-b110d46ad281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:39.246018 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 588/1179] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:39.510111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addf329-d0da-46b5-8daa-b7b217309423 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:39.603721 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:39.625726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addf329-d0da-46b5-8daa-b7b217309423 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:39.659237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85153eb9-682e-40a4-b525-a003912ca34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:39.659862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85153eb9-682e-40a4-b525-a003912ca34c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:39.660139 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85153eb9-682e-40a4-b525-a003912ca34c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:39.660404 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85153eb9-682e-40a4-b525-a003912ca34c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:39.670951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85153eb9-682e-40a4-b525-a003912ca34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-85153eb9-682e-40a4-b525-a003912ca34c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:12:39.675716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:12:39.677405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:12:39.678804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 592/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:12:39.686486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1666f9-5bd2-4f13-bf96-b110d46ad281 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:39.781328 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:39.806942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1666f9-5bd2-4f13-bf96-b110d46ad281 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:39.841711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caad82c-9027-42f5-9fe0-98bec134e1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:39.842315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caad82c-9027-42f5-9fe0-98bec134e1ef None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:39.842605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caad82c-9027-42f5-9fe0-98bec134e1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:39.842877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caad82c-9027-42f5-9fe0-98bec134e1ef None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:39.843579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caad82c-9027-42f5-9fe0-98bec134e1ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:39.843882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caad82c-9027-42f5-9fe0-98bec134e1ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:39.845298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caad82c-9027-42f5-9fe0-98bec134e1ef None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:39.854139 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 589/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:39.864390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85153eb9-682e-40a4-b525-a003912ca34c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:39.969148 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85153eb9-682e-40a4-b525-a003912ca34c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:40.005459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf1786-f842-4d6d-bdbf-6cf7ff12038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:40.006080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf1786-f842-4d6d-bdbf-6cf7ff12038a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:40.006361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf1786-f842-4d6d-bdbf-6cf7ff12038a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:40.006635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf1786-f842-4d6d-bdbf-6cf7ff12038a None admin] PATH_INFO: `/v3/users/a0df97fd1aa14a33bf3b8ee4fa5b9c45` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:40.017567 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:40.021450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf1786-f842-4d6d-bdbf-6cf7ff12038a None admin] RBAC: Authorizing `identity:get_user(user_id=a0df97fd1aa14a33bf3b8ee4fa5b9c45)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:40.022979 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf1786-f842-4d6d-bdbf-6cf7ff12038a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:40.024614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 593/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:12:39 2022] GET /identity/v3/users/a0df97fd1aa14a33bf3b8ee4fa5b9c45 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:40.030836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caad82c-9027-42f5-9fe0-98bec134e1ef None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:40.140107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caad82c-9027-42f5-9fe0-98bec134e1ef None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:40.176474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d3e2c-25e6-4dc6-9bb6-c8e2931f7526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:40.177105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d3e2c-25e6-4dc6-9bb6-c8e2931f7526 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:40.177373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d3e2c-25e6-4dc6-9bb6-c8e2931f7526 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:40.177643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d3e2c-25e6-4dc6-9bb6-c8e2931f7526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:40.190651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:40.251939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d3e2c-25e6-4dc6-9bb6-c8e2931f7526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:40.253414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d3e2c-25e6-4dc6-9bb6-c8e2931f7526 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:40.354509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 590/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:12:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:12:40.362708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf1786-f842-4d6d-bdbf-6cf7ff12038a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:40.469669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf1786-f842-4d6d-bdbf-6cf7ff12038a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:40.512549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60f0fb-17af-45f0-ac2c-1745d754b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:40.513548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60f0fb-17af-45f0-ac2c-1745d754b485 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:40.513977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60f0fb-17af-45f0-ac2c-1745d754b485 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:40.514468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60f0fb-17af-45f0-ac2c-1745d754b485 None admin] PATH_INFO: `/v3/projects/26d0d173968e42068aeaab98c7fb5779` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:40.515892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60f0fb-17af-45f0-ac2c-1745d754b485 None admin] RBAC: Authorizing `identity:get_project(project_id=26d0d173968e42068aeaab98c7fb5779)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:40.517376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60f0fb-17af-45f0-ac2c-1745d754b485 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:40.518989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 594/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:12:40 2022] GET /identity/v3/projects/26d0d173968e42068aeaab98c7fb5779 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:40.525528 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d3e2c-25e6-4dc6-9bb6-c8e2931f7526 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:40.570276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:40.634879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d3e2c-25e6-4dc6-9bb6-c8e2931f7526 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:40.669917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd56e07-e4c1-4754-8e61-47bb96fe16e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:40.670516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd56e07-e4c1-4754-8e61-47bb96fe16e0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:40.670799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd56e07-e4c1-4754-8e61-47bb96fe16e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:40.671068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd56e07-e4c1-4754-8e61-47bb96fe16e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:40.671802 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd56e07-e4c1-4754-8e61-47bb96fe16e0 None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=26d0d173968e42068aeaab98c7fb5779, user.id=a0df97fd1aa14a33bf3b8ee4fa5b9c45) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:40.672112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd56e07-e4c1-4754-8e61-47bb96fe16e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:40.673583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd56e07-e4c1-4754-8e61-47bb96fe16e0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:40.679133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 591/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:12:40 2022] GET /identity/v3/role_assignments?user.id=a0df97fd1aa14a33bf3b8ee4fa5b9c45&scope.project.id=26d0d173968e42068aeaab98c7fb5779&role.id=db572ad3d504403cbb227c2155c93eda => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:42.534507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1b079-4dc8-4c62-a614-927a05475650 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:42.534994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1b079-4dc8-4c62-a614-927a05475650 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:42.535108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1b079-4dc8-4c62-a614-927a05475650 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:42.537274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 595/1186] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:42.545788 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869cd92-35fe-42ae-9113-338fbf39baab None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:42.546282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869cd92-35fe-42ae-9113-338fbf39baab None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:42.546498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869cd92-35fe-42ae-9113-338fbf39baab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:42.565106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0869cd92-35fe-42ae-9113-338fbf39baab None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:42.566306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0869cd92-35fe-42ae-9113-338fbf39baab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:42.636441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 592/1187] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:42.913412 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1b079-4dc8-4c62-a614-927a05475650 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:42.985959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:43.026748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1b079-4dc8-4c62-a614-927a05475650 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:43.062445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd851fe-f829-4aa8-adde-5a888a061352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:43.063054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd851fe-f829-4aa8-adde-5a888a061352 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:43.063328 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd851fe-f829-4aa8-adde-5a888a061352 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:43.063593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd851fe-f829-4aa8-adde-5a888a061352 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:43.075278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd851fe-f829-4aa8-adde-5a888a061352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1fd851fe-f829-4aa8-adde-5a888a061352 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:12:43.079931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:12:43.081073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:12:43.082363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 596/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:12:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:12:43.087316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869cd92-35fe-42ae-9113-338fbf39baab None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:43.124690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:43.209711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869cd92-35fe-42ae-9113-338fbf39baab None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:43.246601 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2c7cc-37b8-4361-8bcb-9ff3b834aa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:43.247199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2c7cc-37b8-4361-8bcb-9ff3b834aa9a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:43.247483 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2c7cc-37b8-4361-8bcb-9ff3b834aa9a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:43.247750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2c7cc-37b8-4361-8bcb-9ff3b834aa9a None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:43.248415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2c7cc-37b8-4361-8bcb-9ff3b834aa9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:43.248754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2c7cc-37b8-4361-8bcb-9ff3b834aa9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:43.250256 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2c7cc-37b8-4361-8bcb-9ff3b834aa9a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:43.259292 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 593/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:12:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:43.266820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd851fe-f829-4aa8-adde-5a888a061352 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:43.383031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd851fe-f829-4aa8-adde-5a888a061352 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:43.411512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:43.423148 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7a84c-c962-4366-a3a4-223ff5432280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:43.423769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7a84c-c962-4366-a3a4-223ff5432280 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:43.424046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7a84c-c962-4366-a3a4-223ff5432280 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:43.424316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7a84c-c962-4366-a3a4-223ff5432280 None admin] PATH_INFO: `/v3/users/a0df97fd1aa14a33bf3b8ee4fa5b9c45` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:43.425482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7a84c-c962-4366-a3a4-223ff5432280 None admin] RBAC: Authorizing `identity:get_user(user_id=a0df97fd1aa14a33bf3b8ee4fa5b9c45)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:43.426926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7a84c-c962-4366-a3a4-223ff5432280 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:43.428514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 597/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:12:43 2022] GET /identity/v3/users/a0df97fd1aa14a33bf3b8ee4fa5b9c45 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:43.434690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2c7cc-37b8-4361-8bcb-9ff3b834aa9a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:43.539686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:43.544095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2c7cc-37b8-4361-8bcb-9ff3b834aa9a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:43.579115 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180ebc6-182a-41c0-9f0e-6b8b45b8cd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:43.579726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180ebc6-182a-41c0-9f0e-6b8b45b8cd2d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:43.580011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180ebc6-182a-41c0-9f0e-6b8b45b8cd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:43.580286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180ebc6-182a-41c0-9f0e-6b8b45b8cd2d None admin] PATH_INFO: `/v3/projects/26d0d173968e42068aeaab98c7fb5779` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:43.581452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180ebc6-182a-41c0-9f0e-6b8b45b8cd2d None admin] RBAC: Authorizing `identity:get_project(project_id=26d0d173968e42068aeaab98c7fb5779)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:43.582885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180ebc6-182a-41c0-9f0e-6b8b45b8cd2d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:43.584550 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 594/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:12:43 2022] GET /identity/v3/projects/26d0d173968e42068aeaab98c7fb5779 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:43.590802 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7a84c-c962-4366-a3a4-223ff5432280 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:43.697081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7a84c-c962-4366-a3a4-223ff5432280 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:43.734031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecc8fd-31ba-4445-997b-d0662a238ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:43.734688 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecc8fd-31ba-4445-997b-d0662a238ed3 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:43.734964 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecc8fd-31ba-4445-997b-d0662a238ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:43.735235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecc8fd-31ba-4445-997b-d0662a238ed3 None admin] PATH_INFO: `/v3/projects/26d0d173968e42068aeaab98c7fb5779/users/a0df97fd1aa14a33bf3b8ee4fa5b9c45/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:43.737272 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecc8fd-31ba-4445-997b-d0662a238ed3 None admin] RBAC: Authorizing `identity:create_grant(project_id=26d0d173968e42068aeaab98c7fb5779, user_id=a0df97fd1aa14a33bf3b8ee4fa5b9c45, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:43.738726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecc8fd-31ba-4445-997b-d0662a238ed3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:43.754247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 598/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:12:43 2022] PUT /identity/v3/projects/26d0d173968e42068aeaab98c7fb5779/users/a0df97fd1aa14a33bf3b8ee4fa5b9c45/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:12:45.605042 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4b579-99d1-4fd8-8d73-e57d63683cc5 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:45.606241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4b579-99d1-4fd8-8d73-e57d63683cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:45.606241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4b579-99d1-4fd8-8d73-e57d63683cc5 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:45.608433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 595/1193] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:12:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:12:45.613963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30c343-9b7e-4cc1-9bc9-4846b5a7de0e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:45.614394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30c343-9b7e-4cc1-9bc9-4846b5a7de0e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:45.614496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30c343-9b7e-4cc1-9bc9-4846b5a7de0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:45.634159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8d30c343-9b7e-4cc1-9bc9-4846b5a7de0e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:12:45.635348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8d30c343-9b7e-4cc1-9bc9-4846b5a7de0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:12:45.686734 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:45.711500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 599/1194] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:12:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:12:45.973172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4b579-99d1-4fd8-8d73-e57d63683cc5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:46.087655 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4b579-99d1-4fd8-8d73-e57d63683cc5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:46.123094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564adc6-d93a-4390-a1de-5b88c0d6f9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:46.123717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564adc6-d93a-4390-a1de-5b88c0d6f9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:46.123993 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564adc6-d93a-4390-a1de-5b88c0d6f9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:46.124263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564adc6-d93a-4390-a1de-5b88c0d6f9f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:46.135146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564adc6-d93a-4390-a1de-5b88c0d6f9f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f564adc6-d93a-4390-a1de-5b88c0d6f9f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:12:46.139904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:12:46.141043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:12:46.142073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 596/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:12:46.147311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30c343-9b7e-4cc1-9bc9-4846b5a7de0e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:46.252802 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30c343-9b7e-4cc1-9bc9-4846b5a7de0e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:46.299451 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6df5c1-0627-47a0-b883-6ffd2fec9457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:46.300056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df5c1-0627-47a0-b883-6ffd2fec9457 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:46.300333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df5c1-0627-47a0-b883-6ffd2fec9457 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:46.300600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df5c1-0627-47a0-b883-6ffd2fec9457 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:46.301291 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6df5c1-0627-47a0-b883-6ffd2fec9457 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:46.301684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6df5c1-0627-47a0-b883-6ffd2fec9457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:46.303081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6df5c1-0627-47a0-b883-6ffd2fec9457 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:46.311472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 600/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:12:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:46.318059 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564adc6-d93a-4390-a1de-5b88c0d6f9f3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:46.351309 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:46.432162 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564adc6-d93a-4390-a1de-5b88c0d6f9f3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:46.467636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cfa02-014a-464a-a6bf-9496a88034c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:46.468271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cfa02-014a-464a-a6bf-9496a88034c5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:46.468549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cfa02-014a-464a-a6bf-9496a88034c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:46.468849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cfa02-014a-464a-a6bf-9496a88034c5 None admin] PATH_INFO: `/v3/users/a0df97fd1aa14a33bf3b8ee4fa5b9c45` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:46.470077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cfa02-014a-464a-a6bf-9496a88034c5 None admin] RBAC: Authorizing `identity:get_user(user_id=a0df97fd1aa14a33bf3b8ee4fa5b9c45)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:46.471511 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cfa02-014a-464a-a6bf-9496a88034c5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:46.473148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 597/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Fri Aug 26 18:12:46 2022] GET /identity/v3/users/a0df97fd1aa14a33bf3b8ee4fa5b9c45 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:46.483051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6df5c1-0627-47a0-b883-6ffd2fec9457 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:46.532611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:46.584498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6df5c1-0627-47a0-b883-6ffd2fec9457 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:46.622412 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977a5b4-4be9-4cfb-ad39-a4f3d88e6484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:46.623012 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977a5b4-4be9-4cfb-ad39-a4f3d88e6484 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:46.623273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977a5b4-4be9-4cfb-ad39-a4f3d88e6484 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:46.623536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977a5b4-4be9-4cfb-ad39-a4f3d88e6484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:46.691471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977a5b4-4be9-4cfb-ad39-a4f3d88e6484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:46.692962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977a5b4-4be9-4cfb-ad39-a4f3d88e6484 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:46.739190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:46.793499 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 601/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:12:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:12:46.799807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cfa02-014a-464a-a6bf-9496a88034c5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:46.899661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:46.907581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cfa02-014a-464a-a6bf-9496a88034c5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:46.942806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ea0f5-6277-48e6-bd63-c29ce9574286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:46.943432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ea0f5-6277-48e6-bd63-c29ce9574286 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:46.943705 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ea0f5-6277-48e6-bd63-c29ce9574286 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:46.943970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ea0f5-6277-48e6-bd63-c29ce9574286 None admin] PATH_INFO: `/v3/projects/26d0d173968e42068aeaab98c7fb5779` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:46.945214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ea0f5-6277-48e6-bd63-c29ce9574286 None admin] RBAC: Authorizing `identity:get_project(project_id=26d0d173968e42068aeaab98c7fb5779)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:46.946633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ea0f5-6277-48e6-bd63-c29ce9574286 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:46.948256 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 598/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Fri Aug 26 18:12:46 2022] GET /identity/v3/projects/26d0d173968e42068aeaab98c7fb5779 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:46.954637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977a5b4-4be9-4cfb-ad39-a4f3d88e6484 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:12:47.058334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977a5b4-4be9-4cfb-ad39-a4f3d88e6484 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:12:47.098479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714927ff-6286-4af4-ba27-0edd4d9a82ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:12:47.099082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714927ff-6286-4af4-ba27-0edd4d9a82ea None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:12:47.099361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714927ff-6286-4af4-ba27-0edd4d9a82ea None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:12:47.099629 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714927ff-6286-4af4-ba27-0edd4d9a82ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:12:47.100360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714927ff-6286-4af4-ba27-0edd4d9a82ea None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=26d0d173968e42068aeaab98c7fb5779, user.id=a0df97fd1aa14a33bf3b8ee4fa5b9c45) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:12:47.100666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714927ff-6286-4af4-ba27-0edd4d9a82ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:12:47.102198 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714927ff-6286-4af4-ba27-0edd4d9a82ea None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:12:47.109423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 602/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:12:46 2022] GET /identity/v3/role_assignments?user.id=a0df97fd1aa14a33bf3b8ee4fa5b9c45&scope.project.id=26d0d173968e42068aeaab98c7fb5779&role.id=db572ad3d504403cbb227c2155c93eda => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:12:56.937837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=19 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:12:57.106763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:42.623565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec623ac-aa4c-4551-b3c6-dab43953be97 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:42.624196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec623ac-aa4c-4551-b3c6-dab43953be97 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:42.624196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec623ac-aa4c-4551-b3c6-dab43953be97 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:42.628198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 599/1201] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:13:42.631262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a930d3f-0385-40dc-89b7-af44d1a9a858 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:42.631774 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a930d3f-0385-40dc-89b7-af44d1a9a858 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:42.631867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a930d3f-0385-40dc-89b7-af44d1a9a858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:42.650807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2a930d3f-0385-40dc-89b7-af44d1a9a858 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:13:42.651989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2a930d3f-0385-40dc-89b7-af44d1a9a858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:13:42.726829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 603/1202] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:13:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:13:42.998693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec623ac-aa4c-4551-b3c6-dab43953be97 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:43.143172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec623ac-aa4c-4551-b3c6-dab43953be97 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:43.191228 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aff259-3e41-4bed-b61b-0b5c78be3d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:43.192057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aff259-3e41-4bed-b61b-0b5c78be3d8e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:43.192448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aff259-3e41-4bed-b61b-0b5c78be3d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:43.192734 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aff259-3e41-4bed-b61b-0b5c78be3d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:43.206642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aff259-3e41-4bed-b61b-0b5c78be3d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:43.208649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aff259-3e41-4bed-b61b-0b5c78be3d8e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-42aff259-3e41-4bed-b61b-0b5c78be3d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:13:43.230578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:43.231785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:13:43.233641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:13:43.233641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:43.233641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:13:43.233641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 600/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:43.238252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a930d3f-0385-40dc-89b7-af44d1a9a858 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:43.367096 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a930d3f-0385-40dc-89b7-af44d1a9a858 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:43.403524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:43.411407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a34f9-8ec1-43fc-afe0-f3303a7aa54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:43.412085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a34f9-8ec1-43fc-afe0-f3303a7aa54a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:43.412361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a34f9-8ec1-43fc-afe0-f3303a7aa54a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:43.412629 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a34f9-8ec1-43fc-afe0-f3303a7aa54a None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:43.413481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a34f9-8ec1-43fc-afe0-f3303a7aa54a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:43.413781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a34f9-8ec1-43fc-afe0-f3303a7aa54a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:43.415165 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a34f9-8ec1-43fc-afe0-f3303a7aa54a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:43.436265 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 604/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:43.442399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aff259-3e41-4bed-b61b-0b5c78be3d8e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:43.512675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:43.592703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aff259-3e41-4bed-b61b-0b5c78be3d8e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:43.644078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4dfa7-eb75-4530-bbb8-7552b5021338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:43.644822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4dfa7-eb75-4530-bbb8-7552b5021338 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:43.644995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4dfa7-eb75-4530-bbb8-7552b5021338 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:43.645237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4dfa7-eb75-4530-bbb8-7552b5021338 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:43.645916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4dfa7-eb75-4530-bbb8-7552b5021338 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:43.648292 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4dfa7-eb75-4530-bbb8-7552b5021338 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:43.684979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 601/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Fri Aug 26 18:13:43 2022] POST /identity/v3/users => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:13:45.740307 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71e217-6100-45e3-a0d2-64b050037c2c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:45.740900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71e217-6100-45e3-a0d2-64b050037c2c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:45.740900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71e217-6100-45e3-a0d2-64b050037c2c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:45.742232 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 605/1206] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:13:45.747480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3a2aa-8c97-46b9-a659-c9ae0a142db5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:45.747953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3a2aa-8c97-46b9-a659-c9ae0a142db5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:45.748046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3a2aa-8c97-46b9-a659-c9ae0a142db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:45.767123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-88a3a2aa-8c97-46b9-a659-c9ae0a142db5 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:13:45.768864 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-88a3a2aa-8c97-46b9-a659-c9ae0a142db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:13:45.849420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 602/1207] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:13:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:13:46.125125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71e217-6100-45e3-a0d2-64b050037c2c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:46.245234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71e217-6100-45e3-a0d2-64b050037c2c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:46.281189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a041b-5411-4d9c-adbb-837591e396d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:46.281830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a041b-5411-4d9c-adbb-837591e396d0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:46.282139 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a041b-5411-4d9c-adbb-837591e396d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:46.282413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a041b-5411-4d9c-adbb-837591e396d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:46.293303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a041b-5411-4d9c-adbb-837591e396d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-961a041b-5411-4d9c-adbb-837591e396d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:13:46.298141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:46.299342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:13:46.300216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 606/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:13:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:46.306025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3a2aa-8c97-46b9-a659-c9ae0a142db5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:46.349026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:46.413719 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3a2aa-8c97-46b9-a659-c9ae0a142db5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:46.452910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb90b1-dec8-4760-bd75-a8101cae94ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:46.453555 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb90b1-dec8-4760-bd75-a8101cae94ed None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:46.453872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb90b1-dec8-4760-bd75-a8101cae94ed None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:46.454162 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb90b1-dec8-4760-bd75-a8101cae94ed None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:46.454851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb90b1-dec8-4760-bd75-a8101cae94ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:46.455157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb90b1-dec8-4760-bd75-a8101cae94ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:46.456597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb90b1-dec8-4760-bd75-a8101cae94ed None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:46.466190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 603/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:13:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:46.472289 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a041b-5411-4d9c-adbb-837591e396d0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:46.540959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:46.599728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a041b-5411-4d9c-adbb-837591e396d0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:46.646352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8cf28-ac7f-43ca-bfb0-3ab680ae5846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:46.647188 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8cf28-ac7f-43ca-bfb0-3ab680ae5846 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:46.647467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8cf28-ac7f-43ca-bfb0-3ab680ae5846 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:46.647737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8cf28-ac7f-43ca-bfb0-3ab680ae5846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:46.659939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8cf28-ac7f-43ca-bfb0-3ab680ae5846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:46.661587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8cf28-ac7f-43ca-bfb0-3ab680ae5846 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-25d8cf28-ac7f-43ca-bfb0-3ab680ae5846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:13:46.679500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:46.680550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:13:46.681507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:13:46.681507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:46.681507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:13:46.681507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 607/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:46.686897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb90b1-dec8-4760-bd75-a8101cae94ed None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:46.804863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:46.808154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb90b1-dec8-4760-bd75-a8101cae94ed None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:46.851071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f01f83-0d05-48b8-be66-64eb3fefeb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:46.852492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f01f83-0d05-48b8-be66-64eb3fefeb28 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:46.852492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f01f83-0d05-48b8-be66-64eb3fefeb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:46.852492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f01f83-0d05-48b8-be66-64eb3fefeb28 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:46.853032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f01f83-0d05-48b8-be66-64eb3fefeb28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:46.853340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f01f83-0d05-48b8-be66-64eb3fefeb28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:46.854706 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f01f83-0d05-48b8-be66-64eb3fefeb28 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:46.871685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 604/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:46.873000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8cf28-ac7f-43ca-bfb0-3ab680ae5846 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:46.980976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8cf28-ac7f-43ca-bfb0-3ab680ae5846 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:46.982520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:47.016841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997e7a1-91fd-407d-a114-39447efdd0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:47.017650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997e7a1-91fd-407d-a114-39447efdd0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:47.018030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997e7a1-91fd-407d-a114-39447efdd0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:47.018415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997e7a1-91fd-407d-a114-39447efdd0d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:47.025814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997e7a1-91fd-407d-a114-39447efdd0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:47.027169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997e7a1-91fd-407d-a114-39447efdd0d2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e997e7a1-91fd-407d-a114-39447efdd0d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:13:47.038939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:47.040044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:47.041088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:47.041088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:47.041088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:13:47.041088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:13:47.041088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:13:47.041088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:13:47.041088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:13:47.041088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:13:47.041088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 18:13:47.041088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:13:47.044911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 608/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:13:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:47.048579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f01f83-0d05-48b8-be66-64eb3fefeb28 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:47.169812 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f01f83-0d05-48b8-be66-64eb3fefeb28 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:47.212125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072fa92-b041-4dbc-8617-72270be31ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:47.212935 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072fa92-b041-4dbc-8617-72270be31ebe None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:47.213312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072fa92-b041-4dbc-8617-72270be31ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:47.213691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072fa92-b041-4dbc-8617-72270be31ebe None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:47.214793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072fa92-b041-4dbc-8617-72270be31ebe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:47.214793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072fa92-b041-4dbc-8617-72270be31ebe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:47.216368 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072fa92-b041-4dbc-8617-72270be31ebe None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:47.238335 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 605/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Aug 26 18:13:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:47.244261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997e7a1-91fd-407d-a114-39447efdd0d2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:47.363478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997e7a1-91fd-407d-a114-39447efdd0d2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:47.399851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94896926-0d52-4478-a662-f2646da438ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:47.400438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94896926-0d52-4478-a662-f2646da438ec None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:47.400707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94896926-0d52-4478-a662-f2646da438ec None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:47.401030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94896926-0d52-4478-a662-f2646da438ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:47.446505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:47.490069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94896926-0d52-4478-a662-f2646da438ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:47.493025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94896926-0d52-4478-a662-f2646da438ec None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:47.643834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 609/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:13:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 18:13:47.649981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072fa92-b041-4dbc-8617-72270be31ebe None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:47.673640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:47.769498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072fa92-b041-4dbc-8617-72270be31ebe None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:47.811995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427741a-3b18-45ce-b68e-7b67cd061fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:47.812734 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427741a-3b18-45ce-b68e-7b67cd061fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:47.813128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427741a-3b18-45ce-b68e-7b67cd061fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:47.813453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427741a-3b18-45ce-b68e-7b67cd061fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:47.828871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427741a-3b18-45ce-b68e-7b67cd061fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:47.830373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427741a-3b18-45ce-b68e-7b67cd061fe6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-d427741a-3b18-45ce-b68e-7b67cd061fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:13:47.844906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:47.846047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:13:47.847350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:13:47.847350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:47.847350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:13:47.847350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 606/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:13:47.851885 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94896926-0d52-4478-a662-f2646da438ec None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:47.935700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:47.977950 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94896926-0d52-4478-a662-f2646da438ec None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:48.014400 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f81d4-eda0-4158-a211-0498b1c063a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:48.015014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f81d4-eda0-4158-a211-0498b1c063a3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:48.015290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f81d4-eda0-4158-a211-0498b1c063a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:48.015584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f81d4-eda0-4158-a211-0498b1c063a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:48.016193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f81d4-eda0-4158-a211-0498b1c063a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:48.016503 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f81d4-eda0-4158-a211-0498b1c063a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:48.018087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f81d4-eda0-4158-a211-0498b1c063a3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:48.035139 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 610/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:48.036298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427741a-3b18-45ce-b68e-7b67cd061fe6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:48.110889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:48.145699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427741a-3b18-45ce-b68e-7b67cd061fe6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:48.189382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c36e07-4a62-461f-9cc9-ba3662b81c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:48.190065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c36e07-4a62-461f-9cc9-ba3662b81c62 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:48.190389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c36e07-4a62-461f-9cc9-ba3662b81c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:48.190669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c36e07-4a62-461f-9cc9-ba3662b81c62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:48.198932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c36e07-4a62-461f-9cc9-ba3662b81c62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:48.200616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c36e07-4a62-461f-9cc9-ba3662b81c62 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-77c36e07-4a62-461f-9cc9-ba3662b81c62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:13:48.214390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:48.215578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:48.216506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:13:48.216506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:13:48.216506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:13:48.216506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:13:48.216506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:13:48.216506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:13:48.216506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:13:48.216506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:13:48.216506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 607/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:48.222169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f81d4-eda0-4158-a211-0498b1c063a3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:48.346965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f81d4-eda0-4158-a211-0498b1c063a3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:48.371161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:48.386677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fe8ed-69f0-4c71-8445-4262e88b2611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:48.387387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fe8ed-69f0-4c71-8445-4262e88b2611 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:48.387733 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fe8ed-69f0-4c71-8445-4262e88b2611 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:48.388071 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fe8ed-69f0-4c71-8445-4262e88b2611 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:48.388866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fe8ed-69f0-4c71-8445-4262e88b2611 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:48.389239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fe8ed-69f0-4c71-8445-4262e88b2611 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:48.391175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fe8ed-69f0-4c71-8445-4262e88b2611 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:48.406913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 611/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:48.414800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c36e07-4a62-461f-9cc9-ba3662b81c62 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:48.555205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c36e07-4a62-461f-9cc9-ba3662b81c62 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:48.586258 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:48.593702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c86f23-2f68-4e0b-9b0e-26ba15a4ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:48.594659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c86f23-2f68-4e0b-9b0e-26ba15a4ae01 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:48.595131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c86f23-2f68-4e0b-9b0e-26ba15a4ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:48.595607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c86f23-2f68-4e0b-9b0e-26ba15a4ae01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:48.596865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c86f23-2f68-4e0b-9b0e-26ba15a4ae01 None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=dd9eef8921de43f18245f47559f3fa71) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:48.597269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c86f23-2f68-4e0b-9b0e-26ba15a4ae01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:48.599160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c86f23-2f68-4e0b-9b0e-26ba15a4ae01 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:48.616749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 608/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:13:48 2022] GET /identity/v3/role_assignments?user.id=dd9eef8921de43f18245f47559f3fa71&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:50.571310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63e3a6-7d8b-471e-b13b-50ee9ea1f33c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:50.571857 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63e3a6-7d8b-471e-b13b-50ee9ea1f33c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:50.571857 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63e3a6-7d8b-471e-b13b-50ee9ea1f33c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:50.573319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 612/1220] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:13:50.578724 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29651a4-1cb6-4a3a-b145-95bb2de17262 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:50.579173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29651a4-1cb6-4a3a-b145-95bb2de17262 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:50.579407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29651a4-1cb6-4a3a-b145-95bb2de17262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:50.600301 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d29651a4-1cb6-4a3a-b145-95bb2de17262 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:13:50.601623 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d29651a4-1cb6-4a3a-b145-95bb2de17262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:13:50.680052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 609/1221] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:13:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:13:50.983096 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63e3a6-7d8b-471e-b13b-50ee9ea1f33c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:51.098309 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63e3a6-7d8b-471e-b13b-50ee9ea1f33c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:51.134193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c937a-972f-4d86-b123-0664d227e6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:51.134809 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c937a-972f-4d86-b123-0664d227e6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:51.135095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c937a-972f-4d86-b123-0664d227e6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:51.135371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c937a-972f-4d86-b123-0664d227e6b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:51.145825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c937a-972f-4d86-b123-0664d227e6b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-471c937a-972f-4d86-b123-0664d227e6b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:13:51.150604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:51.151796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:13:51.152813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 613/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:13:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:51.158175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29651a4-1cb6-4a3a-b145-95bb2de17262 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:51.274036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29651a4-1cb6-4a3a-b145-95bb2de17262 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:51.300358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:51.312475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39592ba2-29d9-497f-a67d-e34c6cefb9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:51.313123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592ba2-29d9-497f-a67d-e34c6cefb9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:51.313400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592ba2-29d9-497f-a67d-e34c6cefb9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:51.313705 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592ba2-29d9-497f-a67d-e34c6cefb9b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:51.314371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39592ba2-29d9-497f-a67d-e34c6cefb9b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:51.314670 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39592ba2-29d9-497f-a67d-e34c6cefb9b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:51.316047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39592ba2-29d9-497f-a67d-e34c6cefb9b0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:51.329283 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 610/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:13:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:13:51.330603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c937a-972f-4d86-b123-0664d227e6b1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:51.379689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:51.440977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c937a-972f-4d86-b123-0664d227e6b1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:51.478234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f4886-8814-4a1b-800a-49099b4a3616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:51.479037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f4886-8814-4a1b-800a-49099b4a3616 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:51.479343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f4886-8814-4a1b-800a-49099b4a3616 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:51.479619 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f4886-8814-4a1b-800a-49099b4a3616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:51.490857 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f4886-8814-4a1b-800a-49099b4a3616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:51.492388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f4886-8814-4a1b-800a-49099b4a3616 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-bc6f4886-8814-4a1b-800a-49099b4a3616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:13:51.507357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:51.508535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:13:51.509472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:13:51.509472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:51.509472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:13:51.509472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 614/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:51.515009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39592ba2-29d9-497f-a67d-e34c6cefb9b0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:51.624180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39592ba2-29d9-497f-a67d-e34c6cefb9b0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:51.662384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231ef58-df9b-41c9-a3ba-d1ac85bbd13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:51.663079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231ef58-df9b-41c9-a3ba-d1ac85bbd13f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:51.663344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231ef58-df9b-41c9-a3ba-d1ac85bbd13f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:51.663629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231ef58-df9b-41c9-a3ba-d1ac85bbd13f None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:51.664268 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231ef58-df9b-41c9-a3ba-d1ac85bbd13f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:51.664566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231ef58-df9b-41c9-a3ba-d1ac85bbd13f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:51.666267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231ef58-df9b-41c9-a3ba-d1ac85bbd13f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:51.678939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 611/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:51.684909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f4886-8814-4a1b-800a-49099b4a3616 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:51.800540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:51.807255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f4886-8814-4a1b-800a-49099b4a3616 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:51.846158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbff3b7-20c9-4237-999b-504f651f0b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:51.846840 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbff3b7-20c9-4237-999b-504f651f0b8c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:51.847123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbff3b7-20c9-4237-999b-504f651f0b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:51.847466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbff3b7-20c9-4237-999b-504f651f0b8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:51.855980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbff3b7-20c9-4237-999b-504f651f0b8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:51.857552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbff3b7-20c9-4237-999b-504f651f0b8c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-0bbff3b7-20c9-4237-999b-504f651f0b8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:13:51.869934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:51.871343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:51.872355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:51.872355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:51.872355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:13:51.872355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:13:51.872355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:13:51.872355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:13:51.872355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:13:51.872355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:13:51.872355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 18:13:51.872355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:13:51.872355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 615/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:13:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:13:51.877960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231ef58-df9b-41c9-a3ba-d1ac85bbd13f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:51.931605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:51.990417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231ef58-df9b-41c9-a3ba-d1ac85bbd13f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:52.024807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551c808-b2e3-4246-a49a-62350de7c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:52.025400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551c808-b2e3-4246-a49a-62350de7c485 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:52.025675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551c808-b2e3-4246-a49a-62350de7c485 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:52.025948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551c808-b2e3-4246-a49a-62350de7c485 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:52.026674 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551c808-b2e3-4246-a49a-62350de7c485 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:52.026980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551c808-b2e3-4246-a49a-62350de7c485 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:52.028415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551c808-b2e3-4246-a49a-62350de7c485 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:52.053496 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 612/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Aug 26 18:13:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:52.055088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbff3b7-20c9-4237-999b-504f651f0b8c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:52.182434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbff3b7-20c9-4237-999b-504f651f0b8c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:52.225456 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428fbde-a37e-4814-bbc6-b3eb54477f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:52.226272 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428fbde-a37e-4814-bbc6-b3eb54477f49 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:52.226563 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428fbde-a37e-4814-bbc6-b3eb54477f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:52.226854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428fbde-a37e-4814-bbc6-b3eb54477f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:52.242409 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428fbde-a37e-4814-bbc6-b3eb54477f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:52.243976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428fbde-a37e-4814-bbc6-b3eb54477f49 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-f428fbde-a37e-4814-bbc6-b3eb54477f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:13:52.260938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:52.262200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:13:52.263408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:13:52.263408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:52.263408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:13:52.263408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 616/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 18:13:52.268770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551c808-b2e3-4246-a49a-62350de7c485 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:52.378154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551c808-b2e3-4246-a49a-62350de7c485 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:52.380503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:52.416016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50f13d-a279-4a7f-b005-800351289798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:52.416827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50f13d-a279-4a7f-b005-800351289798 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:52.417116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50f13d-a279-4a7f-b005-800351289798 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:52.417395 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50f13d-a279-4a7f-b005-800351289798 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:52.418196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50f13d-a279-4a7f-b005-800351289798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:52.418588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50f13d-a279-4a7f-b005-800351289798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:52.420015 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50f13d-a279-4a7f-b005-800351289798 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:52.433559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 613/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:52.439921 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428fbde-a37e-4814-bbc6-b3eb54477f49 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:52.450353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:52.561406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428fbde-a37e-4814-bbc6-b3eb54477f49 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:52.598276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42616d5-9565-47e5-a8fd-9d2bb59a2e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:52.598957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42616d5-9565-47e5-a8fd-9d2bb59a2e54 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:52.599278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42616d5-9565-47e5-a8fd-9d2bb59a2e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:52.599547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42616d5-9565-47e5-a8fd-9d2bb59a2e54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:52.607495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42616d5-9565-47e5-a8fd-9d2bb59a2e54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:52.609358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42616d5-9565-47e5-a8fd-9d2bb59a2e54 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c42616d5-9565-47e5-a8fd-9d2bb59a2e54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:13:52.624513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:52.625698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:52.626975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:13:52.626975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:13:52.626975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:13:52.626975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:13:52.626975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:13:52.626975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:13:52.626975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:13:52.626975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:13:52.632352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 617/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:52.632468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50f13d-a279-4a7f-b005-800351289798 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:52.770372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50f13d-a279-4a7f-b005-800351289798 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:52.808156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aede2f-d96d-47fc-ab8c-cab769648540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:52.808824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aede2f-d96d-47fc-ab8c-cab769648540 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:52.809119 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aede2f-d96d-47fc-ab8c-cab769648540 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:52.809376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aede2f-d96d-47fc-ab8c-cab769648540 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:52.810075 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aede2f-d96d-47fc-ab8c-cab769648540 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:52.810381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aede2f-d96d-47fc-ab8c-cab769648540 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:52.811829 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aede2f-d96d-47fc-ab8c-cab769648540 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:52.824607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 614/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:52.830949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42616d5-9565-47e5-a8fd-9d2bb59a2e54 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:52.905394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:52.942578 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42616d5-9565-47e5-a8fd-9d2bb59a2e54 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:52.980396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb956ae-82cf-47d7-a1a4-99aa9ce254ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:52.981086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb956ae-82cf-47d7-a1a4-99aa9ce254ad None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:52.981390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb956ae-82cf-47d7-a1a4-99aa9ce254ad None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:52.981768 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb956ae-82cf-47d7-a1a4-99aa9ce254ad None admin] PATH_INFO: `/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/dd9eef8921de43f18245f47559f3fa71/roles/5a08ee803b2e44e280fc0c2c4941df8b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:52.999062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb956ae-82cf-47d7-a1a4-99aa9ce254ad None admin] RBAC: Authorizing `identity:create_grant(project_id=2803c5ec5ecf4223836ddf75397cc095, user_id=dd9eef8921de43f18245f47559f3fa71, role_id=5a08ee803b2e44e280fc0c2c4941df8b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:53.000549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb956ae-82cf-47d7-a1a4-99aa9ce254ad None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:53.013431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 618/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:13:52 2022] PUT /identity/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/dd9eef8921de43f18245f47559f3fa71/roles/5a08ee803b2e44e280fc0c2c4941df8b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:13:55.015390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74a87-3e3d-44fd-a733-a797028f731c None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:55.016017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74a87-3e3d-44fd-a733-a797028f731c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:55.016017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74a87-3e3d-44fd-a733-a797028f731c None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:55.017339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 615/1233] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:13:55.022786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487531b-9e7d-4163-9b98-72ee5b918256 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:55.023190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487531b-9e7d-4163-9b98-72ee5b918256 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:55.023335 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487531b-9e7d-4163-9b98-72ee5b918256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:55.042665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5487531b-9e7d-4163-9b98-72ee5b918256 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:13:55.043878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5487531b-9e7d-4163-9b98-72ee5b918256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:13:55.112223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 619/1234] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:13:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:13:55.417277 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74a87-3e3d-44fd-a733-a797028f731c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:55.449140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:55.531646 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74a87-3e3d-44fd-a733-a797028f731c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:55.569334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f294a-42ed-45f6-8ccb-8aabfec86520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:55.569981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f294a-42ed-45f6-8ccb-8aabfec86520 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:55.570296 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f294a-42ed-45f6-8ccb-8aabfec86520 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:55.570645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f294a-42ed-45f6-8ccb-8aabfec86520 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:55.580978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f294a-42ed-45f6-8ccb-8aabfec86520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a66f294a-42ed-45f6-8ccb-8aabfec86520 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:13:55.585989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:55.587280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:13:55.588475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 616/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Fri Aug 26 18:13:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:55.593463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487531b-9e7d-4163-9b98-72ee5b918256 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:55.644498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:55.703277 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487531b-9e7d-4163-9b98-72ee5b918256 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:55.738878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109de03-5df9-4945-9d0e-1fc88367328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:55.739499 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109de03-5df9-4945-9d0e-1fc88367328b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:55.739796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109de03-5df9-4945-9d0e-1fc88367328b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:55.740052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109de03-5df9-4945-9d0e-1fc88367328b None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:55.740767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109de03-5df9-4945-9d0e-1fc88367328b None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:55.741074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109de03-5df9-4945-9d0e-1fc88367328b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:55.742462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109de03-5df9-4945-9d0e-1fc88367328b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:55.752049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 620/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Fri Aug 26 18:13:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:13:55.761739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f294a-42ed-45f6-8ccb-8aabfec86520 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:55.862914 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:55.884531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f294a-42ed-45f6-8ccb-8aabfec86520 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:55.928080 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9442e9-682b-492c-820f-84059feed495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:55.928862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9442e9-682b-492c-820f-84059feed495 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:55.929144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9442e9-682b-492c-820f-84059feed495 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:55.929430 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9442e9-682b-492c-820f-84059feed495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:55.941447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9442e9-682b-492c-820f-84059feed495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:55.942912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9442e9-682b-492c-820f-84059feed495 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ca9442e9-682b-492c-820f-84059feed495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:13:55.958680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:55.959868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:13:55.961213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:13:55.961213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:55.961213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:13:55.961213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 617/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:55.965930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109de03-5df9-4945-9d0e-1fc88367328b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:56.067931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109de03-5df9-4945-9d0e-1fc88367328b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:56.079064 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:56.105772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89b75-13a6-4703-af9b-f51dd32704f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:56.106422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89b75-13a6-4703-af9b-f51dd32704f0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:56.106700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89b75-13a6-4703-af9b-f51dd32704f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:56.107001 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89b75-13a6-4703-af9b-f51dd32704f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:56.107808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b89b75-13a6-4703-af9b-f51dd32704f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:56.108116 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b89b75-13a6-4703-af9b-f51dd32704f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:56.109906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b89b75-13a6-4703-af9b-f51dd32704f0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:56.123712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 621/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:13:56.129898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9442e9-682b-492c-820f-84059feed495 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:56.246307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9442e9-682b-492c-820f-84059feed495 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:56.293093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9f0df-1a5f-410e-9be8-430370ecb0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:56.293781 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9f0df-1a5f-410e-9be8-430370ecb0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:56.294096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9f0df-1a5f-410e-9be8-430370ecb0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:56.294595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9f0df-1a5f-410e-9be8-430370ecb0a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:56.297503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:56.304485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9f0df-1a5f-410e-9be8-430370ecb0a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:56.306225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9f0df-1a5f-410e-9be8-430370ecb0a9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f9d9f0df-1a5f-410e-9be8-430370ecb0a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:13:56.321490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:56.322637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:56.323787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:56.323787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:56.323787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:13:56.323787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:13:56.323787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:13:56.323787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:13:56.323787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:13:56.323787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:13:56.323787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 18:13:56.323787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:13:56.323787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 618/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:13:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:56.328732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89b75-13a6-4703-af9b-f51dd32704f0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:56.436192 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89b75-13a6-4703-af9b-f51dd32704f0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:56.471861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef98700-2ee0-4ae4-b6e7-bbdfb65c5b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:56.472477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef98700-2ee0-4ae4-b6e7-bbdfb65c5b69 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:56.472784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef98700-2ee0-4ae4-b6e7-bbdfb65c5b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:56.473057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef98700-2ee0-4ae4-b6e7-bbdfb65c5b69 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:56.473775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef98700-2ee0-4ae4-b6e7-bbdfb65c5b69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:56.474079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef98700-2ee0-4ae4-b6e7-bbdfb65c5b69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:56.475586 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef98700-2ee0-4ae4-b6e7-bbdfb65c5b69 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:56.492984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 622/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Aug 26 18:13:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:56.500277 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9f0df-1a5f-410e-9be8-430370ecb0a9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:56.617031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9f0df-1a5f-410e-9be8-430370ecb0a9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:56.662920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4ff3-09e3-4032-a0c7-2d5a9be1adf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:56.663780 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4ff3-09e3-4032-a0c7-2d5a9be1adf3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:56.664175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4ff3-09e3-4032-a0c7-2d5a9be1adf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:56.664572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4ff3-09e3-4032-a0c7-2d5a9be1adf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:56.738829 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:56.746684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde4ff3-09e3-4032-a0c7-2d5a9be1adf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:56.748470 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde4ff3-09e3-4032-a0c7-2d5a9be1adf3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:56.857089 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 619/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:13:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:13:56.863644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef98700-2ee0-4ae4-b6e7-bbdfb65c5b69 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:56.902221 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:56.986402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef98700-2ee0-4ae4-b6e7-bbdfb65c5b69 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:57.027889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bbf21-debf-4e71-8218-6f77fbfd7701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:57.028624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bbf21-debf-4e71-8218-6f77fbfd7701 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:57.028932 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bbf21-debf-4e71-8218-6f77fbfd7701 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:57.029215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bbf21-debf-4e71-8218-6f77fbfd7701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:57.040107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bbf21-debf-4e71-8218-6f77fbfd7701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:57.041740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bbf21-debf-4e71-8218-6f77fbfd7701 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-2e9bbf21-debf-4e71-8218-6f77fbfd7701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:13:57.057889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:57.059144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:13:57.060327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:13:57.060327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:13:57.060327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:13:57.060327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 623/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:57.065178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4ff3-09e3-4032-a0c7-2d5a9be1adf3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:57.172132 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:57.181523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4ff3-09e3-4032-a0c7-2d5a9be1adf3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:57.223124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8189-6c5a-4b35-beec-09acad401654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:57.223771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8189-6c5a-4b35-beec-09acad401654 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:57.224050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8189-6c5a-4b35-beec-09acad401654 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:57.224317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8189-6c5a-4b35-beec-09acad401654 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:57.224974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad8189-6c5a-4b35-beec-09acad401654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:57.225351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad8189-6c5a-4b35-beec-09acad401654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:57.226638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad8189-6c5a-4b35-beec-09acad401654 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:57.238552 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 620/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:57.245852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bbf21-debf-4e71-8218-6f77fbfd7701 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:57.333497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:57.357055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bbf21-debf-4e71-8218-6f77fbfd7701 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:57.390665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab49b1-67c9-4113-99e3-4edd50eecd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:57.391464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab49b1-67c9-4113-99e3-4edd50eecd1c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:57.391792 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab49b1-67c9-4113-99e3-4edd50eecd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:57.392095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab49b1-67c9-4113-99e3-4edd50eecd1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:57.399905 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab49b1-67c9-4113-99e3-4edd50eecd1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:57.401649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab49b1-67c9-4113-99e3-4edd50eecd1c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-98ab49b1-67c9-4113-99e3-4edd50eecd1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:13:57.414334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:13:57.415481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:13:57.416581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:13:57.416581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:13:57.416581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:13:57.416581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:13:57.416581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:13:57.416581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:13:57.416581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:13:57.416581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:13:57.417513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 624/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:13:57.424185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8189-6c5a-4b35-beec-09acad401654 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:57.531601 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8189-6c5a-4b35-beec-09acad401654 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:57.568122 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe14097-15b0-4527-be74-fc0748815b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:57.568864 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe14097-15b0-4527-be74-fc0748815b94 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:57.569142 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe14097-15b0-4527-be74-fc0748815b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:57.569412 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe14097-15b0-4527-be74-fc0748815b94 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:57.570107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe14097-15b0-4527-be74-fc0748815b94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:57.570411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe14097-15b0-4527-be74-fc0748815b94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:57.571839 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe14097-15b0-4527-be74-fc0748815b94 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:57.584219 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 621/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:13:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:13:57.590742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab49b1-67c9-4113-99e3-4edd50eecd1c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:13:57.718578 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab49b1-67c9-4113-99e3-4edd50eecd1c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:13:57.760307 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29398db-4d55-4856-8235-770674044b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:13:57.761018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29398db-4d55-4856-8235-770674044b4d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:57.761402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29398db-4d55-4856-8235-770674044b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:57.761675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29398db-4d55-4856-8235-770674044b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:57.762440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29398db-4d55-4856-8235-770674044b4d None admin] RBAC: Adding query filter params (role.id=5a08ee803b2e44e280fc0c2c4941df8b, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=dd9eef8921de43f18245f47559f3fa71) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:13:57.762798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29398db-4d55-4856-8235-770674044b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:13:57.764387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29398db-4d55-4856-8235-770674044b4d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:13:57.771140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 625/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:13:57 2022] GET /identity/v3/role_assignments?user.id=dd9eef8921de43f18245f47559f3fa71&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=5a08ee803b2e44e280fc0c2c4941df8b => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:13:59.775110 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d395030-f833-4417-882f-6bf74419dde3 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:59.775673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d395030-f833-4417-882f-6bf74419dde3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:59.775673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d395030-f833-4417-882f-6bf74419dde3 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:59.777072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 622/1247] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:13:59.783225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef2d5-0a30-4562-b1bc-6de307bd0625 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:13:59.783725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef2d5-0a30-4562-b1bc-6de307bd0625 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:13:59.783725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef2d5-0a30-4562-b1bc-6de307bd0625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:13:59.791499 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:13:59.806981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-761ef2d5-0a30-4562-b1bc-6de307bd0625 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:13:59.808350 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-761ef2d5-0a30-4562-b1bc-6de307bd0625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:13:59.889481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 626/1248] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:13:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:14:00.176628 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d395030-f833-4417-882f-6bf74419dde3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:00.197027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:00.303311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d395030-f833-4417-882f-6bf74419dde3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:00.344544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407211a-1d17-436a-b32b-73096950bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:00.345776 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407211a-1d17-436a-b32b-73096950bd44 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:00.346129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407211a-1d17-436a-b32b-73096950bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:00.346517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407211a-1d17-436a-b32b-73096950bd44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:00.360457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407211a-1d17-436a-b32b-73096950bd44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-0407211a-1d17-436a-b32b-73096950bd44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:14:00.365413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:00.366651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:14:00.367546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 623/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:00.373138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef2d5-0a30-4562-b1bc-6de307bd0625 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:00.483896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef2d5-0a30-4562-b1bc-6de307bd0625 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:00.519546 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:00.526503 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76732f-89b8-440d-9753-03c4f63aa316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:00.527126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76732f-89b8-440d-9753-03c4f63aa316 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:00.527446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76732f-89b8-440d-9753-03c4f63aa316 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:00.527745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76732f-89b8-440d-9753-03c4f63aa316 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:00.528528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76732f-89b8-440d-9753-03c4f63aa316 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:00.528895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76732f-89b8-440d-9753-03c4f63aa316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:00.530285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76732f-89b8-440d-9753-03c4f63aa316 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:00.540349 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 627/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:00.545957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407211a-1d17-436a-b32b-73096950bd44 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:00.627957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:00.652766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407211a-1d17-436a-b32b-73096950bd44 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:00.690405 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b5d64-3630-4b8c-a7ec-8965e5c22cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:00.691200 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b5d64-3630-4b8c-a7ec-8965e5c22cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:00.691546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b5d64-3630-4b8c-a7ec-8965e5c22cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:00.691976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b5d64-3630-4b8c-a7ec-8965e5c22cb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:00.702634 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b5d64-3630-4b8c-a7ec-8965e5c22cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:00.704173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b5d64-3630-4b8c-a7ec-8965e5c22cb1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-998b5d64-3630-4b8c-a7ec-8965e5c22cb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:14:00.720461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:00.721651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:14:00.722892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:14:00.722892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:14:00.722892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:14:00.722892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 624/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:00.728044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76732f-89b8-440d-9753-03c4f63aa316 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:00.841795 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76732f-89b8-440d-9753-03c4f63aa316 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:00.885233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcc970-3fae-4d83-b908-251628fac200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:00.886217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc970-3fae-4d83-b908-251628fac200 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:00.886498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc970-3fae-4d83-b908-251628fac200 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:00.886938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc970-3fae-4d83-b908-251628fac200 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:00.887942 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcc970-3fae-4d83-b908-251628fac200 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:00.888365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcc970-3fae-4d83-b908-251628fac200 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:00.890454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcc970-3fae-4d83-b908-251628fac200 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:00.907382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 628/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:14:00.914188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b5d64-3630-4b8c-a7ec-8965e5c22cb1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:01.022883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b5d64-3630-4b8c-a7ec-8965e5c22cb1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:01.055537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:01.067613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8961af-872d-4284-bfb4-37823db0adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:01.068523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8961af-872d-4284-bfb4-37823db0adba None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:01.068945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8961af-872d-4284-bfb4-37823db0adba None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:01.069317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8961af-872d-4284-bfb4-37823db0adba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:01.078374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8961af-872d-4284-bfb4-37823db0adba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:01.080061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8961af-872d-4284-bfb4-37823db0adba None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-2a8961af-872d-4284-bfb4-37823db0adba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:14:01.094021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:01.095521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:01.096852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:01.096852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:01.096852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:14:01.096852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:14:01.096852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:14:01.096852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:14:01.096852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:14:01.096852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:14:01.096852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 18:14:01.096852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:14:01.096852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 625/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:14:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:01.101298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcc970-3fae-4d83-b908-251628fac200 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:01.174547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:01.230530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcc970-3fae-4d83-b908-251628fac200 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:01.269644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4cce1-e645-4599-8a85-7ca79b43f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:01.270369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4cce1-e645-4599-8a85-7ca79b43f769 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:01.270634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4cce1-e645-4599-8a85-7ca79b43f769 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:01.270902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4cce1-e645-4599-8a85-7ca79b43f769 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:01.271652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4cce1-e645-4599-8a85-7ca79b43f769 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:01.271956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4cce1-e645-4599-8a85-7ca79b43f769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:01.273533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4cce1-e645-4599-8a85-7ca79b43f769 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:01.291853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 629/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Aug 26 18:14:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:01.297790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8961af-872d-4284-bfb4-37823db0adba None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:01.403002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8961af-872d-4284-bfb4-37823db0adba None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:01.439346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce2f03-9302-4ce6-abf0-d80e5ae845f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:01.440009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce2f03-9302-4ce6-abf0-d80e5ae845f1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:01.440250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce2f03-9302-4ce6-abf0-d80e5ae845f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:01.440557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce2f03-9302-4ce6-abf0-d80e5ae845f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:01.499662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:01.513586 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce2f03-9302-4ce6-abf0-d80e5ae845f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:01.515733 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce2f03-9302-4ce6-abf0-d80e5ae845f1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:01.620691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 626/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:14:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:14:01.627566 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4cce1-e645-4599-8a85-7ca79b43f769 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:01.734965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4cce1-e645-4599-8a85-7ca79b43f769 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:01.749129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:01.771537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f96bb-6f56-43fd-9fff-8acdf0f4d28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:01.772174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f96bb-6f56-43fd-9fff-8acdf0f4d28a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:01.772459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f96bb-6f56-43fd-9fff-8acdf0f4d28a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:01.772736 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f96bb-6f56-43fd-9fff-8acdf0f4d28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:01.783725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f96bb-6f56-43fd-9fff-8acdf0f4d28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:01.785239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f96bb-6f56-43fd-9fff-8acdf0f4d28a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-ce3f96bb-6f56-43fd-9fff-8acdf0f4d28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:14:01.802094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:01.803372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:14:01.804461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:14:01.804461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:14:01.804461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:01.804461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 630/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:01.809270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce2f03-9302-4ce6-abf0-d80e5ae845f1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:01.910035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:01.926036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce2f03-9302-4ce6-abf0-d80e5ae845f1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:01.962210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8784114-b16c-46b9-afcb-d50a9e672671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:01.962920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8784114-b16c-46b9-afcb-d50a9e672671 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:01.963218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8784114-b16c-46b9-afcb-d50a9e672671 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:01.963625 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8784114-b16c-46b9-afcb-d50a9e672671 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:01.964484 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8784114-b16c-46b9-afcb-d50a9e672671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:01.964858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8784114-b16c-46b9-afcb-d50a9e672671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:01.966705 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8784114-b16c-46b9-afcb-d50a9e672671 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:01.980022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 627/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:01.986690 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f96bb-6f56-43fd-9fff-8acdf0f4d28a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:02.100578 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f96bb-6f56-43fd-9fff-8acdf0f4d28a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:02.136069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021353bb-ca07-4bf5-87c2-64b825e0a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:02.136736 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021353bb-ca07-4bf5-87c2-64b825e0a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:02.137015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021353bb-ca07-4bf5-87c2-64b825e0a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:02.137300 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021353bb-ca07-4bf5-87c2-64b825e0a6e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:02.144474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021353bb-ca07-4bf5-87c2-64b825e0a6e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:02.146032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021353bb-ca07-4bf5-87c2-64b825e0a6e8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-021353bb-ca07-4bf5-87c2-64b825e0a6e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:14:02.160218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:02.161321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:02.162366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:14:02.162366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:14:02.162366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:14:02.162366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:14:02.162366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:14:02.162366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:14:02.162366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:14:02.162366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:02.162366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 631/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:02.168770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8784114-b16c-46b9-afcb-d50a9e672671 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:02.281622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8784114-b16c-46b9-afcb-d50a9e672671 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:02.315568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92cbe7-8f6f-490c-b33b-efe735d3ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:02.316181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92cbe7-8f6f-490c-b33b-efe735d3ceaf None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:02.316449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92cbe7-8f6f-490c-b33b-efe735d3ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:02.316749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92cbe7-8f6f-490c-b33b-efe735d3ceaf None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:02.317443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92cbe7-8f6f-490c-b33b-efe735d3ceaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:02.317748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92cbe7-8f6f-490c-b33b-efe735d3ceaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:02.319187 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92cbe7-8f6f-490c-b33b-efe735d3ceaf None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:02.333076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 628/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:14:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:02.341991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021353bb-ca07-4bf5-87c2-64b825e0a6e8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:02.369283 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:02.455019 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021353bb-ca07-4bf5-87c2-64b825e0a6e8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:02.492297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fa4bd-7d91-4a14-a9ac-235484352cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:02.492931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fa4bd-7d91-4a14-a9ac-235484352cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:02.493217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fa4bd-7d91-4a14-a9ac-235484352cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:02.493485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fa4bd-7d91-4a14-a9ac-235484352cc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:02.494228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fa4bd-7d91-4a14-a9ac-235484352cc0 None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=dd9eef8921de43f18245f47559f3fa71) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:02.494528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fa4bd-7d91-4a14-a9ac-235484352cc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:02.495978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fa4bd-7d91-4a14-a9ac-235484352cc0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:02.503049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 632/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:14:02 2022] GET /identity/v3/role_assignments?user.id=dd9eef8921de43f18245f47559f3fa71&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=db572ad3d504403cbb227c2155c93eda => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:04.408766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a7e6e-dde5-4220-82be-9925c4ffdf69 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:04.409640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a7e6e-dde5-4220-82be-9925c4ffdf69 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:04.409640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a7e6e-dde5-4220-82be-9925c4ffdf69 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:04.411839 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 629/1261] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:14:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:14:04.417193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e7b40-bf33-43a5-9912-ec42b6f5cbc1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:04.417633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e7b40-bf33-43a5-9912-ec42b6f5cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:04.417726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e7b40-bf33-43a5-9912-ec42b6f5cbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:04.438205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-649e7b40-bf33-43a5-9912-ec42b6f5cbc1 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:14:04.439465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-649e7b40-bf33-43a5-9912-ec42b6f5cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:14:04.519226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 633/1262] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:14:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:14:04.802216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a7e6e-dde5-4220-82be-9925c4ffdf69 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:04.816078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:04.918571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a7e6e-dde5-4220-82be-9925c4ffdf69 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:04.961060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7c835-b107-4ab8-8691-1fd6759272ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:04.961679 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7c835-b107-4ab8-8691-1fd6759272ba None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:04.961958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7c835-b107-4ab8-8691-1fd6759272ba None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:04.962226 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7c835-b107-4ab8-8691-1fd6759272ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:04.973314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7c835-b107-4ab8-8691-1fd6759272ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b1a7c835-b107-4ab8-8691-1fd6759272ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:14:04.977965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:04.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:14:04.980217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 630/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:14:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:04.986083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e7b40-bf33-43a5-9912-ec42b6f5cbc1 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:05.005015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:05.111130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e7b40-bf33-43a5-9912-ec42b6f5cbc1 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:05.153100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd7d66-a1a2-4fb2-abee-42c83ef8177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:05.153729 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd7d66-a1a2-4fb2-abee-42c83ef8177d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:05.154004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd7d66-a1a2-4fb2-abee-42c83ef8177d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:05.154244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd7d66-a1a2-4fb2-abee-42c83ef8177d None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:05.154928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd7d66-a1a2-4fb2-abee-42c83ef8177d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:05.155223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd7d66-a1a2-4fb2-abee-42c83ef8177d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:05.156603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd7d66-a1a2-4fb2-abee-42c83ef8177d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:05.165564 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 634/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:05.171921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7c835-b107-4ab8-8691-1fd6759272ba None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:05.244933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:05.277394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7c835-b107-4ab8-8691-1fd6759272ba None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:05.311128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c611f-7280-4fab-9dcc-8a140265e1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:05.311756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c611f-7280-4fab-9dcc-8a140265e1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:05.312032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c611f-7280-4fab-9dcc-8a140265e1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:05.312303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c611f-7280-4fab-9dcc-8a140265e1e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:05.322940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c611f-7280-4fab-9dcc-8a140265e1e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:05.324397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c611f-7280-4fab-9dcc-8a140265e1e2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-e60c611f-7280-4fab-9dcc-8a140265e1e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:14:05.340144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:05.341255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:14:05.342307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:14:05.342307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:14:05.342307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:14:05.342307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 631/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:05.348274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd7d66-a1a2-4fb2-abee-42c83ef8177d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:05.437027 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:05.457918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd7d66-a1a2-4fb2-abee-42c83ef8177d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:05.493702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dc18f-d00f-46fc-8455-a6845e7b0de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:05.494311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dc18f-d00f-46fc-8455-a6845e7b0de4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:05.494585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dc18f-d00f-46fc-8455-a6845e7b0de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:05.494854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dc18f-d00f-46fc-8455-a6845e7b0de4 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:05.495501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dc18f-d00f-46fc-8455-a6845e7b0de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:05.495801 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dc18f-d00f-46fc-8455-a6845e7b0de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:05.497226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dc18f-d00f-46fc-8455-a6845e7b0de4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:05.509262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 635/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:05.515312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c611f-7280-4fab-9dcc-8a140265e1e2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:05.617891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c611f-7280-4fab-9dcc-8a140265e1e2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:05.645826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:05.667767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4724f7-e365-4df8-9acc-e598d3c4deb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:05.668400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4724f7-e365-4df8-9acc-e598d3c4deb4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:05.668679 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4724f7-e365-4df8-9acc-e598d3c4deb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:05.668981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4724f7-e365-4df8-9acc-e598d3c4deb4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:05.676588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4724f7-e365-4df8-9acc-e598d3c4deb4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:05.678081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4724f7-e365-4df8-9acc-e598d3c4deb4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-dc4724f7-e365-4df8-9acc-e598d3c4deb4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:14:05.690394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:05.691424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:05.692766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:05.692766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:05.692766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:14:05.692766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:14:05.692766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:14:05.692766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:14:05.692766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:14:05.692766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:14:05.692766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 18:14:05.692766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:14:05.692766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 632/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:14:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:05.700396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dc18f-d00f-46fc-8455-a6845e7b0de4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:05.805512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dc18f-d00f-46fc-8455-a6845e7b0de4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:05.840308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9ad36-9522-4817-a1aa-994e276d7f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:05.840934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9ad36-9522-4817-a1aa-994e276d7f9f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:05.841217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9ad36-9522-4817-a1aa-994e276d7f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:05.841481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9ad36-9522-4817-a1aa-994e276d7f9f None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:05.842206 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9ad36-9522-4817-a1aa-994e276d7f9f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:05.842515 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9ad36-9522-4817-a1aa-994e276d7f9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:05.843954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9ad36-9522-4817-a1aa-994e276d7f9f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:05.853325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:05.862866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 636/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Aug 26 18:14:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:05.868743 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4724f7-e365-4df8-9acc-e598d3c4deb4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:05.980133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4724f7-e365-4df8-9acc-e598d3c4deb4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:06.017919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1aa28-e519-465c-9424-f2df43403296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:06.018766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1aa28-e519-465c-9424-f2df43403296 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:06.019040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1aa28-e519-465c-9424-f2df43403296 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:06.020362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1aa28-e519-465c-9424-f2df43403296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:06.033810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1aa28-e519-465c-9424-f2df43403296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:06.035540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1aa28-e519-465c-9424-f2df43403296 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-12b1aa28-e519-465c-9424-f2df43403296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:14:06.050765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:06.051794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:14:06.053057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:14:06.053057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:14:06.053057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:14:06.053057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 633/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:06.060331 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9ad36-9522-4817-a1aa-994e276d7f9f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:06.165925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9ad36-9522-4817-a1aa-994e276d7f9f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:06.203094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e1542-8576-4d8c-8953-7204c5a3383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:06.203701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e1542-8576-4d8c-8953-7204c5a3383d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:06.203977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e1542-8576-4d8c-8953-7204c5a3383d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:06.204245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e1542-8576-4d8c-8953-7204c5a3383d None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:06.204920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e1542-8576-4d8c-8953-7204c5a3383d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:06.205224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e1542-8576-4d8c-8953-7204c5a3383d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:06.206632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e1542-8576-4d8c-8953-7204c5a3383d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:06.217838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 637/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:06.224444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1aa28-e519-465c-9424-f2df43403296 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:06.267428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:06.340222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1aa28-e519-465c-9424-f2df43403296 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:06.378904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131e97d-4ccc-4649-8f81-664377b65eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:06.379545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131e97d-4ccc-4649-8f81-664377b65eba None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:06.379825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131e97d-4ccc-4649-8f81-664377b65eba None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:06.380096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131e97d-4ccc-4649-8f81-664377b65eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:06.386981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131e97d-4ccc-4649-8f81-664377b65eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:06.388427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131e97d-4ccc-4649-8f81-664377b65eba None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-9131e97d-4ccc-4649-8f81-664377b65eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:14:06.399631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:06.400627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:06.401902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:14:06.401902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:14:06.401902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:14:06.401902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:14:06.401902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:14:06.401902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:14:06.401902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:14:06.401902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:14:06.401902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 634/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:06.408508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e1542-8576-4d8c-8953-7204c5a3383d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:06.468791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:06.512936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e1542-8576-4d8c-8953-7204c5a3383d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:06.547862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4c15b-ae65-4bb6-bf9f-fc1a8f3fabf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:06.548521 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c15b-ae65-4bb6-bf9f-fc1a8f3fabf1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:06.548830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c15b-ae65-4bb6-bf9f-fc1a8f3fabf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:06.549101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c15b-ae65-4bb6-bf9f-fc1a8f3fabf1 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:06.549789 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4c15b-ae65-4bb6-bf9f-fc1a8f3fabf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:06.550093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4c15b-ae65-4bb6-bf9f-fc1a8f3fabf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:06.551540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4c15b-ae65-4bb6-bf9f-fc1a8f3fabf1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:06.563360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 638/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:06.569825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131e97d-4ccc-4649-8f81-664377b65eba None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:06.668896 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:06.678857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131e97d-4ccc-4649-8f81-664377b65eba None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:06.713822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b166a90-9498-4391-9fee-47f5fdef4197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:06.714474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166a90-9498-4391-9fee-47f5fdef4197 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:06.714757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166a90-9498-4391-9fee-47f5fdef4197 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:06.715026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166a90-9498-4391-9fee-47f5fdef4197 None admin] PATH_INFO: `/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/dd9eef8921de43f18245f47559f3fa71/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:06.717204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b166a90-9498-4391-9fee-47f5fdef4197 None admin] RBAC: Authorizing `identity:create_grant(project_id=2803c5ec5ecf4223836ddf75397cc095, user_id=dd9eef8921de43f18245f47559f3fa71, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:06.718726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b166a90-9498-4391-9fee-47f5fdef4197 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:06.735341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 635/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Fri Aug 26 18:14:06 2022] PUT /identity/v3/projects/2803c5ec5ecf4223836ddf75397cc095/users/dd9eef8921de43f18245f47559f3fa71/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:14:08.585189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f856fd-7cf1-432b-91be-6e670398a3f3 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:08.585757 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f856fd-7cf1-432b-91be-6e670398a3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:08.585757 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f856fd-7cf1-432b-91be-6e670398a3f3 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:08.587085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 639/1274] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:14:08.593382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fe37a-609a-483c-88bc-506aabc54473 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:08.594177 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fe37a-609a-483c-88bc-506aabc54473 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:08.594372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fe37a-609a-483c-88bc-506aabc54473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:08.615648 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a52fe37a-609a-483c-88bc-506aabc54473 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:14:08.616883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a52fe37a-609a-483c-88bc-506aabc54473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:14:08.688232 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 636/1275] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:14:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:14:08.963563 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f856fd-7cf1-432b-91be-6e670398a3f3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:09.073063 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f856fd-7cf1-432b-91be-6e670398a3f3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:09.091131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:09.110514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a3536-a66d-439b-a8fe-3af3782eb2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:09.111167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a3536-a66d-439b-a8fe-3af3782eb2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:09.111445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a3536-a66d-439b-a8fe-3af3782eb2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:09.111712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a3536-a66d-439b-a8fe-3af3782eb2b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:09.122626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a3536-a66d-439b-a8fe-3af3782eb2b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-857a3536-a66d-439b-a8fe-3af3782eb2b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 18:14:09.127442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:09.128582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:09.129829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 640/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Fri Aug 26 18:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:09.135187 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fe37a-609a-483c-88bc-506aabc54473 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:09.228566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:09.257555 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fe37a-609a-483c-88bc-506aabc54473 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:09.296033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fec063-d0b8-4d05-b7e4-bada2522c3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:09.296811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fec063-d0b8-4d05-b7e4-bada2522c3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:09.297153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fec063-d0b8-4d05-b7e4-bada2522c3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:09.297459 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fec063-d0b8-4d05-b7e4-bada2522c3b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:09.298432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fec063-d0b8-4d05-b7e4-bada2522c3b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:09.298791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fec063-d0b8-4d05-b7e4-bada2522c3b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:09.300905 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fec063-d0b8-4d05-b7e4-bada2522c3b3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:09.313899 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 637/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Fri Aug 26 18:14:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:09.319888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a3536-a66d-439b-a8fe-3af3782eb2b6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:09.442142 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a3536-a66d-439b-a8fe-3af3782eb2b6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:09.481115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4157366-40bd-4940-bbce-709ba436055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:09.481666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4157366-40bd-4940-bbce-709ba436055e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:09.481947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4157366-40bd-4940-bbce-709ba436055e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:09.482217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4157366-40bd-4940-bbce-709ba436055e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:09.493634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4157366-40bd-4940-bbce-709ba436055e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:09.495086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4157366-40bd-4940-bbce-709ba436055e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c4157366-40bd-4940-bbce-709ba436055e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:14:09.510031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:09.511162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:14:09.512463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:14:09.512463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:14:09.512463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:09.512463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 641/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:09.517377 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fec063-d0b8-4d05-b7e4-bada2522c3b3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:09.620447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fec063-d0b8-4d05-b7e4-bada2522c3b3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:09.655548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0f7a2-e653-4d0a-b186-fdbc915e8db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:09.656147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0f7a2-e653-4d0a-b186-fdbc915e8db8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:09.656422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0f7a2-e653-4d0a-b186-fdbc915e8db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:09.656692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0f7a2-e653-4d0a-b186-fdbc915e8db8 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:09.657365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0f7a2-e653-4d0a-b186-fdbc915e8db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:09.657685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0f7a2-e653-4d0a-b186-fdbc915e8db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:09.659056 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0f7a2-e653-4d0a-b186-fdbc915e8db8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:09.670740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 638/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:09.676827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4157366-40bd-4940-bbce-709ba436055e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:09.709110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:09.787674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4157366-40bd-4940-bbce-709ba436055e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:09.827219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e029e-d83c-4d70-a78e-aeaa86e4e070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:09.827840 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e029e-d83c-4d70-a78e-aeaa86e4e070 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:09.828117 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e029e-d83c-4d70-a78e-aeaa86e4e070 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:09.828381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e029e-d83c-4d70-a78e-aeaa86e4e070 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:09.837555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e029e-d83c-4d70-a78e-aeaa86e4e070 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:09.839005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e029e-d83c-4d70-a78e-aeaa86e4e070 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-199e029e-d83c-4d70-a78e-aeaa86e4e070 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 18:14:09.850351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:09.851553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:09.853476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:09.853476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:09.853476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 18:14:09.853476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 18:14:09.853476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 18:14:09.853476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 18:14:09.853476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 18:14:09.853476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 18:14:09.853476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 18:14:09.853476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:09.853476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 642/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:14:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:09.860211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0f7a2-e653-4d0a-b186-fdbc915e8db8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:09.864509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:09.972746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0f7a2-e653-4d0a-b186-fdbc915e8db8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:10.008460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02568288-3fbe-4030-a45f-0fbd9464170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:10.009102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568288-3fbe-4030-a45f-0fbd9464170a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:10.009385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568288-3fbe-4030-a45f-0fbd9464170a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:10.009656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568288-3fbe-4030-a45f-0fbd9464170a None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:10.010387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02568288-3fbe-4030-a45f-0fbd9464170a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:10.010692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02568288-3fbe-4030-a45f-0fbd9464170a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:10.012102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02568288-3fbe-4030-a45f-0fbd9464170a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:10.030327 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 639/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Fri Aug 26 18:14:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:10.036988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e029e-d83c-4d70-a78e-aeaa86e4e070 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:10.142244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:10.153513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e029e-d83c-4d70-a78e-aeaa86e4e070 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:10.186516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253ca11-adfc-459d-9b6b-c428ff1769a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:10.187111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253ca11-adfc-459d-9b6b-c428ff1769a4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:10.187388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253ca11-adfc-459d-9b6b-c428ff1769a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:10.187660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253ca11-adfc-459d-9b6b-c428ff1769a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:10.256546 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253ca11-adfc-459d-9b6b-c428ff1769a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:10.258066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253ca11-adfc-459d-9b6b-c428ff1769a4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:10.361403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:10.376662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 643/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Fri Aug 26 18:14:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 18:14:10.382692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02568288-3fbe-4030-a45f-0fbd9464170a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:10.458849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:10.500576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02568288-3fbe-4030-a45f-0fbd9464170a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:10.538073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff70e4-a80d-4f7c-85c2-e0261cd8acd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:10.538709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff70e4-a80d-4f7c-85c2-e0261cd8acd2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:10.538991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff70e4-a80d-4f7c-85c2-e0261cd8acd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:10.539259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff70e4-a80d-4f7c-85c2-e0261cd8acd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:10.550901 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff70e4-a80d-4f7c-85c2-e0261cd8acd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:10.552350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff70e4-a80d-4f7c-85c2-e0261cd8acd2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-22ff70e4-a80d-4f7c-85c2-e0261cd8acd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 18:14:10.567911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:10.569020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 18:14:10.570128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 18:14:10.570128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 18:14:10.570128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:14:10.570128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 640/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:10.575032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253ca11-adfc-459d-9b6b-c428ff1769a4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:10.683613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253ca11-adfc-459d-9b6b-c428ff1769a4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:10.724469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb52ec-2304-43c9-b2dc-78d0c0d8b7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:10.725035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb52ec-2304-43c9-b2dc-78d0c0d8b7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:10.725314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb52ec-2304-43c9-b2dc-78d0c0d8b7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:10.725578 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb52ec-2304-43c9-b2dc-78d0c0d8b7c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:10.726219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb52ec-2304-43c9-b2dc-78d0c0d8b7c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:10.726521 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb52ec-2304-43c9-b2dc-78d0c0d8b7c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:10.727906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb52ec-2304-43c9-b2dc-78d0c0d8b7c8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:10.740490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 644/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Fri Aug 26 18:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:10.746689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff70e4-a80d-4f7c-85c2-e0261cd8acd2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:10.870204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff70e4-a80d-4f7c-85c2-e0261cd8acd2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:10.889432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:10.910580 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b585cfa-37b6-4ef9-89df-e6c236103d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:10.911247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b585cfa-37b6-4ef9-89df-e6c236103d65 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:10.911583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b585cfa-37b6-4ef9-89df-e6c236103d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:10.911848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b585cfa-37b6-4ef9-89df-e6c236103d65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:10.918415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b585cfa-37b6-4ef9-89df-e6c236103d65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:10.919856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b585cfa-37b6-4ef9-89df-e6c236103d65 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-0b585cfa-37b6-4ef9-89df-e6c236103d65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 18:14:10.931076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:10.932099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:10.933049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 18:14:10.933049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 18:14:10.933049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 18:14:10.933049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 18:14:10.933049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 18:14:10.933049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 18:14:10.933049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 18:14:10.933049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 26 18:14:10.933049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 641/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Fri Aug 26 18:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:10.938346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb52ec-2304-43c9-b2dc-78d0c0d8b7c8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:10.997646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:11.055817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb52ec-2304-43c9-b2dc-78d0c0d8b7c8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:11.090686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20abb93-30c3-47db-a156-e4a284b0cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:11.091284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20abb93-30c3-47db-a156-e4a284b0cb4f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:11.091560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20abb93-30c3-47db-a156-e4a284b0cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:11.091833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20abb93-30c3-47db-a156-e4a284b0cb4f None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:11.092518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20abb93-30c3-47db-a156-e4a284b0cb4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:11.092853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20abb93-30c3-47db-a156-e4a284b0cb4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:11.094306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20abb93-30c3-47db-a156-e4a284b0cb4f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:11.106264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 645/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Fri Aug 26 18:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:11.113049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b585cfa-37b6-4ef9-89df-e6c236103d65 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:11.216621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b585cfa-37b6-4ef9-89df-e6c236103d65 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:11.251573 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8e2c3-6394-4773-90ee-11fb3c41e7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:11.252097 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8e2c3-6394-4773-90ee-11fb3c41e7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:11.252373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8e2c3-6394-4773-90ee-11fb3c41e7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:11.252643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8e2c3-6394-4773-90ee-11fb3c41e7d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:11.253398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8e2c3-6394-4773-90ee-11fb3c41e7d7 None admin] RBAC: Adding query filter params (role.id=db572ad3d504403cbb227c2155c93eda, scope.project.id=2803c5ec5ecf4223836ddf75397cc095, user.id=dd9eef8921de43f18245f47559f3fa71) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:11.253708 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8e2c3-6394-4773-90ee-11fb3c41e7d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:11.255146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8e2c3-6394-4773-90ee-11fb3c41e7d7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:11.261442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 642/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Fri Aug 26 18:14:11 2022] GET /identity/v3/role_assignments?user.id=dd9eef8921de43f18245f47559f3fa71&scope.project.id=2803c5ec5ecf4223836ddf75397cc095&role.id=db572ad3d504403cbb227c2155c93eda => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:13.207895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a995cc-4c89-4174-82e7-6cea76d85521 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:13.208485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a995cc-4c89-4174-82e7-6cea76d85521 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:13.208485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a995cc-4c89-4174-82e7-6cea76d85521 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:13.209835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 646/1288] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:14:13.216035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8010d9-2bf3-46ee-8ae9-de0624867f7b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:13.216482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8010d9-2bf3-46ee-8ae9-de0624867f7b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:13.216610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8010d9-2bf3-46ee-8ae9-de0624867f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:13.242688 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2f8010d9-2bf3-46ee-8ae9-de0624867f7b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:14:13.243884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2f8010d9-2bf3-46ee-8ae9-de0624867f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:14:13.274869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:13.320763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 643/1289] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:14:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:14:13.584251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a995cc-4c89-4174-82e7-6cea76d85521 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:13.713104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a995cc-4c89-4174-82e7-6cea76d85521 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:13.724898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:13.749473 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18aaec-cd81-4036-a697-e4eaa2f5008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:13.750093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18aaec-cd81-4036-a697-e4eaa2f5008d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:13.750368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18aaec-cd81-4036-a697-e4eaa2f5008d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:13.750636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18aaec-cd81-4036-a697-e4eaa2f5008d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:13.751218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18aaec-cd81-4036-a697-e4eaa2f5008d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:13.752686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18aaec-cd81-4036-a697-e4eaa2f5008d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-ba18aaec-cd81-4036-a697-e4eaa2f5008d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:13.761548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:13.762803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:13.763893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 647/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 26 18:14:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:13.769070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8010d9-2bf3-46ee-8ae9-de0624867f7b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:13.868589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8010d9-2bf3-46ee-8ae9-de0624867f7b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:13.914051 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780f6f1-c443-40ab-9ca1-dd9e8483513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:13.915891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780f6f1-c443-40ab-9ca1-dd9e8483513a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:13.916448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780f6f1-c443-40ab-9ca1-dd9e8483513a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:13.917760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780f6f1-c443-40ab-9ca1-dd9e8483513a None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:13.918667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780f6f1-c443-40ab-9ca1-dd9e8483513a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:13.919000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780f6f1-c443-40ab-9ca1-dd9e8483513a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:13.920553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780f6f1-c443-40ab-9ca1-dd9e8483513a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:13.927292 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 644/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Aug 26 18:14:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:13.933547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18aaec-cd81-4036-a697-e4eaa2f5008d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:14.049695 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18aaec-cd81-4036-a697-e4eaa2f5008d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:14.093906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cada86d-c9e9-4ed4-b00e-165efd4dc2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:14.094564 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cada86d-c9e9-4ed4-b00e-165efd4dc2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:14.094798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cada86d-c9e9-4ed4-b00e-165efd4dc2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:14.095675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cada86d-c9e9-4ed4-b00e-165efd4dc2e6 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:14.095895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cada86d-c9e9-4ed4-b00e-165efd4dc2e6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:14.096322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cada86d-c9e9-4ed4-b00e-165efd4dc2e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:14.098473 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cada86d-c9e9-4ed4-b00e-165efd4dc2e6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:14.103161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 648/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Aug 26 18:14:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:15.966333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd105cc-ec66-42d6-8a6f-98f718779b41 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:15.966914 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd105cc-ec66-42d6-8a6f-98f718779b41 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:15.966914 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd105cc-ec66-42d6-8a6f-98f718779b41 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:15.968248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 645/1293] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:14:15.973579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884b444-02c8-408e-8216-b133640706bc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:15.973997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884b444-02c8-408e-8216-b133640706bc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:15.974124 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884b444-02c8-408e-8216-b133640706bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:15.993651 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7884b444-02c8-408e-8216-b133640706bc None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:14:15.994848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7884b444-02c8-408e-8216-b133640706bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:14:16.026933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:16.065421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 649/1294] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:14:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:14:16.336811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd105cc-ec66-42d6-8a6f-98f718779b41 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:16.370113 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:16.441977 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd105cc-ec66-42d6-8a6f-98f718779b41 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:16.475861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228330e-2e8a-407d-a171-8b78af24d6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:16.476479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228330e-2e8a-407d-a171-8b78af24d6cd None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:16.476873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228330e-2e8a-407d-a171-8b78af24d6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:16.477128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228330e-2e8a-407d-a171-8b78af24d6cd None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:16.478323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228330e-2e8a-407d-a171-8b78af24d6cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:16.479836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228330e-2e8a-407d-a171-8b78af24d6cd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:16.498622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 646/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Fri Aug 26 18:14:16 2022] POST /identity/v3/services => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:14:18.393277 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b71158-9b9d-4a0f-a818-caba535dfa6a None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:18.393877 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b71158-9b9d-4a0f-a818-caba535dfa6a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:18.393877 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b71158-9b9d-4a0f-a818-caba535dfa6a None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:18.395207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 650/1296] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:14:18.401549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c5968-b0e5-4049-9ce2-25b46988c333 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:18.402278 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c5968-b0e5-4049-9ce2-25b46988c333 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:18.402427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c5968-b0e5-4049-9ce2-25b46988c333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:18.424746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-769c5968-b0e5-4049-9ce2-25b46988c333 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:14:18.425960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-769c5968-b0e5-4049-9ce2-25b46988c333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:14:18.508740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 647/1297] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:14:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 18:14:18.775167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b71158-9b9d-4a0f-a818-caba535dfa6a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:18.898506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b71158-9b9d-4a0f-a818-caba535dfa6a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:18.938450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09b8c4-2e96-49d6-99c8-4f882d0cec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:18.939130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09b8c4-2e96-49d6-99c8-4f882d0cec6a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:18.939468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09b8c4-2e96-49d6-99c8-4f882d0cec6a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:18.939745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09b8c4-2e96-49d6-99c8-4f882d0cec6a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:18.940364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09b8c4-2e96-49d6-99c8-4f882d0cec6a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:18.941935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09b8c4-2e96-49d6-99c8-4f882d0cec6a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-4e09b8c4-2e96-49d6-99c8-4f882d0cec6a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:18.952539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:18.953858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:18.954965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 651/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 26 18:14:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:18.960330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c5968-b0e5-4049-9ce2-25b46988c333 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:18.980144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:19.062223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c5968-b0e5-4049-9ce2-25b46988c333 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:19.097104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07c4e6-467b-45f3-824e-1f3e61cfdb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:19.097700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07c4e6-467b-45f3-824e-1f3e61cfdb7c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:19.097976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07c4e6-467b-45f3-824e-1f3e61cfdb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:19.098238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07c4e6-467b-45f3-824e-1f3e61cfdb7c None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:19.098858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07c4e6-467b-45f3-824e-1f3e61cfdb7c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:19.099153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07c4e6-467b-45f3-824e-1f3e61cfdb7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:19.100522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07c4e6-467b-45f3-824e-1f3e61cfdb7c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:19.106228 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 648/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Aug 26 18:14:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:19.113122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09b8c4-2e96-49d6-99c8-4f882d0cec6a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:19.148161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:19.217418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09b8c4-2e96-49d6-99c8-4f882d0cec6a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:19.252744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fde69d-9609-4b13-9899-33f019aab6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:19.253380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fde69d-9609-4b13-9899-33f019aab6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:19.253663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fde69d-9609-4b13-9899-33f019aab6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:19.253924 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fde69d-9609-4b13-9899-33f019aab6d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:19.254610 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fde69d-9609-4b13-9899-33f019aab6d3 None admin] RBAC: Adding query filter params (interface=public, service_id=744fefa2d78346ba8106bfdbce8f0238, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:19.254923 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fde69d-9609-4b13-9899-33f019aab6d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:19.256285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fde69d-9609-4b13-9899-33f019aab6d3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:19.261979 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 652/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Fri Aug 26 18:14:19 2022] GET /identity/v3/endpoints?service_id=744fefa2d78346ba8106bfdbce8f0238&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:19.268315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07c4e6-467b-45f3-824e-1f3e61cfdb7c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:19.353171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:19.372338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07c4e6-467b-45f3-824e-1f3e61cfdb7c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:19.406907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491dab7-d8f9-4829-bd98-c7d4818b2ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:19.407492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491dab7-d8f9-4829-bd98-c7d4818b2ffb None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:19.407770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491dab7-d8f9-4829-bd98-c7d4818b2ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:19.408072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491dab7-d8f9-4829-bd98-c7d4818b2ffb None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:19.408684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491dab7-d8f9-4829-bd98-c7d4818b2ffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:19.410094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491dab7-d8f9-4829-bd98-c7d4818b2ffb None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:19.417563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 649/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Fri Aug 26 18:14:19 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:14:21.293720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33cb26-96c7-4112-80e4-cf500cdc0b5f None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:21.294294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33cb26-96c7-4112-80e4-cf500cdc0b5f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:21.294294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33cb26-96c7-4112-80e4-cf500cdc0b5f None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:21.296523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 653/1302] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:14:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:14:21.304433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04102e-8503-41b5-9633-8f3b4c8dc0f3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:21.304918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04102e-8503-41b5-9633-8f3b4c8dc0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:21.305035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04102e-8503-41b5-9633-8f3b4c8dc0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:21.331627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fc04102e-8503-41b5-9633-8f3b4c8dc0f3 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:14:21.333446 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fc04102e-8503-41b5-9633-8f3b4c8dc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:14:21.407406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 650/1303] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:14:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 18:14:21.687739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33cb26-96c7-4112-80e4-cf500cdc0b5f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:21.788009 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:21.799728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33cb26-96c7-4112-80e4-cf500cdc0b5f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:21.839888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1856d7-2b9d-4ed3-902e-54edb8575ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:21.840804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1856d7-2b9d-4ed3-902e-54edb8575ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:21.841208 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1856d7-2b9d-4ed3-902e-54edb8575ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:21.841553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1856d7-2b9d-4ed3-902e-54edb8575ba9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:21.842438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1856d7-2b9d-4ed3-902e-54edb8575ba9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:21.844644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1856d7-2b9d-4ed3-902e-54edb8575ba9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-af1856d7-2b9d-4ed3-902e-54edb8575ba9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 18:14:21.857982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 18:14:21.859137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 26 18:14:21.860465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 654/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Fri Aug 26 18:14:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 18:14:21.868114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04102e-8503-41b5-9633-8f3b4c8dc0f3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:21.949098 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:21.981912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04102e-8503-41b5-9633-8f3b4c8dc0f3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:22.016902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829d9bd-de8a-4f38-9169-efb7c1d96c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:22.017522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829d9bd-de8a-4f38-9169-efb7c1d96c24 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:22.017799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829d9bd-de8a-4f38-9169-efb7c1d96c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:22.018046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829d9bd-de8a-4f38-9169-efb7c1d96c24 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:22.018680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829d9bd-de8a-4f38-9169-efb7c1d96c24 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:14:22.018974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829d9bd-de8a-4f38-9169-efb7c1d96c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:22.020369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829d9bd-de8a-4f38-9169-efb7c1d96c24 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:22.025564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 651/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Fri Aug 26 18:14:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:14:22.031786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1856d7-2b9d-4ed3-902e-54edb8575ba9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:14:22.138433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1856d7-2b9d-4ed3-902e-54edb8575ba9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:14:22.176157 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacf849-d370-49c8-b63c-60f1a11fb612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:14:22.176765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacf849-d370-49c8-b63c-60f1a11fb612 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:14:22.177008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacf849-d370-49c8-b63c-60f1a11fb612 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:14:22.177301 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacf849-d370-49c8-b63c-60f1a11fb612 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:14:22.177971 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacf849-d370-49c8-b63c-60f1a11fb612 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:14:22.179340 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacf849-d370-49c8-b63c-60f1a11fb612 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:14:22.201115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 655/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:14:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:14:32.022516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=30 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:14:32.197228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:25.748897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28043e-f722-4fd6-8ca4-14bda81eb047 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:25.749802 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28043e-f722-4fd6-8ca4-14bda81eb047 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:25.750233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28043e-f722-4fd6-8ca4-14bda81eb047 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:25.755988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 652/1307] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:15:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:15:25.757367 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22accf90-d890-4f23-afd5-dc9bd069c335 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:25.757787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22accf90-d890-4f23-afd5-dc9bd069c335 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:25.757963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22accf90-d890-4f23-afd5-dc9bd069c335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:25.837102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-22accf90-d890-4f23-afd5-dc9bd069c335 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:25.838326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-22accf90-d890-4f23-afd5-dc9bd069c335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:25.988734 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 656/1308] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:15:26.279027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fdf07-afb7-4326-a51a-914daa2312cd None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:26.279377 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fdf07-afb7-4326-a51a-914daa2312cd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:26.279586 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fdf07-afb7-4326-a51a-914daa2312cd None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:26.281238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 653/1309] 10.222.0.45 () {54 vars in 965 bytes} [Fri Aug 26 18:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:15:26.287588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6b2b0-eaa4-4399-9535-744fc56603d9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:26.288055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6b2b0-eaa4-4399-9535-744fc56603d9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:26.288331 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6b2b0-eaa4-4399-9535-744fc56603d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:26.366956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2df6b2b0-eaa4-4399-9535-744fc56603d9 None None] MFA Rules not processed for user `78487667b3334cf09fed51b697cbf759`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:26.368155 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2df6b2b0-eaa4-4399-9535-744fc56603d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:26.391361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:26.451438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 657/1310] 10.222.0.45 () {58 vars in 1062 bytes} [Fri Aug 26 18:15:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:15:26.460932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fdf07-afb7-4326-a51a-914daa2312cd None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:15:26.462835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-742fdf07-afb7-4326-a51a-914daa2312cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:26.603087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fdf07-afb7-4326-a51a-914daa2312cd None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:15:26.684953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73732b0b-dd07-4abb-93bf-7e1fe038cc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:15:26.685588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73732b0b-dd07-4abb-93bf-7e1fe038cc10 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:26.685871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73732b0b-dd07-4abb-93bf-7e1fe038cc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:26.686140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73732b0b-dd07-4abb-93bf-7e1fe038cc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:26.687827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-73732b0b-dd07-4abb-93bf-7e1fe038cc10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:26.746315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:26.803201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73732b0b-dd07-4abb-93bf-7e1fe038cc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:15:26.804649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73732b0b-dd07-4abb-93bf-7e1fe038cc10 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:15:26.823726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 654/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:15:28.976517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ff7de-f206-438a-bba7-3da84a02e05a None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:28.977068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ff7de-f206-438a-bba7-3da84a02e05a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:28.977439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ff7de-f206-438a-bba7-3da84a02e05a None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:28.979038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 658/1312] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:15:28.984386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5b2f-700d-4a63-aa7e-eaf5f43e189c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:28.984827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5b2f-700d-4a63-aa7e-eaf5f43e189c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:28.985079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5b2f-700d-4a63-aa7e-eaf5f43e189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:29.072390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-7c8e5b2f-700d-4a63-aa7e-eaf5f43e189c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:29.073664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7c8e5b2f-700d-4a63-aa7e-eaf5f43e189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:29.182836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 655/1313] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:15:29.464763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ff7de-f206-438a-bba7-3da84a02e05a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:15:29.466347 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-161ff7de-f206-438a-bba7-3da84a02e05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:29.574358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ff7de-f206-438a-bba7-3da84a02e05a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:15:29.645139 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:29.648044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34667081-c817-4e39-8417-8842a6c7ad60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:15:29.649072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34667081-c817-4e39-8417-8842a6c7ad60 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:29.649543 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34667081-c817-4e39-8417-8842a6c7ad60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:29.650045 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34667081-c817-4e39-8417-8842a6c7ad60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:29.651702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-34667081-c817-4e39-8417-8842a6c7ad60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:29.766211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34667081-c817-4e39-8417-8842a6c7ad60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:15:29.767573 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34667081-c817-4e39-8417-8842a6c7ad60 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:15:29.786740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 659/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:15:31.981692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df80b0-4111-41d2-8809-c259820cfbce None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:31.982554 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df80b0-4111-41d2-8809-c259820cfbce None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:31.982554 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df80b0-4111-41d2-8809-c259820cfbce None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:31.984750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 656/1315] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:15:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:15:31.991702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460486d-a49f-4a27-9b72-362b2f16b531 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:31.992106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460486d-a49f-4a27-9b72-362b2f16b531 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:31.992247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460486d-a49f-4a27-9b72-362b2f16b531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:32.059154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c460486d-a49f-4a27-9b72-362b2f16b531 None None] MFA Rules not processed for user `d399c8932dea4a31a881e6ab6d908c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:32.060363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c460486d-a49f-4a27-9b72-362b2f16b531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:32.117083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:32.169946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 660/1316] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:15:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:15:32.470348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cde97-9886-45f1-9a22-92fef52054f7 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:32.470787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cde97-9886-45f1-9a22-92fef52054f7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:32.471149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cde97-9886-45f1-9a22-92fef52054f7 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:32.472897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 657/1317] 10.222.0.45 () {54 vars in 965 bytes} [Fri Aug 26 18:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:15:32.479011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e31354-15c1-4216-8d1e-32ab203fe04b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:32.479304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e31354-15c1-4216-8d1e-32ab203fe04b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:32.479582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e31354-15c1-4216-8d1e-32ab203fe04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:32.561665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-43e31354-15c1-4216-8d1e-32ab203fe04b None None] MFA Rules not processed for user `78487667b3334cf09fed51b697cbf759`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:32.562882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-43e31354-15c1-4216-8d1e-32ab203fe04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:32.643268 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 661/1318] 10.222.0.45 () {58 vars in 1062 bytes} [Fri Aug 26 18:15:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:15:32.652499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cde97-9886-45f1-9a22-92fef52054f7 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:15:32.654145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-466cde97-9886-45f1-9a22-92fef52054f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:32.664411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:32.762246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cde97-9886-45f1-9a22-92fef52054f7 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:15:32.836597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200cf3d-21ea-4316-930e-abde6c474895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:15:32.837265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200cf3d-21ea-4316-930e-abde6c474895 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:32.837539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200cf3d-21ea-4316-930e-abde6c474895 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:32.837811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200cf3d-21ea-4316-930e-abde6c474895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:32.839393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7200cf3d-21ea-4316-930e-abde6c474895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:32.909020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:32.957186 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200cf3d-21ea-4316-930e-abde6c474895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:15:32.958635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200cf3d-21ea-4316-930e-abde6c474895 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:15:32.977361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 658/1319] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:15:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:15:35.766450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dad4d4-346a-4977-a1cc-c785e805985a None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:35.767008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dad4d4-346a-4977-a1cc-c785e805985a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:35.767008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dad4d4-346a-4977-a1cc-c785e805985a None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:35.768385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 662/1320] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:15:35.774181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c758387-8579-47e1-b571-b9ff00c82ca9 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:35.774603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c758387-8579-47e1-b571-b9ff00c82ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:35.774708 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c758387-8579-47e1-b571-b9ff00c82ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:35.844859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-7c758387-8579-47e1-b571-b9ff00c82ca9 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:35.846064 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7c758387-8579-47e1-b571-b9ff00c82ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:35.949227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 659/1321] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:15:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:15:36.235250 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dad4d4-346a-4977-a1cc-c785e805985a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:15:36.237729 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a1dad4d4-346a-4977-a1cc-c785e805985a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:36.295462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:36.349387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dad4d4-346a-4977-a1cc-c785e805985a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:15:36.437841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aeb20-56e3-4e05-9cd0-dd0110139b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:15:36.438663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aeb20-56e3-4e05-9cd0-dd0110139b68 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:36.439021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aeb20-56e3-4e05-9cd0-dd0110139b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:36.439269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aeb20-56e3-4e05-9cd0-dd0110139b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:36.442147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8f5aeb20-56e3-4e05-9cd0-dd0110139b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:36.549109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:36.563662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5aeb20-56e3-4e05-9cd0-dd0110139b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:15:36.565154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5aeb20-56e3-4e05-9cd0-dd0110139b68 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:15:36.583942 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 663/1322] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:15:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:15:39.245150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9095e-2750-44de-aec5-6cdc3346b492 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:39.245731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9095e-2750-44de-aec5-6cdc3346b492 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:39.245731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9095e-2750-44de-aec5-6cdc3346b492 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:39.247053 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 660/1323] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:15:39.252371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849f70b-f92a-445b-b144-3d4d9c1b7c48 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:39.252864 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849f70b-f92a-445b-b144-3d4d9c1b7c48 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:39.252986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849f70b-f92a-445b-b144-3d4d9c1b7c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:39.319018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1849f70b-f92a-445b-b144-3d4d9c1b7c48 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:39.320234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1849f70b-f92a-445b-b144-3d4d9c1b7c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:39.420034 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 664/1324] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:15:39.694844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9095e-2750-44de-aec5-6cdc3346b492 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:15:39.696382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-aed9095e-2750-44de-aec5-6cdc3346b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:39.716613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:39.802903 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9095e-2750-44de-aec5-6cdc3346b492 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:15:39.880919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67e543-cfb7-4b8a-8b81-c98e6a6138ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:15:39.881449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67e543-cfb7-4b8a-8b81-c98e6a6138ac service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:39.881755 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67e543-cfb7-4b8a-8b81-c98e6a6138ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:39.882001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67e543-cfb7-4b8a-8b81-c98e6a6138ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:39.883784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5e67e543-cfb7-4b8a-8b81-c98e6a6138ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:39.960968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:39.999272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67e543-cfb7-4b8a-8b81-c98e6a6138ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:15:40.000751 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67e543-cfb7-4b8a-8b81-c98e6a6138ac service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:15:40.019323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 661/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:15:42.044374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8ca3e-36fd-49fb-b50f-c3843f0c3940 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:42.045041 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8ca3e-36fd-49fb-b50f-c3843f0c3940 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:42.045041 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8ca3e-36fd-49fb-b50f-c3843f0c3940 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:42.046280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 665/1326] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:15:42.051780 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264c5f9-b113-44b6-8736-3920cb14ee55 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:42.052266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264c5f9-b113-44b6-8736-3920cb14ee55 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:42.052266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264c5f9-b113-44b6-8736-3920cb14ee55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:42.117596 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1264c5f9-b113-44b6-8736-3920cb14ee55 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:42.119315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1264c5f9-b113-44b6-8736-3920cb14ee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:42.236393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 662/1327] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:15:42.518743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8ca3e-36fd-49fb-b50f-c3843f0c3940 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:15:42.520303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4eb8ca3e-36fd-49fb-b50f-c3843f0c3940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:42.584659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:42.631040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8ca3e-36fd-49fb-b50f-c3843f0c3940 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:15:42.706131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a9f81-c362-4d33-a1c5-9e0a2b74fa7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:15:42.706735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a9f81-c362-4d33-a1c5-9e0a2b74fa7a service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:42.707006 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a9f81-c362-4d33-a1c5-9e0a2b74fa7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:42.707274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a9f81-c362-4d33-a1c5-9e0a2b74fa7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:42.708929 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-496a9f81-c362-4d33-a1c5-9e0a2b74fa7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:42.815653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:42.818358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a9f81-c362-4d33-a1c5-9e0a2b74fa7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:15:42.819878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a9f81-c362-4d33-a1c5-9e0a2b74fa7a service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:15:42.840454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 666/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:15:44.774163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60101345-b527-4d00-892a-5997a59c6234 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:44.774828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60101345-b527-4d00-892a-5997a59c6234 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:44.774828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60101345-b527-4d00-892a-5997a59c6234 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:44.776076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 663/1329] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:15:44.781392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f057789-b911-428e-a9d4-237e1d29ee03 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:44.781831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f057789-b911-428e-a9d4-237e1d29ee03 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:44.781944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f057789-b911-428e-a9d4-237e1d29ee03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:44.847330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2f057789-b911-428e-a9d4-237e1d29ee03 None None] MFA Rules not processed for user `d399c8932dea4a31a881e6ab6d908c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:44.848536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2f057789-b911-428e-a9d4-237e1d29ee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:44.948379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 667/1330] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:15:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:15:45.232563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60101345-b527-4d00-892a-5997a59c6234 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:15:45.234213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-60101345-b527-4d00-892a-5997a59c6234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:45.269539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:45.350708 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60101345-b527-4d00-892a-5997a59c6234 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:15:45.429470 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953f21b-9b60-4c8f-8edb-fc2c5a2c2336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:15:45.430095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953f21b-9b60-4c8f-8edb-fc2c5a2c2336 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:45.430372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953f21b-9b60-4c8f-8edb-fc2c5a2c2336 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:45.430643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953f21b-9b60-4c8f-8edb-fc2c5a2c2336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:45.432271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b953f21b-9b60-4c8f-8edb-fc2c5a2c2336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:45.521671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:45.555479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953f21b-9b60-4c8f-8edb-fc2c5a2c2336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:15:45.556972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953f21b-9b60-4c8f-8edb-fc2c5a2c2336 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:15:45.574758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 664/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:15:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:15:47.712710 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca78bc7-b821-4446-a7b7-4c21a1087816 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:47.713668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca78bc7-b821-4446-a7b7-4c21a1087816 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:47.713668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca78bc7-b821-4446-a7b7-4c21a1087816 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:47.715903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 668/1332] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:15:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:15:47.721357 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26075c-33e3-4957-9c52-707cf404c542 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:47.721808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26075c-33e3-4957-9c52-707cf404c542 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:47.721903 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26075c-33e3-4957-9c52-707cf404c542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:47.788940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4f26075c-33e3-4957-9c52-707cf404c542 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:47.790052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4f26075c-33e3-4957-9c52-707cf404c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:47.894509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 665/1333] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:15:48.173106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca78bc7-b821-4446-a7b7-4c21a1087816 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:15:48.175615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1ca78bc7-b821-4446-a7b7-4c21a1087816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:48.255785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:48.293004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca78bc7-b821-4446-a7b7-4c21a1087816 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:15:48.380231 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0574664-b27a-4635-a3bf-5d16635ceb4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:15:48.380863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0574664-b27a-4635-a3bf-5d16635ceb4a service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:48.381140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0574664-b27a-4635-a3bf-5d16635ceb4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:48.381409 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0574664-b27a-4635-a3bf-5d16635ceb4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:48.383064 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f0574664-b27a-4635-a3bf-5d16635ceb4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:48.495384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0574664-b27a-4635-a3bf-5d16635ceb4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:15:48.496852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0574664-b27a-4635-a3bf-5d16635ceb4a service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:15:48.507146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:48.516626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 669/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:15:50.434112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd1df8-1ba1-4f65-bf1f-d74bb72cc0c9 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:50.435005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd1df8-1ba1-4f65-bf1f-d74bb72cc0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:50.435005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd1df8-1ba1-4f65-bf1f-d74bb72cc0c9 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:50.437270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 666/1335] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:15:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:15:50.443386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813f3db-5d61-4e67-8cd9-1897899b8451 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:50.443859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813f3db-5d61-4e67-8cd9-1897899b8451 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:50.443965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813f3db-5d61-4e67-8cd9-1897899b8451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:50.518849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a813f3db-5d61-4e67-8cd9-1897899b8451 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:50.520103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a813f3db-5d61-4e67-8cd9-1897899b8451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:50.618099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 670/1336] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:15:50.903426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd1df8-1ba1-4f65-bf1f-d74bb72cc0c9 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:15:50.905888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fdcd1df8-1ba1-4f65-bf1f-d74bb72cc0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:50.956083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:51.025981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd1df8-1ba1-4f65-bf1f-d74bb72cc0c9 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:15:51.102514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090ffed-480e-4ba3-980d-f6d1abad6d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:15:51.103123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ffed-480e-4ba3-980d-f6d1abad6d8d service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:51.103404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ffed-480e-4ba3-980d-f6d1abad6d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:51.103668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ffed-480e-4ba3-980d-f6d1abad6d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:51.105291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a090ffed-480e-4ba3-980d-f6d1abad6d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:51.199198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:51.227578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090ffed-480e-4ba3-980d-f6d1abad6d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:15:51.229911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090ffed-480e-4ba3-980d-f6d1abad6d8d service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:15:51.257986 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 667/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:15:53.559980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba17f0f-0c8d-4f20-838e-760f2a76056e None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:53.560769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba17f0f-0c8d-4f20-838e-760f2a76056e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:53.561057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba17f0f-0c8d-4f20-838e-760f2a76056e None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:53.562968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 671/1338] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:15:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:15:53.571263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e405-fc95-4ff4-be0b-6247b8a4da1e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:53.571713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e405-fc95-4ff4-be0b-6247b8a4da1e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:53.571823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e405-fc95-4ff4-be0b-6247b8a4da1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:53.649450 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-93c8e405-fc95-4ff4-be0b-6247b8a4da1e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:53.650683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-93c8e405-fc95-4ff4-be0b-6247b8a4da1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:53.750656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 668/1339] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:15:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:15:54.051670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba17f0f-0c8d-4f20-838e-760f2a76056e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:15:54.054787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2ba17f0f-0c8d-4f20-838e-760f2a76056e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:54.138377 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:54.177085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba17f0f-0c8d-4f20-838e-760f2a76056e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:15:54.279868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fd3f0-19e5-45f6-8a67-d575d4774815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:15:54.280481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd3f0-19e5-45f6-8a67-d575d4774815 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:54.280786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd3f0-19e5-45f6-8a67-d575d4774815 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:54.281230 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd3f0-19e5-45f6-8a67-d575d4774815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:54.283499 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e27fd3f0-19e5-45f6-8a67-d575d4774815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:54.411298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fd3f0-19e5-45f6-8a67-d575d4774815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:15:54.412704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fd3f0-19e5-45f6-8a67-d575d4774815 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:15:54.432951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 672/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:15:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:15:58.275036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397998e6-693d-46af-9060-82e0e64e79c5 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:58.275571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397998e6-693d-46af-9060-82e0e64e79c5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:58.275571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397998e6-693d-46af-9060-82e0e64e79c5 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:58.276991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 669/1341] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:15:58.282307 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd7ae-963f-4422-a5b8-0cadaa31e426 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:58.282760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd7ae-963f-4422-a5b8-0cadaa31e426 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:58.282871 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd7ae-963f-4422-a5b8-0cadaa31e426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:58.288476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:58.351357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a61bd7ae-963f-4422-a5b8-0cadaa31e426 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:15:58.352581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a61bd7ae-963f-4422-a5b8-0cadaa31e426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:58.456531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 673/1342] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:15:58.734696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397998e6-693d-46af-9060-82e0e64e79c5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:15:58.736239 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-397998e6-693d-46af-9060-82e0e64e79c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:58.789320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:58.847461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397998e6-693d-46af-9060-82e0e64e79c5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:15:58.925520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1c913-974a-483c-b761-cfa66fae4d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:15:58.926136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c913-974a-483c-b761-cfa66fae4d74 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:15:58.926415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c913-974a-483c-b761-cfa66fae4d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:15:58.926689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c913-974a-483c-b761-cfa66fae4d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:15:58.928416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-36b1c913-974a-483c-b761-cfa66fae4d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:15:59.026498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:15:59.045766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1c913-974a-483c-b761-cfa66fae4d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:15:59.047173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1c913-974a-483c-b761-cfa66fae4d74 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:15:59.068021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 670/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:01.521167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057983-bf19-42ff-96d9-20bdbe4d4a1b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:01.521572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057983-bf19-42ff-96d9-20bdbe4d4a1b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:01.521720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057983-bf19-42ff-96d9-20bdbe4d4a1b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:01.523146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 674/1344] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:01.528851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cef65-2c4f-472c-b8c8-c5b14b6ded9a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:01.529496 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cef65-2c4f-472c-b8c8-c5b14b6ded9a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:01.529496 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cef65-2c4f-472c-b8c8-c5b14b6ded9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:01.597792 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-780cef65-2c4f-472c-b8c8-c5b14b6ded9a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:01.599144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-780cef65-2c4f-472c-b8c8-c5b14b6ded9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:01.699266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 671/1345] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:16:01.977654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9057983-bf19-42ff-96d9-20bdbe4d4a1b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:01.979334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e9057983-bf19-42ff-96d9-20bdbe4d4a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:02.072973 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:02.090539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9057983-bf19-42ff-96d9-20bdbe4d4a1b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:02.165178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950ee40-575c-4bb5-acf4-849bf32e07d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:02.165797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ee40-575c-4bb5-acf4-849bf32e07d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:02.166076 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ee40-575c-4bb5-acf4-849bf32e07d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:02.166346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ee40-575c-4bb5-acf4-849bf32e07d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:02.167944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d950ee40-575c-4bb5-acf4-849bf32e07d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:02.281106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950ee40-575c-4bb5-acf4-849bf32e07d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:02.282537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950ee40-575c-4bb5-acf4-849bf32e07d8 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:02.301065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 675/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:06.483996 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c65fd6-fc09-4b10-834a-c3d9a46883d8 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:06.484557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c65fd6-fc09-4b10-834a-c3d9a46883d8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:06.484557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c65fd6-fc09-4b10-834a-c3d9a46883d8 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:06.486005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 672/1347] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:06.492054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9f02d-e1bb-40b4-ac92-464da81e1239 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:06.492561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9f02d-e1bb-40b4-ac92-464da81e1239 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:06.492561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9f02d-e1bb-40b4-ac92-464da81e1239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:06.509187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:06.563711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-aff9f02d-e1bb-40b4-ac92-464da81e1239 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:06.564991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-aff9f02d-e1bb-40b4-ac92-464da81e1239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:06.665012 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 676/1348] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:06.941133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c65fd6-fc09-4b10-834a-c3d9a46883d8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:06.942681 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-90c65fd6-fc09-4b10-834a-c3d9a46883d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:07.009158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:07.058967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c65fd6-fc09-4b10-834a-c3d9a46883d8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:07.138042 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4b1f5-6194-4a51-a636-85d8104b5a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:07.138585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4b1f5-6194-4a51-a636-85d8104b5a2f service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:07.138867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4b1f5-6194-4a51-a636-85d8104b5a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:07.139136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4b1f5-6194-4a51-a636-85d8104b5a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:07.140731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9ef4b1f5-6194-4a51-a636-85d8104b5a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:07.255611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:07.260044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4b1f5-6194-4a51-a636-85d8104b5a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:07.261941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4b1f5-6194-4a51-a636-85d8104b5a2f service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:07.280860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 673/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:12.135348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae8e50-6501-4e7c-9149-e536ffd0cb9d None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:12.135875 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae8e50-6501-4e7c-9149-e536ffd0cb9d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:12.136229 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae8e50-6501-4e7c-9149-e536ffd0cb9d None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:12.137927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 677/1350] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:12.143412 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b9d76-55a8-4661-839c-295402dcce9b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:12.144165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b9d76-55a8-4661-839c-295402dcce9b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:12.144585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b9d76-55a8-4661-839c-295402dcce9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:12.233848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-305b9d76-55a8-4661-839c-295402dcce9b None None] MFA Rules not processed for user `dd9eef8921de43f18245f47559f3fa71`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:12.235257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-305b9d76-55a8-4661-839c-295402dcce9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:12.425177 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 674/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:16:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:16.663198 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=59 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:16.666006 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389adf-233d-4c57-b253-a81ace249e29 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:16.667208 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389adf-233d-4c57-b253-a81ace249e29 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:16.667769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389adf-233d-4c57-b253-a81ace249e29 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:16.669362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 678/1352] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:16.674693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eecf28-f509-47a2-9a64-0ad5c4fdab13 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:16.675138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eecf28-f509-47a2-9a64-0ad5c4fdab13 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:16.675524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eecf28-f509-47a2-9a64-0ad5c4fdab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:16.732561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:16.765232 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-93eecf28-f509-47a2-9a64-0ad5c4fdab13 None None] MFA Rules not processed for user `dd9eef8921de43f18245f47559f3fa71`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:16.767301 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-93eecf28-f509-47a2-9a64-0ad5c4fdab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:16.925180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 675/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:16:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:18.166997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dcb46-ef0d-47cc-9e58-239fb771f716 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:18.167520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dcb46-ef0d-47cc-9e58-239fb771f716 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:18.167520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dcb46-ef0d-47cc-9e58-239fb771f716 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:18.169109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 679/1354] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:18.174408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78507f85-3005-4c1e-8e75-c4db331f7294 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:18.174814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78507f85-3005-4c1e-8e75-c4db331f7294 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:18.175117 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78507f85-3005-4c1e-8e75-c4db331f7294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:18.255081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-78507f85-3005-4c1e-8e75-c4db331f7294 None None] MFA Rules not processed for user `dd9eef8921de43f18245f47559f3fa71`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:18.256319 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-78507f85-3005-4c1e-8e75-c4db331f7294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:18.298419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:18.367302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 676/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:16:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:21.536577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7b128-7bea-42d8-9c40-27a71d4e5de0 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:21.537100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7b128-7bea-42d8-9c40-27a71d4e5de0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:21.537211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7b128-7bea-42d8-9c40-27a71d4e5de0 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:21.538537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 680/1356] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:21.543843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e32a-0c68-4185-a88a-c6001c8b6d79 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:21.544303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e32a-0c68-4185-a88a-c6001c8b6d79 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:21.544402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e32a-0c68-4185-a88a-c6001c8b6d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:21.616700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2569e32a-0c68-4185-a88a-c6001c8b6d79 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:21.620190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2569e32a-0c68-4185-a88a-c6001c8b6d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:21.733284 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 677/1357] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:22.035171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113115-11e9-4b36-a08e-f5b1ccc0c71c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:22.035703 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113115-11e9-4b36-a08e-f5b1ccc0c71c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:22.036177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113115-11e9-4b36-a08e-f5b1ccc0c71c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:22.038112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 681/1358] 10.222.0.45 () {54 vars in 962 bytes} [Fri Aug 26 18:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:22.045212 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228734aa-21e3-4c14-a2ca-a81077337b51 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:22.045493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228734aa-21e3-4c14-a2ca-a81077337b51 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:22.045772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228734aa-21e3-4c14-a2ca-a81077337b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:22.064264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:22.129889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-228734aa-21e3-4c14-a2ca-a81077337b51 None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:22.131516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-228734aa-21e3-4c14-a2ca-a81077337b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:22.252961 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 678/1359] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Aug 26 18:16:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:22.261385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3113115-11e9-4b36-a08e-f5b1ccc0c71c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:22.263190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e3113115-11e9-4b36-a08e-f5b1ccc0c71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:22.420920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3113115-11e9-4b36-a08e-f5b1ccc0c71c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:22.509197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:22.559305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234af7f8-6135-4685-a06a-3b489c704d97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:22.560021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234af7f8-6135-4685-a06a-3b489c704d97 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:22.560269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234af7f8-6135-4685-a06a-3b489c704d97 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:22.560514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234af7f8-6135-4685-a06a-3b489c704d97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:22.562404 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-234af7f8-6135-4685-a06a-3b489c704d97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:22.665751 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234af7f8-6135-4685-a06a-3b489c704d97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:22.667728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234af7f8-6135-4685-a06a-3b489c704d97 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:22.688334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 682/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:24.787787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215d83f-5670-4677-8178-6800b5d379db None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:24.787787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215d83f-5670-4677-8178-6800b5d379db None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:24.788604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215d83f-5670-4677-8178-6800b5d379db None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:24.793712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 679/1361] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:24.796184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90b809-f9d3-4ce8-a5ff-a35af5b1e956 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:24.797026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90b809-f9d3-4ce8-a5ff-a35af5b1e956 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:24.797916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90b809-f9d3-4ce8-a5ff-a35af5b1e956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:24.875617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fc90b809-f9d3-4ce8-a5ff-a35af5b1e956 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:24.877230 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fc90b809-f9d3-4ce8-a5ff-a35af5b1e956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:24.920059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:24.981599 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 683/1362] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:25.268874 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215d83f-5670-4677-8178-6800b5d379db None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:25.280306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3215d83f-5670-4677-8178-6800b5d379db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:25.370205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:25.459446 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215d83f-5670-4677-8178-6800b5d379db None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:25.586801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e94c8-60e3-4bbe-8e96-f77f114eca82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:25.587332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e94c8-60e3-4bbe-8e96-f77f114eca82 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:25.587609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e94c8-60e3-4bbe-8e96-f77f114eca82 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:25.587880 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e94c8-60e3-4bbe-8e96-f77f114eca82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:25.589503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b97e94c8-60e3-4bbe-8e96-f77f114eca82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:25.613831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:25.691398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e94c8-60e3-4bbe-8e96-f77f114eca82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:25.693087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e94c8-60e3-4bbe-8e96-f77f114eca82 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:25.712561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 680/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:27.926910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ca71e-cffb-449f-a1b9-f08973f46696 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:27.927481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ca71e-cffb-449f-a1b9-f08973f46696 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:27.927481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ca71e-cffb-449f-a1b9-f08973f46696 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:27.930055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 684/1364] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:27.935740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7afe1-afbe-42db-8dc6-f00c5d266183 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:27.936208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7afe1-afbe-42db-8dc6-f00c5d266183 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:27.936208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7afe1-afbe-42db-8dc6-f00c5d266183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:28.005102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-88a7afe1-afbe-42db-8dc6-f00c5d266183 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:28.006385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-88a7afe1-afbe-42db-8dc6-f00c5d266183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:28.105083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:28.117153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 681/1365] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:16:28.390455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9846b-7cf0-4c74-9efa-862f93bdaf70 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:28.390771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9846b-7cf0-4c74-9efa-862f93bdaf70 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:28.391226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9846b-7cf0-4c74-9efa-862f93bdaf70 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:28.393227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 685/1366] 10.222.0.45 () {54 vars in 962 bytes} [Fri Aug 26 18:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:28.399563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712ddb-7015-459b-b0c4-b5852d3cec96 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:28.399850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712ddb-7015-459b-b0c4-b5852d3cec96 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:28.400112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712ddb-7015-459b-b0c4-b5852d3cec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:28.480059 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ee712ddb-7015-459b-b0c4-b5852d3cec96 None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:28.481293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ee712ddb-7015-459b-b0c4-b5852d3cec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:28.631883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 682/1367] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Aug 26 18:16:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:28.640022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9846b-7cf0-4c74-9efa-862f93bdaf70 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:28.641650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2ff9846b-7cf0-4c74-9efa-862f93bdaf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:28.802218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9846b-7cf0-4c74-9efa-862f93bdaf70 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:28.826790 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:28.927495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8736c16-78bf-4b3e-8132-f825158d2eff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:28.928271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8736c16-78bf-4b3e-8132-f825158d2eff service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:28.928452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8736c16-78bf-4b3e-8132-f825158d2eff service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:28.928724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8736c16-78bf-4b3e-8132-f825158d2eff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:28.930341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b8736c16-78bf-4b3e-8132-f825158d2eff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:29.021433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8736c16-78bf-4b3e-8132-f825158d2eff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:29.023180 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8736c16-78bf-4b3e-8132-f825158d2eff service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:29.041516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 686/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:29.647405 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267eb86-e478-4dd6-afe7-94e5f382f0b8 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:29.647972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267eb86-e478-4dd6-afe7-94e5f382f0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:29.647972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267eb86-e478-4dd6-afe7-94e5f382f0b8 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:29.649572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 683/1369] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:29.654700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5ca3f-c92f-4bf5-83f4-e919ee9506b8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:29.654989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5ca3f-c92f-4bf5-83f4-e919ee9506b8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:29.655282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5ca3f-c92f-4bf5-83f4-e919ee9506b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:29.688207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:29.725180 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-39e5ca3f-c92f-4bf5-83f4-e919ee9506b8 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:29.726406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-39e5ca3f-c92f-4bf5-83f4-e919ee9506b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:29.827861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 687/1370] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:30.405824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0d574-84a2-4fdc-8b65-b769cf4089bc None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:30.405824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0d574-84a2-4fdc-8b65-b769cf4089bc None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:30.405824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0d574-84a2-4fdc-8b65-b769cf4089bc None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:30.406940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 684/1371] 10.222.0.45 () {54 vars in 964 bytes} [Fri Aug 26 18:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:30.411781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210f4e-ccb5-4c40-8e06-ed03f23b4f00 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:30.412418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210f4e-ccb5-4c40-8e06-ed03f23b4f00 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:30.412418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210f4e-ccb5-4c40-8e06-ed03f23b4f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:30.491653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-22210f4e-ccb5-4c40-8e06-ed03f23b4f00 None None] MFA Rules not processed for user `fcfeeb3365ba420c9ff03e5aadee7f66`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:30.493179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-22210f4e-ccb5-4c40-8e06-ed03f23b4f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:30.555763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:30.589129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 688/1372] 10.222.0.45 () {58 vars in 1061 bytes} [Fri Aug 26 18:16:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:30.596640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0d574-84a2-4fdc-8b65-b769cf4089bc None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:30.598186 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ddb0d574-84a2-4fdc-8b65-b769cf4089bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:30.650893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:30.705610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0d574-84a2-4fdc-8b65-b769cf4089bc None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:30.782388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d78501-703c-4ae8-9697-14e6fcee9a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:30.783106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78501-703c-4ae8-9697-14e6fcee9a59 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:30.783496 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78501-703c-4ae8-9697-14e6fcee9a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:30.783861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78501-703c-4ae8-9697-14e6fcee9a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:30.785569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-28d78501-703c-4ae8-9697-14e6fcee9a59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:30.897191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:30.911072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d78501-703c-4ae8-9697-14e6fcee9a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:30.912622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d78501-703c-4ae8-9697-14e6fcee9a59 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:30.932347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 685/1373] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:31.004265 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f4e9d-c630-4c30-81a0-5d2ae1da5b73 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:31.004697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f4e9d-c630-4c30-81a0-5d2ae1da5b73 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:31.005198 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f4e9d-c630-4c30-81a0-5d2ae1da5b73 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:31.007775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 689/1374] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:31.012600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219660f-61d9-443a-8d0d-8e5c39936b1d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:31.012935 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219660f-61d9-443a-8d0d-8e5c39936b1d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:31.013217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219660f-61d9-443a-8d0d-8e5c39936b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:31.085421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c219660f-61d9-443a-8d0d-8e5c39936b1d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:31.086591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c219660f-61d9-443a-8d0d-8e5c39936b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:31.322517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 686/1375] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:31.606107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f4e9d-c630-4c30-81a0-5d2ae1da5b73 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:31.607662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9e8f4e9d-c630-4c30-81a0-5d2ae1da5b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:31.754352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f4e9d-c630-4c30-81a0-5d2ae1da5b73 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:31.807450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:31.870740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d75e4-aef8-41cb-bbea-c31a0d8ffd46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:31.871330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d75e4-aef8-41cb-bbea-c31a0d8ffd46 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:31.871605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d75e4-aef8-41cb-bbea-c31a0d8ffd46 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:31.871875 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d75e4-aef8-41cb-bbea-c31a0d8ffd46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:31.873520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-777d75e4-aef8-41cb-bbea-c31a0d8ffd46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:31.964150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d75e4-aef8-41cb-bbea-c31a0d8ffd46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:31.965798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d75e4-aef8-41cb-bbea-c31a0d8ffd46 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:31.984214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 690/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:33.914405 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311acc-745a-46e1-88bf-b68002e8949a None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:33.914948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311acc-745a-46e1-88bf-b68002e8949a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:33.914948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311acc-745a-46e1-88bf-b68002e8949a None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:33.916320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 687/1377] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:33.922262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec2c13-ad1d-4f79-a417-a16fa4cbfd0c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:33.922720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec2c13-ad1d-4f79-a417-a16fa4cbfd0c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:33.922819 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec2c13-ad1d-4f79-a417-a16fa4cbfd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:33.987226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6bec2c13-ad1d-4f79-a417-a16fa4cbfd0c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:33.988426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6bec2c13-ad1d-4f79-a417-a16fa4cbfd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:33.995584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:34.088296 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 691/1378] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:34.390347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30311acc-745a-46e1-88bf-b68002e8949a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:34.391569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-30311acc-745a-46e1-88bf-b68002e8949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:34.474713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:34.574084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30311acc-745a-46e1-88bf-b68002e8949a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:34.692344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8180e6-3932-4e73-8a1e-88e163f30635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:34.693156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8180e6-3932-4e73-8a1e-88e163f30635 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:34.693593 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8180e6-3932-4e73-8a1e-88e163f30635 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:34.693956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8180e6-3932-4e73-8a1e-88e163f30635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:34.695650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cc8180e6-3932-4e73-8a1e-88e163f30635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:34.714923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:34.788934 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8180e6-3932-4e73-8a1e-88e163f30635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:34.790616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8180e6-3932-4e73-8a1e-88e163f30635 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:34.809251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 688/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:36.722776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776e37f-9f6c-4b2a-b536-d8779edec090 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:36.723364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776e37f-9f6c-4b2a-b536-d8779edec090 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:36.723364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776e37f-9f6c-4b2a-b536-d8779edec090 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:36.724882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 692/1380] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:36.730236 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e259b2b-11d9-4f7f-b3b9-95bd03c5d754 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:36.730681 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e259b2b-11d9-4f7f-b3b9-95bd03c5d754 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:36.731006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e259b2b-11d9-4f7f-b3b9-95bd03c5d754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:36.801913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-7e259b2b-11d9-4f7f-b3b9-95bd03c5d754 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:36.803219 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7e259b2b-11d9-4f7f-b3b9-95bd03c5d754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:36.901540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:36.908755 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 689/1381] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:37.199728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776e37f-9f6c-4b2a-b536-d8779edec090 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:37.201271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5776e37f-9f6c-4b2a-b536-d8779edec090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:37.344878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:37.356440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776e37f-9f6c-4b2a-b536-d8779edec090 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:37.474915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58448afb-6a78-464f-8ae3-98edd2292d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:37.475475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448afb-6a78-464f-8ae3-98edd2292d2b service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:37.475746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448afb-6a78-464f-8ae3-98edd2292d2b service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:37.476013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448afb-6a78-464f-8ae3-98edd2292d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:37.477626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-58448afb-6a78-464f-8ae3-98edd2292d2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:37.576763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58448afb-6a78-464f-8ae3-98edd2292d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:37.578520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58448afb-6a78-464f-8ae3-98edd2292d2b service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:37.590191 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:37.599701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 693/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:39.510929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf4b33-5290-45b5-a60c-77907a68ce87 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:39.511598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf4b33-5290-45b5-a60c-77907a68ce87 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:39.511598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf4b33-5290-45b5-a60c-77907a68ce87 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:39.512963 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 690/1383] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:39.518511 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c78a3-5091-4ce4-9805-54f9b6b590d8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:39.519087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c78a3-5091-4ce4-9805-54f9b6b590d8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:39.519087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c78a3-5091-4ce4-9805-54f9b6b590d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:39.590048 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-100c78a3-5091-4ce4-9805-54f9b6b590d8 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:39.591326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-100c78a3-5091-4ce4-9805-54f9b6b590d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:39.688255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 694/1384] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:39.969002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf4b33-5290-45b5-a60c-77907a68ce87 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:39.971000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bbcf4b33-5290-45b5-a60c-77907a68ce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:40.136898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf4b33-5290-45b5-a60c-77907a68ce87 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:40.210002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:40.256760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea5b3c-a0fc-415f-bc96-e92db3cac329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:40.257377 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea5b3c-a0fc-415f-bc96-e92db3cac329 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:40.257652 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea5b3c-a0fc-415f-bc96-e92db3cac329 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:40.257926 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea5b3c-a0fc-415f-bc96-e92db3cac329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:40.259516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-58ea5b3c-a0fc-415f-bc96-e92db3cac329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:40.353530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea5b3c-a0fc-415f-bc96-e92db3cac329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:40.355144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea5b3c-a0fc-415f-bc96-e92db3cac329 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:40.373947 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 691/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:42.262204 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45befbda-2f85-4b37-81ba-2a27c8b9dd4c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:42.262858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45befbda-2f85-4b37-81ba-2a27c8b9dd4c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:42.262858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45befbda-2f85-4b37-81ba-2a27c8b9dd4c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:42.264112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 695/1386] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:42.272980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b98e-cace-47a7-92c2-c50062772d48 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:42.273460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b98e-cace-47a7-92c2-c50062772d48 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:42.273564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b98e-cace-47a7-92c2-c50062772d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:42.340488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d674b98e-cace-47a7-92c2-c50062772d48 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:42.341755 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d674b98e-cace-47a7-92c2-c50062772d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:42.382870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:42.449685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 692/1387] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:16:42.736246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45befbda-2f85-4b37-81ba-2a27c8b9dd4c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:42.738332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-45befbda-2f85-4b37-81ba-2a27c8b9dd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:42.828777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:42.904954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45befbda-2f85-4b37-81ba-2a27c8b9dd4c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:43.019420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b96693-3f78-40bd-9871-6fd454c61798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:43.020054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b96693-3f78-40bd-9871-6fd454c61798 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:43.020327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b96693-3f78-40bd-9871-6fd454c61798 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:43.020590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b96693-3f78-40bd-9871-6fd454c61798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:43.022572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c4b96693-3f78-40bd-9871-6fd454c61798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:43.063106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:43.130916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b96693-3f78-40bd-9871-6fd454c61798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:43.133185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b96693-3f78-40bd-9871-6fd454c61798 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:43.156348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 696/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:45.097316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984aefd-fabd-4307-800a-cc18044ca9b8 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:45.097888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984aefd-fabd-4307-800a-cc18044ca9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:45.097888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984aefd-fabd-4307-800a-cc18044ca9b8 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:45.099175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 693/1389] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:45.105212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b1753-2b44-42e7-8556-4401afd21358 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:45.105675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b1753-2b44-42e7-8556-4401afd21358 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:45.105781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b1753-2b44-42e7-8556-4401afd21358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:45.176427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4e7b1753-2b44-42e7-8556-4401afd21358 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:45.177693 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4e7b1753-2b44-42e7-8556-4401afd21358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:45.281199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 697/1390] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:45.573786 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984aefd-fabd-4307-800a-cc18044ca9b8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:45.575315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d984aefd-fabd-4307-800a-cc18044ca9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:45.727709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984aefd-fabd-4307-800a-cc18044ca9b8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:45.744711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:45.843185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e60ea-0b2a-4345-a53f-f69e2717a23e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:45.843783 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e60ea-0b2a-4345-a53f-f69e2717a23e service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:45.844085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e60ea-0b2a-4345-a53f-f69e2717a23e service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:45.844336 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e60ea-0b2a-4345-a53f-f69e2717a23e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:45.846045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a59e60ea-0b2a-4345-a53f-f69e2717a23e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:45.943370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e60ea-0b2a-4345-a53f-f69e2717a23e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:45.945134 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e60ea-0b2a-4345-a53f-f69e2717a23e service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:45.963457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 694/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:46.446153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa24a5-9643-4f59-9204-1f96880c24c8 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:46.446719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa24a5-9643-4f59-9204-1f96880c24c8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:46.446719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa24a5-9643-4f59-9204-1f96880c24c8 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:46.448306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 698/1392] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:46.453904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b635da-6a24-4a41-b930-d64e9c016544 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:46.454442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b635da-6a24-4a41-b930-d64e9c016544 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:46.454442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b635da-6a24-4a41-b930-d64e9c016544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:46.480681 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:46.526340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-51b635da-6a24-4a41-b930-d64e9c016544 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:46.527555 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-51b635da-6a24-4a41-b930-d64e9c016544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:46.626987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 695/1393] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:46.921393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b2121-a2be-4c0a-b9b9-cc7ef6c6155d None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:46.921759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b2121-a2be-4c0a-b9b9-cc7ef6c6155d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:46.922099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b2121-a2be-4c0a-b9b9-cc7ef6c6155d None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:46.923496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 699/1394] 10.222.0.45 () {54 vars in 967 bytes} [Fri Aug 26 18:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:46.929047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef3fb-eeb3-4055-9f8b-7e78b48dc70a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:46.929340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef3fb-eeb3-4055-9f8b-7e78b48dc70a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:46.929616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef3fb-eeb3-4055-9f8b-7e78b48dc70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:47.008118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a85ef3fb-eeb3-4055-9f8b-7e78b48dc70a None None] MFA Rules not processed for user `74ee7b50c34742ce896a734f3ef34a53`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:47.009392 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a85ef3fb-eeb3-4055-9f8b-7e78b48dc70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:47.051580 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:47.093238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 696/1395] 10.222.0.45 () {58 vars in 1064 bytes} [Fri Aug 26 18:16:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:47.101000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b2121-a2be-4c0a-b9b9-cc7ef6c6155d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:47.102536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9a8b2121-a2be-4c0a-b9b9-cc7ef6c6155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:47.116954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:47.208709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b2121-a2be-4c0a-b9b9-cc7ef6c6155d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:47.289453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be859ef-55db-483f-a067-2e9cbe974f9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ee7b50c34742ce896a734f3ef34a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:47.290074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be859ef-55db-483f-a067-2e9cbe974f9c service glance] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:47.290430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be859ef-55db-483f-a067-2e9cbe974f9c service glance] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:47.290709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be859ef-55db-483f-a067-2e9cbe974f9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:47.292301 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3be859ef-55db-483f-a067-2e9cbe974f9c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:47.363556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:47.407519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be859ef-55db-483f-a067-2e9cbe974f9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:47.409077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be859ef-55db-483f-a067-2e9cbe974f9c service glance] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:47.427361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 700/1396] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:47.885365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999d775-94d2-4f53-b634-42cbf485e8e3 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:47.885943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999d775-94d2-4f53-b634-42cbf485e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:47.885943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999d775-94d2-4f53-b634-42cbf485e8e3 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:47.887748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 697/1397] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:47.893506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb0869-a2f1-4222-925f-da544cc4ad84 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:47.893980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb0869-a2f1-4222-925f-da544cc4ad84 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:47.894092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb0869-a2f1-4222-925f-da544cc4ad84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:47.965341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-60fb0869-a2f1-4222-925f-da544cc4ad84 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:47.966583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-60fb0869-a2f1-4222-925f-da544cc4ad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:48.076584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 701/1398] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:48.172466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd939d-bf77-4d96-b1eb-254116678551 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:48.172803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd939d-bf77-4d96-b1eb-254116678551 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:48.173085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd939d-bf77-4d96-b1eb-254116678551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:48.238794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-26bd939d-bf77-4d96-b1eb-254116678551 None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:48.240006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-26bd939d-bf77-4d96-b1eb-254116678551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:48.328305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 698/1399] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:16:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:48.362541 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb0869-a2f1-4222-925f-da544cc4ad84 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:48.363700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-60fb0869-a2f1-4222-925f-da544cc4ad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:48.375245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0842648-3548-460f-8aca-f54d13290cef None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:48.375508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0842648-3548-460f-8aca-f54d13290cef None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:48.375809 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0842648-3548-460f-8aca-f54d13290cef None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:48.377239 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 699/1400] 10.222.0.45 () {54 vars in 943 bytes} [Fri Aug 26 18:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:16:48.383814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622b638-b843-4dfb-b204-40ed4cec99f7 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:48.384107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622b638-b843-4dfb-b204-40ed4cec99f7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:48.384378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622b638-b843-4dfb-b204-40ed4cec99f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:48.392418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:48.453911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:48.463187 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d622b638-b843-4dfb-b204-40ed4cec99f7 None None] MFA Rules not processed for user `98c92b2c982a4780884365a7a7ec6514`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:48.464398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d622b638-b843-4dfb-b204-40ed4cec99f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:48.481376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb0869-a2f1-4222-925f-da544cc4ad84 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:48.584389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 700/1401] 10.222.0.45 () {58 vars in 1040 bytes} [Fri Aug 26 18:16:48 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:48.594271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622b638-b843-4dfb-b204-40ed4cec99f7 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:48.603129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ccf37-0e19-4a95-9aa9-38c3a9465953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:48.603749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ccf37-0e19-4a95-9aa9-38c3a9465953 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:48.604020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ccf37-0e19-4a95-9aa9-38c3a9465953 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:48.604285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ccf37-0e19-4a95-9aa9-38c3a9465953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:48.604465 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622b638-b843-4dfb-b204-40ed4cec99f7 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:48.605913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-581ccf37-0e19-4a95-9aa9-38c3a9465953 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:48.624454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:48.697070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ccf37-0e19-4a95-9aa9-38c3a9465953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:48.698706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ccf37-0e19-4a95-9aa9-38c3a9465953 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:48.711823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ce8a5-b24a-40d5-90c5-2a35cbd5a557 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:48.712675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ce8a5-b24a-40d5-90c5-2a35cbd5a557 service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:48.712855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ce8a5-b24a-40d5-90c5-2a35cbd5a557 service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:48.712993 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ce8a5-b24a-40d5-90c5-2a35cbd5a557 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:48.714615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d81ce8a5-b24a-40d5-90c5-2a35cbd5a557 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:48.717102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 702/1402] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:48.717389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:48.803356 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ce8a5-b24a-40d5-90c5-2a35cbd5a557 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:48.805066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ce8a5-b24a-40d5-90c5-2a35cbd5a557 service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:48.814464 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 701/1403] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:16:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 18:16:50.652211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7a782-d636-4ee5-b7d7-baa797f0fabe None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:50.652802 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7a782-d636-4ee5-b7d7-baa797f0fabe None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:50.652802 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7a782-d636-4ee5-b7d7-baa797f0fabe None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:50.654303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 703/1404] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:50.659451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fd0ba-043f-459d-b060-ab311ba2763b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:50.659846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fd0ba-043f-459d-b060-ab311ba2763b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:50.659991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fd0ba-043f-459d-b060-ab311ba2763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:50.736782 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-763fd0ba-043f-459d-b060-ab311ba2763b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:50.738282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-763fd0ba-043f-459d-b060-ab311ba2763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:50.842262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:50.850199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 702/1405] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:51.145346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7a782-d636-4ee5-b7d7-baa797f0fabe None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:51.146944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-05d7a782-d636-4ee5-b7d7-baa797f0fabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:51.307844 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:51.310227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7a782-d636-4ee5-b7d7-baa797f0fabe None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:51.435843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11bbb2-f5d8-4053-8ebf-050b69e036a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:51.436791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bbb2-f5d8-4053-8ebf-050b69e036a9 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:51.437245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bbb2-f5d8-4053-8ebf-050b69e036a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:51.437662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bbb2-f5d8-4053-8ebf-050b69e036a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:51.439432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9f11bbb2-f5d8-4053-8ebf-050b69e036a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:51.557005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11bbb2-f5d8-4053-8ebf-050b69e036a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:51.558657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11bbb2-f5d8-4053-8ebf-050b69e036a9 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:51.583891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 704/1406] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:16:53.525867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d549f00-3509-42b8-8b64-e8e5a8be54cd None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:53.526322 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d549f00-3509-42b8-8b64-e8e5a8be54cd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:53.526411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d549f00-3509-42b8-8b64-e8e5a8be54cd None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:53.527940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 703/1407] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:16:53.533297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013112b-0ff1-440b-91f5-37f68fb3b510 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:53.533777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013112b-0ff1-440b-91f5-37f68fb3b510 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:53.533888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013112b-0ff1-440b-91f5-37f68fb3b510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:53.538426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:53.604663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5013112b-0ff1-440b-91f5-37f68fb3b510 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:16:53.605998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5013112b-0ff1-440b-91f5-37f68fb3b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:53.712763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 705/1408] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:16:54.005149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d549f00-3509-42b8-8b64-e8e5a8be54cd None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:16:54.006509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9d549f00-3509-42b8-8b64-e8e5a8be54cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:54.172116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d549f00-3509-42b8-8b64-e8e5a8be54cd None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:16:54.246630 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:54.297655 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b857ce-f344-4b86-a319-67906f6501dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:16:54.298481 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b857ce-f344-4b86-a319-67906f6501dc service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:16:54.298822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b857ce-f344-4b86-a319-67906f6501dc service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:16:54.299560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b857ce-f344-4b86-a319-67906f6501dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:16:54.300915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-15b857ce-f344-4b86-a319-67906f6501dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:16:54.402571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b857ce-f344-4b86-a319-67906f6501dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:16:54.404173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b857ce-f344-4b86-a319-67906f6501dc service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:16:54.431439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 704/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:03.709949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=64 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:04.428873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=64 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:10.668968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa2bd6-5d74-47df-a645-572b8d2e390f None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:10.669553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa2bd6-5d74-47df-a645-572b8d2e390f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:10.669553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa2bd6-5d74-47df-a645-572b8d2e390f None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:10.670811 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 706/1410] 10.222.0.45 () {54 vars in 918 bytes} [Fri Aug 26 18:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:10.677048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a733f6-4a5f-4bbd-b872-a9cc303cd5e0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:10.677508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a733f6-4a5f-4bbd-b872-a9cc303cd5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:10.677606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a733f6-4a5f-4bbd-b872-a9cc303cd5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:10.762121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-68a733f6-4a5f-4bbd-b872-a9cc303cd5e0 None None] MFA Rules not processed for user `dd9eef8921de43f18245f47559f3fa71`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:10.763330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-68a733f6-4a5f-4bbd-b872-a9cc303cd5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:10.870581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 705/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Aug 26 18:17:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:10.888808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d005-aa78-46b4-aef3-4d61cd3e3a18 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:10.889093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d005-aa78-46b4-aef3-4d61cd3e3a18 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:10.889366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d005-aa78-46b4-aef3-4d61cd3e3a18 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:10.890731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 707/1412] 10.222.0.45 () {54 vars in 918 bytes} [Fri Aug 26 18:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:10.895518 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962b91c-ad88-486d-9507-3392bb3e273b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:10.895806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962b91c-ad88-486d-9507-3392bb3e273b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:10.896082 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962b91c-ad88-486d-9507-3392bb3e273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:10.969885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:10.973396 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9962b91c-ad88-486d-9507-3392bb3e273b None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:10.975333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9962b91c-ad88-486d-9507-3392bb3e273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:11.094041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 706/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Aug 26 18:17:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:13.464184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d268f00-c4f9-4671-b6a2-4fc9176998b4 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:13.465016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d268f00-c4f9-4671-b6a2-4fc9176998b4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:13.465170 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d268f00-c4f9-4671-b6a2-4fc9176998b4 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:13.467261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:17:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:13.475238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194311b4-8b04-468a-bde4-a17e7070bf5f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:13.475694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194311b4-8b04-468a-bde4-a17e7070bf5f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:13.475796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194311b4-8b04-468a-bde4-a17e7070bf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:13.547505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-194311b4-8b04-468a-bde4-a17e7070bf5f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:13.548756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-194311b4-8b04-468a-bde4-a17e7070bf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:13.609707 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:13.651130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:17:13.938414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d268f00-c4f9-4671-b6a2-4fc9176998b4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:13.940055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2d268f00-c4f9-4671-b6a2-4fc9176998b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:14.100357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d268f00-c4f9-4671-b6a2-4fc9176998b4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:14.185183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:14.228387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fefc54-008d-479c-86dc-22050fd77700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:14.229024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fefc54-008d-479c-86dc-22050fd77700 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:14.229304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fefc54-008d-479c-86dc-22050fd77700 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:14.229570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fefc54-008d-479c-86dc-22050fd77700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:14.231170 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-23fefc54-008d-479c-86dc-22050fd77700 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:14.323508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fefc54-008d-479c-86dc-22050fd77700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:14.325158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fefc54-008d-479c-86dc-22050fd77700 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:14.343203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 709/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:15.224166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4819be-7fcf-4cd2-a896-ee43b99ab88d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:15.225138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4819be-7fcf-4cd2-a896-ee43b99ab88d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:15.225138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4819be-7fcf-4cd2-a896-ee43b99ab88d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:15.226929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 18:17:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:15.232261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982e0a4-8639-4059-951c-4b50de284a05 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:15.232707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982e0a4-8639-4059-951c-4b50de284a05 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:15.232852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982e0a4-8639-4059-951c-4b50de284a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:15.309636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f982e0a4-8639-4059-951c-4b50de284a05 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:15.310921 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f982e0a4-8639-4059-951c-4b50de284a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:15.340238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:15.416223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 18:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:15.571431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4819be-7fcf-4cd2-a896-ee43b99ab88d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:15.572968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0d4819be-7fcf-4cd2-a896-ee43b99ab88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:15.727144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4819be-7fcf-4cd2-a896-ee43b99ab88d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:15.774667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:15.858108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e4eaf-21b6-4a96-825f-b20e7b57eb3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:15.858711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e4eaf-21b6-4a96-825f-b20e7b57eb3d service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:15.858983 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e4eaf-21b6-4a96-825f-b20e7b57eb3d service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:15.859253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e4eaf-21b6-4a96-825f-b20e7b57eb3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:15.860862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-be1e4eaf-21b6-4a96-825f-b20e7b57eb3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:15.958730 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e4eaf-21b6-4a96-825f-b20e7b57eb3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:15.960352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e4eaf-21b6-4a96-825f-b20e7b57eb3d service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:15.979138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 709/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:16.869496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eeba3-d5b2-43fd-8c2e-9ac76ce4dc1d None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:16.870343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eeba3-d5b2-43fd-8c2e-9ac76ce4dc1d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:16.870343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eeba3-d5b2-43fd-8c2e-9ac76ce4dc1d None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:16.872467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 18:17:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:16.881200 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbd5ee-5eaf-43fa-96cd-c14c92f0e200 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:16.881665 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbd5ee-5eaf-43fa-96cd-c14c92f0e200 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:16.881975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbd5ee-5eaf-43fa-96cd-c14c92f0e200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:16.939490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:16.962928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-eabbd5ee-5eaf-43fa-96cd-c14c92f0e200 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:16.964136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-eabbd5ee-5eaf-43fa-96cd-c14c92f0e200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:17.062363 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 18:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:17.223433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eeba3-d5b2-43fd-8c2e-9ac76ce4dc1d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:17.225190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d27eeba3-d5b2-43fd-8c2e-9ac76ce4dc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:17.375949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eeba3-d5b2-43fd-8c2e-9ac76ce4dc1d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:17.388194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:17.490577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185d451-f884-4859-9946-8cb2e268eaf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:17.491171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d451-f884-4859-9946-8cb2e268eaf0 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:17.491382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d451-f884-4859-9946-8cb2e268eaf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:17.491704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d451-f884-4859-9946-8cb2e268eaf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:17.493641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3185d451-f884-4859-9946-8cb2e268eaf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:17.586184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185d451-f884-4859-9946-8cb2e268eaf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:17.587810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185d451-f884-4859-9946-8cb2e268eaf0 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:17.606674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 712/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:18.474721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b8d64-f479-4170-8433-720598cc2b03 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:18.475352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b8d64-f479-4170-8433-720598cc2b03 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:18.475352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b8d64-f479-4170-8433-720598cc2b03 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:18.476678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 18:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:18.482788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3a866-6da9-4104-be0a-89d0dca799dd None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:18.483252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3a866-6da9-4104-be0a-89d0dca799dd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:18.483361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3a866-6da9-4104-be0a-89d0dca799dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:18.507637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:18.566275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b5f3a866-6da9-4104-be0a-89d0dca799dd None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:18.567502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b5f3a866-6da9-4104-be0a-89d0dca799dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:18.682107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 18:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:18.834307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b8d64-f479-4170-8433-720598cc2b03 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:18.836609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a61b8d64-f479-4170-8433-720598cc2b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:18.962762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:19.001762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b8d64-f479-4170-8433-720598cc2b03 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:19.133609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd503a-3002-4fd3-b4bf-0ea0cd1ab28e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:19.134124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd503a-3002-4fd3-b4bf-0ea0cd1ab28e service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:19.134395 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd503a-3002-4fd3-b4bf-0ea0cd1ab28e service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:19.134658 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd503a-3002-4fd3-b4bf-0ea0cd1ab28e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:19.136234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0cdd503a-3002-4fd3-b4bf-0ea0cd1ab28e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:19.211636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:19.226396 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd503a-3002-4fd3-b4bf-0ea0cd1ab28e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:19.228006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd503a-3002-4fd3-b4bf-0ea0cd1ab28e service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:19.247608 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 712/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:20.102964 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531cbf0-d486-476e-9e5b-f5ba6f0c823a None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:20.103862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531cbf0-d486-476e-9e5b-f5ba6f0c823a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:20.103862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531cbf0-d486-476e-9e5b-f5ba6f0c823a None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:20.105990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 18:17:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:20.114272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c4202-7605-44fd-9304-75dcaea73898 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:20.114720 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c4202-7605-44fd-9304-75dcaea73898 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:20.114814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c4202-7605-44fd-9304-75dcaea73898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:20.190963 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cb7c4202-7605-44fd-9304-75dcaea73898 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:20.192153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cb7c4202-7605-44fd-9304-75dcaea73898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:20.291080 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 18:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:20.441209 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531cbf0-d486-476e-9e5b-f5ba6f0c823a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:20.442744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9531cbf0-d486-476e-9e5b-f5ba6f0c823a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:20.536642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:20.600358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531cbf0-d486-476e-9e5b-f5ba6f0c823a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:20.715239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119332d8-45bb-49b2-a6ec-5a659a22b6bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:20.715861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119332d8-45bb-49b2-a6ec-5a659a22b6bb service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:20.716148 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119332d8-45bb-49b2-a6ec-5a659a22b6bb service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:20.716416 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119332d8-45bb-49b2-a6ec-5a659a22b6bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:20.718072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-119332d8-45bb-49b2-a6ec-5a659a22b6bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:20.774520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:20.816732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119332d8-45bb-49b2-a6ec-5a659a22b6bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:20.818371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119332d8-45bb-49b2-a6ec-5a659a22b6bb service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:20.836476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 715/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:21.637219 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb44c19-c1c3-4c9e-9e2f-7de103f826a5 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:21.638060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb44c19-c1c3-4c9e-9e2f-7de103f826a5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:21.638060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb44c19-c1c3-4c9e-9e2f-7de103f826a5 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:21.640288 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 18:17:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:21.648025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618cc5c-8055-481b-8e20-fd65453e5176 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:21.648485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618cc5c-8055-481b-8e20-fd65453e5176 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:21.648959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618cc5c-8055-481b-8e20-fd65453e5176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:21.726197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d618cc5c-8055-481b-8e20-fd65453e5176 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:21.727415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d618cc5c-8055-481b-8e20-fd65453e5176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:21.828486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 18:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:17:21.980369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb44c19-c1c3-4c9e-9e2f-7de103f826a5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:21.982747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8eb44c19-c1c3-4c9e-9e2f-7de103f826a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:22.042354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:22.143460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb44c19-c1c3-4c9e-9e2f-7de103f826a5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:22.269589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a13266-b2cd-4ce9-a829-474cb6352544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:22.270207 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a13266-b2cd-4ce9-a829-474cb6352544 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:22.270481 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a13266-b2cd-4ce9-a829-474cb6352544 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:22.270751 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a13266-b2cd-4ce9-a829-474cb6352544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:22.272342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-35a13266-b2cd-4ce9-a829-474cb6352544 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:22.279423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:22.369726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a13266-b2cd-4ce9-a829-474cb6352544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:22.371347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a13266-b2cd-4ce9-a829-474cb6352544 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:22.390200 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 715/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:23.206248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e15178-29d8-419c-b0ac-f29c300e82f4 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:23.206840 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e15178-29d8-419c-b0ac-f29c300e82f4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:23.206840 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e15178-29d8-419c-b0ac-f29c300e82f4 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:23.208936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 18:17:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:23.214990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce182a5-6813-4980-a06f-91b58e58bb36 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:23.215441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce182a5-6813-4980-a06f-91b58e58bb36 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:23.215564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce182a5-6813-4980-a06f-91b58e58bb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:23.295167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fce182a5-6813-4980-a06f-91b58e58bb36 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:23.296388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fce182a5-6813-4980-a06f-91b58e58bb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:23.364902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:23.395725 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 18:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:17:23.546547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e15178-29d8-419c-b0ac-f29c300e82f4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:23.548165 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-41e15178-29d8-419c-b0ac-f29c300e82f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:23.569115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:23.702591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e15178-29d8-419c-b0ac-f29c300e82f4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:23.794604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:23.822884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e00a27-acd5-4bd1-b447-58746c7090b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:23.823531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e00a27-acd5-4bd1-b447-58746c7090b6 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:23.823838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e00a27-acd5-4bd1-b447-58746c7090b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:23.824100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e00a27-acd5-4bd1-b447-58746c7090b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:23.825754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-47e00a27-acd5-4bd1-b447-58746c7090b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:23.924479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e00a27-acd5-4bd1-b447-58746c7090b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:23.926159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e00a27-acd5-4bd1-b447-58746c7090b6 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:23.944297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 718/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:24.903037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b559746-146b-426f-a010-236f77c350ec None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:24.903557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b559746-146b-426f-a010-236f77c350ec None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:24.903557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b559746-146b-426f-a010-236f77c350ec None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:24.904966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 18:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:24.911851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fad95e-5aaa-4dc2-8ca9-0f5513758d2c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:24.912320 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fad95e-5aaa-4dc2-8ca9-0f5513758d2c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:24.912418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fad95e-5aaa-4dc2-8ca9-0f5513758d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:25.002489 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b5fad95e-5aaa-4dc2-8ca9-0f5513758d2c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:25.003719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b5fad95e-5aaa-4dc2-8ca9-0f5513758d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:25.052150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:25.114363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 18:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:25.269295 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b559746-146b-426f-a010-236f77c350ec None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:25.271735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6b559746-146b-426f-a010-236f77c350ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:25.434352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b559746-146b-426f-a010-236f77c350ec None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:25.493758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:25.557369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833faf06-f790-4394-b469-cdc814582342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:25.557999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833faf06-f790-4394-b469-cdc814582342 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:25.558250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833faf06-f790-4394-b469-cdc814582342 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:25.558522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833faf06-f790-4394-b469-cdc814582342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:25.560153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-833faf06-f790-4394-b469-cdc814582342 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:25.654768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833faf06-f790-4394-b469-cdc814582342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:25.656398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833faf06-f790-4394-b469-cdc814582342 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:25.674926 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 718/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:26.490293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fa9b8-03b8-4d00-a287-4f9ed708df9c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:26.490917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fa9b8-03b8-4d00-a287-4f9ed708df9c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:26.490917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fa9b8-03b8-4d00-a287-4f9ed708df9c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:26.492210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 18:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:26.498521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f861a2-e916-4326-943f-83aa762849bf None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:26.498994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f861a2-e916-4326-943f-83aa762849bf None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:26.499107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f861a2-e916-4326-943f-83aa762849bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:26.579572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e6f861a2-e916-4326-943f-83aa762849bf None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:26.580790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e6f861a2-e916-4326-943f-83aa762849bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:26.582876 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:26.685747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 18:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:26.838695 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fa9b8-03b8-4d00-a287-4f9ed708df9c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:26.840936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-339fa9b8-03b8-4d00-a287-4f9ed708df9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:26.992021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fa9b8-03b8-4d00-a287-4f9ed708df9c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:27.021123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:27.108613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ef4d-bdc7-49bc-9f61-51488e8b7599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:27.109188 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ef4d-bdc7-49bc-9f61-51488e8b7599 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:27.109473 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ef4d-bdc7-49bc-9f61-51488e8b7599 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:27.109761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ef4d-bdc7-49bc-9f61-51488e8b7599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:27.111363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-dc00ef4d-bdc7-49bc-9f61-51488e8b7599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:27.203786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ef4d-bdc7-49bc-9f61-51488e8b7599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:27.205489 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ef4d-bdc7-49bc-9f61-51488e8b7599 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:27.224126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 721/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:29.039020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961473c-89ca-4413-8b99-98442203f5bf None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:29.039854 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961473c-89ca-4413-8b99-98442203f5bf None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:29.039854 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961473c-89ca-4413-8b99-98442203f5bf None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:29.042067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:17:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:29.051023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f60d8-f212-4299-ba23-9c2dc0e05196 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:29.051464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f60d8-f212-4299-ba23-9c2dc0e05196 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:29.051591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f60d8-f212-4299-ba23-9c2dc0e05196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:29.094153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:29.120755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-452f60d8-f212-4299-ba23-9c2dc0e05196 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:29.121992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-452f60d8-f212-4299-ba23-9c2dc0e05196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:29.226005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:29.508656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961473c-89ca-4413-8b99-98442203f5bf None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:29.511028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2961473c-89ca-4413-8b99-98442203f5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:29.630807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961473c-89ca-4413-8b99-98442203f5bf None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:29.664766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:29.713346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925c409-97fe-4a95-b81f-8737f7718a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:29.713961 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925c409-97fe-4a95-b81f-8737f7718a5e service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:29.714237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925c409-97fe-4a95-b81f-8737f7718a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:29.714501 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925c409-97fe-4a95-b81f-8737f7718a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:29.716095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f925c409-97fe-4a95-b81f-8737f7718a5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:29.834724 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925c409-97fe-4a95-b81f-8737f7718a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:29.836418 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925c409-97fe-4a95-b81f-8737f7718a5e service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:29.855481 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 721/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:31.949026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd92a60-8cd3-42b5-83ba-aa816182cc44 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:31.949611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd92a60-8cd3-42b5-83ba-aa816182cc44 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:31.949611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd92a60-8cd3-42b5-83ba-aa816182cc44 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:31.950930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:31.956320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf68e7-de07-429e-91c5-e219aedd052d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:31.956801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf68e7-de07-429e-91c5-e219aedd052d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:31.956979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf68e7-de07-429e-91c5-e219aedd052d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:32.030124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b6bf68e7-de07-429e-91c5-e219aedd052d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:32.031329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b6bf68e7-de07-429e-91c5-e219aedd052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:32.044360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:32.130597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:32.413328 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd92a60-8cd3-42b5-83ba-aa816182cc44 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:32.415128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7dd92a60-8cd3-42b5-83ba-aa816182cc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:32.527458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd92a60-8cd3-42b5-83ba-aa816182cc44 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:32.540626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:32.604967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887605d0-9e88-4116-9392-cde2d010805e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:32.605669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887605d0-9e88-4116-9392-cde2d010805e service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:32.605931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887605d0-9e88-4116-9392-cde2d010805e service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:32.606248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887605d0-9e88-4116-9392-cde2d010805e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:32.607990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-887605d0-9e88-4116-9392-cde2d010805e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:32.727054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887605d0-9e88-4116-9392-cde2d010805e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:32.728525 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887605d0-9e88-4116-9392-cde2d010805e service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:32.748702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 724/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:34.952357 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a2fbe-3147-4b43-8d9a-15c0f2d14824 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:34.953317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a2fbe-3147-4b43-8d9a-15c0f2d14824 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:34.953317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a2fbe-3147-4b43-8d9a-15c0f2d14824 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:34.955463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:17:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:34.963272 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68d96e-590d-42b7-9d51-4f16f4fa2379 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:34.963699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68d96e-590d-42b7-9d51-4f16f4fa2379 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:34.963821 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68d96e-590d-42b7-9d51-4f16f4fa2379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:35.020348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:35.038943 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5a68d96e-590d-42b7-9d51-4f16f4fa2379 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:35.040168 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5a68d96e-590d-42b7-9d51-4f16f4fa2379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:35.149026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:17:35.441434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a2fbe-3147-4b43-8d9a-15c0f2d14824 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:35.443877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6a7a2fbe-3147-4b43-8d9a-15c0f2d14824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:35.554064 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a2fbe-3147-4b43-8d9a-15c0f2d14824 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:35.595725 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:35.631571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ae638-d91d-411d-800e-10ce0d7d438a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:35.632212 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ae638-d91d-411d-800e-10ce0d7d438a service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:35.632509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ae638-d91d-411d-800e-10ce0d7d438a service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:35.632853 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ae638-d91d-411d-800e-10ce0d7d438a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:35.634451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-410ae638-d91d-411d-800e-10ce0d7d438a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:35.748145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ae638-d91d-411d-800e-10ce0d7d438a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:35.749656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ae638-d91d-411d-800e-10ce0d7d438a service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:35.769118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 724/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:37.785098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b2df2-76cc-4cfc-b9e3-a0e45b51e01b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:37.785944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b2df2-76cc-4cfc-b9e3-a0e45b51e01b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:37.785944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b2df2-76cc-4cfc-b9e3-a0e45b51e01b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:37.788066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:17:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:37.793572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277a615-d131-4e64-a592-594838321eb5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:37.794014 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277a615-d131-4e64-a592-594838321eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:37.794133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277a615-d131-4e64-a592-594838321eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:37.863424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2277a615-d131-4e64-a592-594838321eb5 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:37.864643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2277a615-d131-4e64-a592-594838321eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:37.887154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:37.973477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:38.261324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b2df2-76cc-4cfc-b9e3-a0e45b51e01b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:38.263821 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-360b2df2-76cc-4cfc-b9e3-a0e45b51e01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:38.496756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b2df2-76cc-4cfc-b9e3-a0e45b51e01b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:38.517742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:38.574639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03e43f-346e-4388-b0cb-901acbbdc6a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:38.575251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03e43f-346e-4388-b0cb-901acbbdc6a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:38.575528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03e43f-346e-4388-b0cb-901acbbdc6a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:38.575798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03e43f-346e-4388-b0cb-901acbbdc6a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:38.577414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9d03e43f-346e-4388-b0cb-901acbbdc6a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:38.690558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03e43f-346e-4388-b0cb-901acbbdc6a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:38.692007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03e43f-346e-4388-b0cb-901acbbdc6a7 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:38.710081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 727/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:40.666618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8455b-22f4-44cf-aca6-03001c7e8b05 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:40.667501 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8455b-22f4-44cf-aca6-03001c7e8b05 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:40.667501 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8455b-22f4-44cf-aca6-03001c7e8b05 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:40.669697 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:17:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:40.675270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3a0ac-e226-46f5-9e0d-9c0813641974 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:40.675714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3a0ac-e226-46f5-9e0d-9c0813641974 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:40.675829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3a0ac-e226-46f5-9e0d-9c0813641974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:40.747930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:40.752181 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0ce3a0ac-e226-46f5-9e0d-9c0813641974 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:40.754865 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0ce3a0ac-e226-46f5-9e0d-9c0813641974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:40.864011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:17:41.148564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8455b-22f4-44cf-aca6-03001c7e8b05 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:41.150129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d7a8455b-22f4-44cf-aca6-03001c7e8b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:41.260341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8455b-22f4-44cf-aca6-03001c7e8b05 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:41.311978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:41.337921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736a523-d700-4a10-835e-ac7071041a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:41.338529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736a523-d700-4a10-835e-ac7071041a0e service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:41.338808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736a523-d700-4a10-835e-ac7071041a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:41.339108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736a523-d700-4a10-835e-ac7071041a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:41.340960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3736a523-d700-4a10-835e-ac7071041a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:41.457448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736a523-d700-4a10-835e-ac7071041a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:41.458878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736a523-d700-4a10-835e-ac7071041a0e service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:41.478780 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 727/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:43.444784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d9382-ef8a-4f9b-82aa-dfdc479d0970 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:43.445641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d9382-ef8a-4f9b-82aa-dfdc479d0970 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:43.445641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d9382-ef8a-4f9b-82aa-dfdc479d0970 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:43.447884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:17:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:43.454320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcba75b-b1ec-4b32-b8a1-669e9db0af07 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:43.455052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcba75b-b1ec-4b32-b8a1-669e9db0af07 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:43.455221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcba75b-b1ec-4b32-b8a1-669e9db0af07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:43.524498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9fcba75b-b1ec-4b32-b8a1-669e9db0af07 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:43.525757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9fcba75b-b1ec-4b32-b8a1-669e9db0af07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:43.555816 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:43.627360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:43.910579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d9382-ef8a-4f9b-82aa-dfdc479d0970 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:43.912119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f65d9382-ef8a-4f9b-82aa-dfdc479d0970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:44.028470 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d9382-ef8a-4f9b-82aa-dfdc479d0970 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:44.056092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:44.107276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f8b3d-bb35-4ea8-88e9-83bdc670a2c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:44.107893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f8b3d-bb35-4ea8-88e9-83bdc670a2c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:44.108215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f8b3d-bb35-4ea8-88e9-83bdc670a2c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:44.108484 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f8b3d-bb35-4ea8-88e9-83bdc670a2c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:44.110116 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-504f8b3d-bb35-4ea8-88e9-83bdc670a2c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:44.220640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f8b3d-bb35-4ea8-88e9-83bdc670a2c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:44.222122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f8b3d-bb35-4ea8-88e9-83bdc670a2c5 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:44.245542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 730/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:17:46.192546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98d507-9302-474c-9c9e-0c80219d3cce None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:46.193155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98d507-9302-474c-9c9e-0c80219d3cce None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:46.193155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98d507-9302-474c-9c9e-0c80219d3cce None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:46.195159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:46.203015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951ba03-99fc-4470-a46e-f045a91b60ad None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:46.203469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951ba03-99fc-4470-a46e-f045a91b60ad None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:46.203587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951ba03-99fc-4470-a46e-f045a91b60ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:46.269522 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3951ba03-99fc-4470-a46e-f045a91b60ad None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:46.270737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3951ba03-99fc-4470-a46e-f045a91b60ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:46.279315 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:46.379873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:17:46.665189 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98d507-9302-474c-9c9e-0c80219d3cce None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:46.666763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6c98d507-9302-474c-9c9e-0c80219d3cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:46.779898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98d507-9302-474c-9c9e-0c80219d3cce None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:46.837017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:46.861486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6d37e-c8fc-42a6-8a2d-156535e3e75a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:46.862096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6d37e-c8fc-42a6-8a2d-156535e3e75a service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:46.862373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6d37e-c8fc-42a6-8a2d-156535e3e75a service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:46.862650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6d37e-c8fc-42a6-8a2d-156535e3e75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:46.864243 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fbd6d37e-c8fc-42a6-8a2d-156535e3e75a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:46.996514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6d37e-c8fc-42a6-8a2d-156535e3e75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:46.998002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6d37e-c8fc-42a6-8a2d-156535e3e75a service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:47.017938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 730/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:48.946406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c1533-853d-4a5f-aa12-337b212ae622 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:48.947222 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c1533-853d-4a5f-aa12-337b212ae622 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:48.947222 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c1533-853d-4a5f-aa12-337b212ae622 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:48.949553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:17:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:48.956036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633a56-3dca-4fea-8203-a6546f2b16af None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:48.956793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633a56-3dca-4fea-8203-a6546f2b16af None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:48.956970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633a56-3dca-4fea-8203-a6546f2b16af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:49.028543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cb633a56-3dca-4fea-8203-a6546f2b16af None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:49.029765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cb633a56-3dca-4fea-8203-a6546f2b16af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:49.069329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:49.140913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:49.422328 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c1533-853d-4a5f-aa12-337b212ae622 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:49.424776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-335c1533-853d-4a5f-aa12-337b212ae622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:49.534620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c1533-853d-4a5f-aa12-337b212ae622 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:49.574152 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:49.612746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f8951-9743-4b8d-96f8-33ed67726337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:49.613428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f8951-9743-4b8d-96f8-33ed67726337 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:49.613681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f8951-9743-4b8d-96f8-33ed67726337 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:49.613947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f8951-9743-4b8d-96f8-33ed67726337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:49.615565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5e6f8951-9743-4b8d-96f8-33ed67726337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:49.729713 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f8951-9743-4b8d-96f8-33ed67726337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:49.731163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f8951-9743-4b8d-96f8-33ed67726337 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:49.749907 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 733/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:51.680355 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae0416-5f90-43b9-9be3-acf6e2d2b31d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:51.680982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae0416-5f90-43b9-9be3-acf6e2d2b31d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:51.680982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae0416-5f90-43b9-9be3-acf6e2d2b31d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:51.682303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:51.688710 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26e15c-bf76-4a95-b6b8-3b8ac4cadc3b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:51.689177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26e15c-bf76-4a95-b6b8-3b8ac4cadc3b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:51.689318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26e15c-bf76-4a95-b6b8-3b8ac4cadc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:51.765321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7f26e15c-bf76-4a95-b6b8-3b8ac4cadc3b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:51.766543 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7f26e15c-bf76-4a95-b6b8-3b8ac4cadc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:51.786105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:51.869148 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:52.151404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae0416-5f90-43b9-9be3-acf6e2d2b31d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:52.152990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-deae0416-5f90-43b9-9be3-acf6e2d2b31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:52.276323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae0416-5f90-43b9-9be3-acf6e2d2b31d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:52.346074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:52.353747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234758a-8546-4049-a2df-90fae5f928ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:52.354365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234758a-8546-4049-a2df-90fae5f928ec service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:52.354649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234758a-8546-4049-a2df-90fae5f928ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:52.354923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234758a-8546-4049-a2df-90fae5f928ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:52.356530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5234758a-8546-4049-a2df-90fae5f928ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:52.469816 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234758a-8546-4049-a2df-90fae5f928ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:52.471265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234758a-8546-4049-a2df-90fae5f928ec service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:52.492222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 733/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:17:54.435269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d3ffe-8f43-4854-beb7-cf5c54108515 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:54.435867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d3ffe-8f43-4854-beb7-cf5c54108515 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:54.435867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d3ffe-8f43-4854-beb7-cf5c54108515 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:54.437962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:17:54.445409 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf3a18-22ee-4736-a20c-e5b3f001b81f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:54.445851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf3a18-22ee-4736-a20c-e5b3f001b81f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:54.445953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf3a18-22ee-4736-a20c-e5b3f001b81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:54.522712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-daaf3a18-22ee-4736-a20c-e5b3f001b81f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:17:54.524067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-daaf3a18-22ee-4736-a20c-e5b3f001b81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:54.576751 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:54.631865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:17:54.921766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d3ffe-8f43-4854-beb7-cf5c54108515 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:17:54.924251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e78d3ffe-8f43-4854-beb7-cf5c54108515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:55.050435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d3ffe-8f43-4854-beb7-cf5c54108515 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:17:55.099928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:55.128502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf8820-e06c-4cf1-b8b8-94a1fb1b54e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:17:55.129167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf8820-e06c-4cf1-b8b8-94a1fb1b54e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:17:55.129439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf8820-e06c-4cf1-b8b8-94a1fb1b54e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:17:55.129704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf8820-e06c-4cf1-b8b8-94a1fb1b54e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:17:55.131337 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cedf8820-e06c-4cf1-b8b8-94a1fb1b54e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:17:55.252239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf8820-e06c-4cf1-b8b8-94a1fb1b54e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:17:55.253737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf8820-e06c-4cf1-b8b8-94a1fb1b54e3 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:17:55.272030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 736/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:18:04.628317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=22 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:05.269715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=66 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:14.629480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b71c73-8a73-47c6-a7a4-96d850e6da9d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:14.630344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b71c73-8a73-47c6-a7a4-96d850e6da9d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:14.630497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b71c73-8a73-47c6-a7a4-96d850e6da9d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:14.632865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 735/1471] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:18:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:18:14.638102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf5f63-dfdd-43f1-b026-3d97551d6b90 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:14.638561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf5f63-dfdd-43f1-b026-3d97551d6b90 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:14.638670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf5f63-dfdd-43f1-b026-3d97551d6b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:14.714399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9bbf5f63-dfdd-43f1-b026-3d97551d6b90 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:18:14.715622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9bbf5f63-dfdd-43f1-b026-3d97551d6b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:14.820986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 737/1472] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:18:15.115936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b55383-0eec-4c08-b80d-65482ee6c67b None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:15.116223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b55383-0eec-4c08-b80d-65482ee6c67b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:15.116493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b55383-0eec-4c08-b80d-65482ee6c67b None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:15.117914 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 736/1473] 10.222.0.45 () {54 vars in 967 bytes} [Fri Aug 26 18:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:18:15.123335 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d716931-f012-4937-a870-b2ab3c5d8233 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:15.123648 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d716931-f012-4937-a870-b2ab3c5d8233 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:15.123922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d716931-f012-4937-a870-b2ab3c5d8233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:15.203801 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9d716931-f012-4937-a870-b2ab3c5d8233 None None] MFA Rules not processed for user `74ee7b50c34742ce896a734f3ef34a53`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:18:15.205091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9d716931-f012-4937-a870-b2ab3c5d8233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:15.226333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:15.286078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 738/1474] 10.222.0.45 () {58 vars in 1064 bytes} [Fri Aug 26 18:18:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:18:15.294739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b55383-0eec-4c08-b80d-65482ee6c67b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:18:15.297194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-05b55383-0eec-4c08-b80d-65482ee6c67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:15.417731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b55383-0eec-4c08-b80d-65482ee6c67b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:18:15.496875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0567-5462-48fc-8350-80f5da058797 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ee7b50c34742ce896a734f3ef34a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:18:15.497495 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0567-5462-48fc-8350-80f5da058797 service glance] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:15.497770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0567-5462-48fc-8350-80f5da058797 service glance] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:15.498037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0567-5462-48fc-8350-80f5da058797 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:15.499638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7e0f0567-5462-48fc-8350-80f5da058797 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:15.560174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:15.620401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f0567-5462-48fc-8350-80f5da058797 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:18:15.622226 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f0567-5462-48fc-8350-80f5da058797 service glance] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:18:15.641976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 737/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:18:17.600148 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86111217-d3cd-430d-9f6a-c2409788d875 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:17.600734 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86111217-d3cd-430d-9f6a-c2409788d875 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:17.600734 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86111217-d3cd-430d-9f6a-c2409788d875 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:17.602112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 739/1476] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:18:17.607665 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f1e4c-41a0-46df-a802-e397d3273323 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:17.608094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f1e4c-41a0-46df-a802-e397d3273323 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:17.608200 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f1e4c-41a0-46df-a802-e397d3273323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:17.673875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0b6f1e4c-41a0-46df-a802-e397d3273323 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:18:17.675112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0b6f1e4c-41a0-46df-a802-e397d3273323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:17.774918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 738/1477] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:18:18.059646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86111217-d3cd-430d-9f6a-c2409788d875 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:18:18.062075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-86111217-d3cd-430d-9f6a-c2409788d875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:18.196815 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86111217-d3cd-430d-9f6a-c2409788d875 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:18:18.253391 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:18.303487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fb061-ea93-4681-8828-b69bc954711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:18:18.304097 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb061-ea93-4681-8828-b69bc954711c admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:18.304370 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb061-ea93-4681-8828-b69bc954711c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:18.304640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb061-ea93-4681-8828-b69bc954711c admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:18.305322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fb061-ea93-4681-8828-b69bc954711c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:18:18.307143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: WARNING py.warnings [None req-397fb061-ea93-4681-8828-b69bc954711c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:18:18.307143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: warnings.warn(msg) Aug 26 18:18:18.307143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: Aug 26 18:18:18.308284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fb061-ea93-4681-8828-b69bc954711c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:18:18.327589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 740/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Fri Aug 26 18:18:18 2022] GET /identity/v3/projects => generated 2553 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:18:20.233155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b129b75-91f2-4daa-8d9f-a8fe03fd5776 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:20.233748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b129b75-91f2-4daa-8d9f-a8fe03fd5776 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:20.233748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b129b75-91f2-4daa-8d9f-a8fe03fd5776 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:20.235962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 739/1479] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:18:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:18:20.244142 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325fb5c-d36c-4a62-b8d2-99dd27007ccf None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:20.244615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325fb5c-d36c-4a62-b8d2-99dd27007ccf None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:20.244769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325fb5c-d36c-4a62-b8d2-99dd27007ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:20.314436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9325fb5c-d36c-4a62-b8d2-99dd27007ccf None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:18:20.315652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9325fb5c-d36c-4a62-b8d2-99dd27007ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:20.429029 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 741/1480] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:18:20.727034 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b129b75-91f2-4daa-8d9f-a8fe03fd5776 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:18:20.729233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7b129b75-91f2-4daa-8d9f-a8fe03fd5776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:20.743929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:20.893019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b129b75-91f2-4daa-8d9f-a8fe03fd5776 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:18:20.973930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:21.008879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371609f-57a7-4ef9-99c8-109b9e413973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:18:21.009487 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371609f-57a7-4ef9-99c8-109b9e413973 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:21.009762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371609f-57a7-4ef9-99c8-109b9e413973 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:21.010024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371609f-57a7-4ef9-99c8-109b9e413973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:21.011604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d371609f-57a7-4ef9-99c8-109b9e413973 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:21.118150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371609f-57a7-4ef9-99c8-109b9e413973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:18:21.119760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371609f-57a7-4ef9-99c8-109b9e413973 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:18:21.139217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 740/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:18:23.218624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca639e-034a-482b-b6f5-a05e69153b5c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:23.219528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca639e-034a-482b-b6f5-a05e69153b5c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:23.219528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca639e-034a-482b-b6f5-a05e69153b5c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:23.221753 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 742/1482] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:18:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:18:23.230494 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9104d-0c90-4c31-b7a6-a63980cdbc71 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:23.230915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9104d-0c90-4c31-b7a6-a63980cdbc71 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:23.231091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9104d-0c90-4c31-b7a6-a63980cdbc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:23.304863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-60a9104d-0c90-4c31-b7a6-a63980cdbc71 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:18:23.306137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-60a9104d-0c90-4c31-b7a6-a63980cdbc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:23.367552 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:23.421790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 741/1483] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:18:23.705843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca639e-034a-482b-b6f5-a05e69153b5c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:18:23.708402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6bca639e-034a-482b-b6f5-a05e69153b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:23.734283 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:23.820462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca639e-034a-482b-b6f5-a05e69153b5c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:18:23.900706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3501e0f-255c-4f8e-81bc-cb9fda225554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:18:23.901348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3501e0f-255c-4f8e-81bc-cb9fda225554 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:23.901628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3501e0f-255c-4f8e-81bc-cb9fda225554 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:23.901890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3501e0f-255c-4f8e-81bc-cb9fda225554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:23.903487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c3501e0f-255c-4f8e-81bc-cb9fda225554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:23.991370 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:24.028187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3501e0f-255c-4f8e-81bc-cb9fda225554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:18:24.029669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3501e0f-255c-4f8e-81bc-cb9fda225554 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:18:24.048275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 743/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:18:26.090384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de795a84-e561-4c56-a31a-fdc4df382ca2 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:26.091305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de795a84-e561-4c56-a31a-fdc4df382ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:26.091305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de795a84-e561-4c56-a31a-fdc4df382ca2 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:26.093723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 742/1485] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:18:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:18:26.099702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac554cbe-5fdb-4980-9acd-4851704826b0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:26.100147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac554cbe-5fdb-4980-9acd-4851704826b0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:26.100251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac554cbe-5fdb-4980-9acd-4851704826b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:26.171147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ac554cbe-5fdb-4980-9acd-4851704826b0 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:18:26.172393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ac554cbe-5fdb-4980-9acd-4851704826b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:26.300921 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 744/1486] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:18:26.587396 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de795a84-e561-4c56-a31a-fdc4df382ca2 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:18:26.589906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-de795a84-e561-4c56-a31a-fdc4df382ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:26.706585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de795a84-e561-4c56-a31a-fdc4df382ca2 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:18:26.794389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:26.796969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece98d79-357f-479c-9895-49888408a190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:18:26.798081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece98d79-357f-479c-9895-49888408a190 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:26.798466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece98d79-357f-479c-9895-49888408a190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:26.798820 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece98d79-357f-479c-9895-49888408a190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:26.802445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ece98d79-357f-479c-9895-49888408a190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:26.916310 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece98d79-357f-479c-9895-49888408a190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:18:26.917839 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece98d79-357f-479c-9895-49888408a190 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:18:26.936782 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 743/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:18:28.982853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b57168-577e-4b2a-b0f3-74d244dc38ca None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:28.983514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b57168-577e-4b2a-b0f3-74d244dc38ca None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:28.983514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b57168-577e-4b2a-b0f3-74d244dc38ca None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:28.984745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 745/1488] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:18:28.991440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2c165-f8b5-43bb-aa77-1ecceae47878 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:28.992238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2c165-f8b5-43bb-aa77-1ecceae47878 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:28.992426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2c165-f8b5-43bb-aa77-1ecceae47878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:29.066670 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f6f2c165-f8b5-43bb-aa77-1ecceae47878 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:18:29.067909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f6f2c165-f8b5-43bb-aa77-1ecceae47878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:29.123157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:29.177564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 744/1489] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:18:29.466498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b57168-577e-4b2a-b0f3-74d244dc38ca None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:18:29.468050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e4b57168-577e-4b2a-b0f3-74d244dc38ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:29.506290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:29.578309 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b57168-577e-4b2a-b0f3-74d244dc38ca None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:18:29.665152 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90847fe4-1b57-4bd3-aa2a-95831bad6217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:18:29.665763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90847fe4-1b57-4bd3-aa2a-95831bad6217 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:29.666039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90847fe4-1b57-4bd3-aa2a-95831bad6217 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:29.666303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90847fe4-1b57-4bd3-aa2a-95831bad6217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:29.667906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-90847fe4-1b57-4bd3-aa2a-95831bad6217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:29.753136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:29.782770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90847fe4-1b57-4bd3-aa2a-95831bad6217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:18:29.784206 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90847fe4-1b57-4bd3-aa2a-95831bad6217 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:18:29.803353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 746/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:18:31.880193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9d46-b443-4c4b-95bc-1f78aba7839e None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:31.881070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9d46-b443-4c4b-95bc-1f78aba7839e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:31.881070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9d46-b443-4c4b-95bc-1f78aba7839e None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:31.883216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 745/1491] 10.222.0.45 () {54 vars in 927 bytes} [Fri Aug 26 18:18:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:18:31.889540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60828bf8-cd33-4889-86c6-a71faab968d4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:31.889993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60828bf8-cd33-4889-86c6-a71faab968d4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:31.890175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60828bf8-cd33-4889-86c6-a71faab968d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:31.959126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-60828bf8-cd33-4889-86c6-a71faab968d4 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:18:31.960345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-60828bf8-cd33-4889-86c6-a71faab968d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:32.066884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 747/1492] 10.222.0.45 () {58 vars in 1024 bytes} [Fri Aug 26 18:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:18:32.354484 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e9d46-b443-4c4b-95bc-1f78aba7839e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:18:32.356017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fd3e9d46-b443-4c4b-95bc-1f78aba7839e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:32.465530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e9d46-b443-4c4b-95bc-1f78aba7839e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:18:32.540990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b494b-560a-4ddb-a0a1-70b8d0cbae72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:18:32.541616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b494b-560a-4ddb-a0a1-70b8d0cbae72 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:18:32.541893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b494b-560a-4ddb-a0a1-70b8d0cbae72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:18:32.542159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b494b-560a-4ddb-a0a1-70b8d0cbae72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:18:32.543749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-515b494b-560a-4ddb-a0a1-70b8d0cbae72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:18:32.556752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:32.669924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b494b-560a-4ddb-a0a1-70b8d0cbae72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:18:32.671648 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b494b-560a-4ddb-a0a1-70b8d0cbae72 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:18:32.689906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 746/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:18:42.065059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=82 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:42.687492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=50 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:19:56.285024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af131a-0bc1-41c0-a943-d1ab8e9d86ab None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:56.285894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af131a-0bc1-41c0-a943-d1ab8e9d86ab None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:56.285894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af131a-0bc1-41c0-a943-d1ab8e9d86ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:56.366185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-26af131a-0bc1-41c0-a943-d1ab8e9d86ab None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:19:56.367394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-26af131a-0bc1-41c0-a943-d1ab8e9d86ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:56.465050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 748/1494] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:19:56.473407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403da06-288a-4b0a-80c4-3c16b69b2035 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:56.473920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403da06-288a-4b0a-80c4-3c16b69b2035 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:56.473920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403da06-288a-4b0a-80c4-3c16b69b2035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:56.552872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1403da06-288a-4b0a-80c4-3c16b69b2035 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:19:56.554073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1403da06-288a-4b0a-80c4-3c16b69b2035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:56.653956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 747/1495] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:19:56.659156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af131a-0bc1-41c0-a943-d1ab8e9d86ab None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:19:56.660360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-26af131a-0bc1-41c0-a943-d1ab8e9d86ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:56.671897 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af131a-0bc1-41c0-a943-d1ab8e9d86ab None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:19:56.733480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:19:56.769155 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92205c-d765-4a9e-820a-1fa52cc661eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:19:56.769762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92205c-d765-4a9e-820a-1fa52cc661eb admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:56.770035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92205c-d765-4a9e-820a-1fa52cc661eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:56.770276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92205c-d765-4a9e-820a-1fa52cc661eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:56.770952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92205c-d765-4a9e-820a-1fa52cc661eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:19:56.771252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92205c-d765-4a9e-820a-1fa52cc661eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:19:56.772270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: WARNING py.warnings [None req-8b92205c-d765-4a9e-820a-1fa52cc661eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:19:56.772270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: warnings.warn(msg) Aug 26 18:19:56.772270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: Aug 26 18:19:56.773192 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92205c-d765-4a9e-820a-1fa52cc661eb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:19:56.784489 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 749/1496] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:19:56.793088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403da06-288a-4b0a-80c4-3c16b69b2035 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:19:56.803162 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403da06-288a-4b0a-80c4-3c16b69b2035 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:19:56.867115 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:19:56.901590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f5d79-b4ee-44e7-8434-92f2dcad1a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:19:56.902187 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f5d79-b4ee-44e7-8434-92f2dcad1a10 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:56.902458 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f5d79-b4ee-44e7-8434-92f2dcad1a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:56.902724 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f5d79-b4ee-44e7-8434-92f2dcad1a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:56.903342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f5d79-b4ee-44e7-8434-92f2dcad1a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:19:56.905101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: WARNING py.warnings [None req-2f2f5d79-b4ee-44e7-8434-92f2dcad1a10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:19:56.905101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: warnings.warn(msg) Aug 26 18:19:56.905101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: Aug 26 18:19:56.906298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f5d79-b4ee-44e7-8434-92f2dcad1a10 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:19:56.967524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 748/1497] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:19:56 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:19:56.971625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92205c-d765-4a9e-820a-1fa52cc661eb admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:19:56.973218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8b92205c-d765-4a9e-820a-1fa52cc661eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:57.008028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92205c-d765-4a9e-820a-1fa52cc661eb admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:19:57.111195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e51de-185a-4c0e-98ad-01071c27a50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:19:57.111807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e51de-185a-4c0e-98ad-01071c27a50a admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:57.112083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e51de-185a-4c0e-98ad-01071c27a50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:57.112348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e51de-185a-4c0e-98ad-01071c27a50a admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:57.112997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e51de-185a-4c0e-98ad-01071c27a50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:19:57.114032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: WARNING py.warnings [None req-0a6e51de-185a-4c0e-98ad-01071c27a50a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:19:57.114032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: warnings.warn(msg) Aug 26 18:19:57.114032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: Aug 26 18:19:57.115237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e51de-185a-4c0e-98ad-01071c27a50a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:19:57.160567 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 750/1498] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:19:56 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:19:57.164821 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f5d79-b4ee-44e7-8434-92f2dcad1a10 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:19:57.166359 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2f2f5d79-b4ee-44e7-8434-92f2dcad1a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:57.238920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f5d79-b4ee-44e7-8434-92f2dcad1a10 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:19:57.327564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:19:57.339272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf251a0-2c36-48f2-b121-806e7a26c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:19:57.339885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf251a0-2c36-48f2-b121-806e7a26c171 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:57.340158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf251a0-2c36-48f2-b121-806e7a26c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:57.340411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf251a0-2c36-48f2-b121-806e7a26c171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:57.341090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf251a0-2c36-48f2-b121-806e7a26c171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:19:57.342137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: WARNING py.warnings [None req-5bf251a0-2c36-48f2-b121-806e7a26c171 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:19:57.342137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: warnings.warn(msg) Aug 26 18:19:57.342137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: Aug 26 18:19:57.343017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf251a0-2c36-48f2-b121-806e7a26c171 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:19:57.355445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 749/1499] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:19:57.359576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e51de-185a-4c0e-98ad-01071c27a50a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:19:57.361231 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0a6e51de-185a-4c0e-98ad-01071c27a50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:57.372878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e51de-185a-4c0e-98ad-01071c27a50a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:19:57.399675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:19:57.469922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa2876-783e-47b5-807b-0cced102a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:19:57.470576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa2876-783e-47b5-807b-0cced102a7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:57.470850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa2876-783e-47b5-807b-0cced102a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:57.471113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa2876-783e-47b5-807b-0cced102a7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:57.471752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa2876-783e-47b5-807b-0cced102a7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:19:57.472835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: WARNING py.warnings [None req-d3aa2876-783e-47b5-807b-0cced102a7f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:19:57.472835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: warnings.warn(msg) Aug 26 18:19:57.472835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: Aug 26 18:19:57.473716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa2876-783e-47b5-807b-0cced102a7f5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:19:57.486359 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 751/1500] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:19:57.490842 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf251a0-2c36-48f2-b121-806e7a26c171 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:19:57.492353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5bf251a0-2c36-48f2-b121-806e7a26c171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:57.526398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf251a0-2c36-48f2-b121-806e7a26c171 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:19:57.637621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e28ed-e199-46a8-8144-0f8b0d4e3f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:19:57.638309 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e28ed-e199-46a8-8144-0f8b0d4e3f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:57.638559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e28ed-e199-46a8-8144-0f8b0d4e3f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:57.638828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e28ed-e199-46a8-8144-0f8b0d4e3f1c admin admin] PATH_INFO: `/v3/projects/e7387f08d3f446d99bfe608d176b9145/users/68c379ce6d674ab1b1070a668aadff3e/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:57.661867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e28ed-e199-46a8-8144-0f8b0d4e3f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7387f08d3f446d99bfe608d176b9145, user_id=68c379ce6d674ab1b1070a668aadff3e, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:19:57.662918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: WARNING py.warnings [None req-da6e28ed-e199-46a8-8144-0f8b0d4e3f1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:19:57.662918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: warnings.warn(msg) Aug 26 18:19:57.662918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: Aug 26 18:19:57.664898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e28ed-e199-46a8-8144-0f8b0d4e3f1c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:19:57.692281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 750/1501] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:19:57 2022] PUT /identity/v3/projects/e7387f08d3f446d99bfe608d176b9145/users/68c379ce6d674ab1b1070a668aadff3e/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:19:57.704657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c1f8a-08c7-4976-a725-78861b3aabc1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:57.705016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c1f8a-08c7-4976-a725-78861b3aabc1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:57.705224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c1f8a-08c7-4976-a725-78861b3aabc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:57.769425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c14c1f8a-08c7-4976-a725-78861b3aabc1 None None] MFA Rules not processed for user `68c379ce6d674ab1b1070a668aadff3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:19:57.770637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c14c1f8a-08c7-4976-a725-78861b3aabc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:57.859970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 752/1502] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:19:57.874544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219814d-08be-469d-89f5-3533c441541b None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:57.874760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219814d-08be-469d-89f5-3533c441541b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:57.875159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219814d-08be-469d-89f5-3533c441541b None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:57.877631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 751/1503] 10.222.0.45 () {54 vars in 964 bytes} [Fri Aug 26 18:19:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:19:57.885509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed2cf5-fc44-43db-994c-2a8736f1852a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:57.885883 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed2cf5-fc44-43db-994c-2a8736f1852a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:57.886232 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed2cf5-fc44-43db-994c-2a8736f1852a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:57.922126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:19:57.967439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-23ed2cf5-fc44-43db-994c-2a8736f1852a None None] MFA Rules not processed for user `fcfeeb3365ba420c9ff03e5aadee7f66`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:19:57.968661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-23ed2cf5-fc44-43db-994c-2a8736f1852a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:58.049269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 753/1504] 10.222.0.45 () {58 vars in 1061 bytes} [Fri Aug 26 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:19:58.057320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219814d-08be-469d-89f5-3533c441541b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:19:58.058846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9219814d-08be-469d-89f5-3533c441541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:58.118574 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:19:58.183364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219814d-08be-469d-89f5-3533c441541b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:19:58.264375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768bb4a-fe54-45f4-97cf-27fe32bf0bb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:19:58.265061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768bb4a-fe54-45f4-97cf-27fe32bf0bb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:58.265314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768bb4a-fe54-45f4-97cf-27fe32bf0bb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:58.265590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768bb4a-fe54-45f4-97cf-27fe32bf0bb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:58.267210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7768bb4a-fe54-45f4-97cf-27fe32bf0bb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:58.370074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768bb4a-fe54-45f4-97cf-27fe32bf0bb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:19:58.371548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768bb4a-fe54-45f4-97cf-27fe32bf0bb0 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:19:58.376151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:19:58.391954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 752/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:19:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:19:58.442094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1127-d241-454d-8a25-98aba92fb380 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:58.442558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1127-d241-454d-8a25-98aba92fb380 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:58.442676 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1127-d241-454d-8a25-98aba92fb380 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:58.445517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 754/1506] 10.222.0.45 () {52 vars in 830 bytes} [Fri Aug 26 18:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:19:58.449463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768bb4a-fe54-45f4-97cf-27fe32bf0bb0 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:19:58.450693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7768bb4a-fe54-45f4-97cf-27fe32bf0bb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:58.560208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768bb4a-fe54-45f4-97cf-27fe32bf0bb0 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:19:58.663677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:19:58.664323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:58.664603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:58.664906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] PATH_INFO: `/v3/users/68c379ce6d674ab1b1070a668aadff3e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:58.678293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c379ce6d674ab1b1070a668aadff3e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:19:58.679319 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: WARNING py.warnings [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:19:58.679319 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: warnings.warn(msg) Aug 26 18:19:58.679319 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: Aug 26 18:19:58.680541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:19:58.692152 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:19:58.752126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c379ce6d674ab1b1070a668aadff3e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:19:58.776917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c379ce6d674ab1b1070a668aadff3e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:19:58.777485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c379ce6d674ab1b1070a668aadff3e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:19:58.791674 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c379ce6d674ab1b1070a668aadff3e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:19:58.802010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c379ce6d674ab1b1070a668aadff3e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:19:58.807629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 753/1507] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:19:58 2022] DELETE /identity/v3/users/68c379ce6d674ab1b1070a668aadff3e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:19:58.812073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69a2f-cdcf-4ec4-ad48-277ce7e93426 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:58.812363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69a2f-cdcf-4ec4-ad48-277ce7e93426 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:58.812623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69a2f-cdcf-4ec4-ad48-277ce7e93426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:58.872070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-32f69a2f-cdcf-4ec4-ad48-277ce7e93426 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:19:58.873299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-32f69a2f-cdcf-4ec4-ad48-277ce7e93426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:58.953062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:19:58.966315 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 755/1508] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:19:58.977154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:19:58.978393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:59.080701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b91bd-d2db-47b1-8480-a1026e7c3c08 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:19:59.140522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:19:59.160627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7edad-6e6d-4c24-9dba-9be84b68f634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:19:59.161276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7edad-6e6d-4c24-9dba-9be84b68f634 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:59.161557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7edad-6e6d-4c24-9dba-9be84b68f634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:59.161835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7edad-6e6d-4c24-9dba-9be84b68f634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:59.163431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1fc7edad-6e6d-4c24-9dba-9be84b68f634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:59.276393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7edad-6e6d-4c24-9dba-9be84b68f634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:19:59.277826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7edad-6e6d-4c24-9dba-9be84b68f634 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:19:59.296554 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 754/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:19:59.640138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f69a2f-cdcf-4ec4-ad48-277ce7e93426 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:19:59.641745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-32f69a2f-cdcf-4ec4-ad48-277ce7e93426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:19:59.653682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f69a2f-cdcf-4ec4-ad48-277ce7e93426 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:19:59.751613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:19:59.752255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:19:59.752532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:19:59.752830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] PATH_INFO: `/v3/projects/e7387f08d3f446d99bfe608d176b9145` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:19:59.763940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7387f08d3f446d99bfe608d176b9145)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:19:59.765091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: WARNING py.warnings [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:19:59.765091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: warnings.warn(msg) Aug 26 18:19:59.765091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: Aug 26 18:19:59.766329 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:19:59.827362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7387f08d3f446d99bfe608d176b9145', 'request_id': 'req-09914908-8e03-4685-ad95-a91fb254fcc5'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:19:59.833526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7387f08d3f446d99bfe608d176b9145', 'request_id': 'req-09914908-8e03-4685-ad95-a91fb254fcc5'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:19:59.846756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7387f08d3f446d99bfe608d176b9145', 'request_id': 'req-09914908-8e03-4685-ad95-a91fb254fcc5'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:19:59.883501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] The token cache is being invalidate because project e7387f08d3f446d99bfe608d176b9145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:19:59.883714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:19:59.884240 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-09914908-8e03-4685-ad95-a91fb254fcc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:19:59.885618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 756/1510] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:19:59 2022] DELETE /identity/v3/projects/e7387f08d3f446d99bfe608d176b9145 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:20:09.294177 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=62 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:20:09.881183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:21:30.529678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9d536-2e6a-461a-9008-86d0410da173 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:30.530303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9d536-2e6a-461a-9008-86d0410da173 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:30.530303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9d536-2e6a-461a-9008-86d0410da173 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:30.531649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 18:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:21:30.539113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb6da-b04f-4e0d-9d8a-dde7c72e257e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:30.539585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb6da-b04f-4e0d-9d8a-dde7c72e257e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:30.539694 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb6da-b04f-4e0d-9d8a-dde7c72e257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:30.634539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3e4fb6da-b04f-4e0d-9d8a-dde7c72e257e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:21:30.635735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3e4fb6da-b04f-4e0d-9d8a-dde7c72e257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:30.747207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 18:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:21:30.902110 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9d536-2e6a-461a-9008-86d0410da173 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:21:30.904331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3fc9d536-2e6a-461a-9008-86d0410da173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:31.035007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9d536-2e6a-461a-9008-86d0410da173 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:21:31.045163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950edd2-ffbb-449b-8d1e-1c3ad44b2721 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:21:31.045782 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950edd2-ffbb-449b-8d1e-1c3ad44b2721 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:31.046059 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950edd2-ffbb-449b-8d1e-1c3ad44b2721 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:31.046327 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950edd2-ffbb-449b-8d1e-1c3ad44b2721 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:31.057494 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950edd2-ffbb-449b-8d1e-1c3ad44b2721 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:21:31.059115 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950edd2-ffbb-449b-8d1e-1c3ad44b2721 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:21:31.069139 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 756/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:21:31.888627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24542a6b-2127-44ef-a333-2925e9fa70b1 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:31.889739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24542a6b-2127-44ef-a333-2925e9fa70b1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:31.889739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24542a6b-2127-44ef-a333-2925e9fa70b1 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:31.891727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 18:21:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:21:31.897671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2bfbb-74e4-453c-b925-a4aca77ec4e2 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:31.898133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2bfbb-74e4-453c-b925-a4aca77ec4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:31.898237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2bfbb-74e4-453c-b925-a4aca77ec4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:31.920204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-afa2bfbb-74e4-453c-b925-a4aca77ec4e2 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:21:31.921506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-afa2bfbb-74e4-453c-b925-a4aca77ec4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:31.930401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 18:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:21:32.088862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24542a6b-2127-44ef-a333-2925e9fa70b1 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:21:32.105242 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24542a6b-2127-44ef-a333-2925e9fa70b1 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:21:32.111773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b646e2-4c24-4d67-b344-c7774b345a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:21:32.112399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b646e2-4c24-4d67-b344-c7774b345a1a service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:32.112675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b646e2-4c24-4d67-b344-c7774b345a1a service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:32.112980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b646e2-4c24-4d67-b344-c7774b345a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:32.122396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b646e2-4c24-4d67-b344-c7774b345a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:21:32.123603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b646e2-4c24-4d67-b344-c7774b345a1a service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:21:32.136380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 759/1516] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:21:33.467049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7a3ab-0ffa-4902-8c09-cf7de6e426d5 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:33.467652 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7a3ab-0ffa-4902-8c09-cf7de6e426d5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:33.467652 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7a3ab-0ffa-4902-8c09-cf7de6e426d5 None None] PATH_INFO: `/v3` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:33.469000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 758/1517] 10.222.0.20 () {54 vars in 925 bytes} [Fri Aug 26 18:21:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:21:33.477018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d774122-0d02-493f-a4a3-6396a9ad8fcd None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:33.477836 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d774122-0d02-493f-a4a3-6396a9ad8fcd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:33.477836 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d774122-0d02-493f-a4a3-6396a9ad8fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:33.557118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0d774122-0d02-493f-a4a3-6396a9ad8fcd None None] MFA Rules not processed for user `dd9eef8921de43f18245f47559f3fa71`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:21:33.558369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0d774122-0d02-493f-a4a3-6396a9ad8fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:33.578002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:21:33.637617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 760/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Aug 26 18:21:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:21:37.513526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c40f95-32e6-4361-9f6b-46fb3b224cdb None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:37.514063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c40f95-32e6-4361-9f6b-46fb3b224cdb None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:37.514063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c40f95-32e6-4361-9f6b-46fb3b224cdb None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:37.515358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 759/1519] 10.222.0.45 () {54 vars in 961 bytes} [Fri Aug 26 18:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:21:37.520570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc99b-cf95-436a-babf-213f31d280fa None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:37.521080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc99b-cf95-436a-babf-213f31d280fa None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:37.521284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc99b-cf95-436a-babf-213f31d280fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:37.541910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8bbdc99b-cf95-436a-babf-213f31d280fa None None] MFA Rules not processed for user `dd9eef8921de43f18245f47559f3fa71`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:21:37.543155 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8bbdc99b-cf95-436a-babf-213f31d280fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:37.552293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 761/1520] 10.222.0.45 () {58 vars in 1058 bytes} [Fri Aug 26 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:21:37.560203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c40f95-32e6-4361-9f6b-46fb3b224cdb None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:21:37.575281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c40f95-32e6-4361-9f6b-46fb3b224cdb None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:21:37.580527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1866f9-51a4-4435-9bf3-c0766425fc84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9eef8921de43f18245f47559f3fa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:21:37.581150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1866f9-51a4-4435-9bf3-c0766425fc84 service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:37.581427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1866f9-51a4-4435-9bf3-c0766425fc84 service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:37.581699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1866f9-51a4-4435-9bf3-c0766425fc84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:37.590183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1866f9-51a4-4435-9bf3-c0766425fc84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:21:37.591719 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1866f9-51a4-4435-9bf3-c0766425fc84 service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:21:37.601270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 760/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:21:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:21:43.373599 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedcfbe-41f2-4c11-bdff-931e91ef7a3e None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:43.374199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedcfbe-41f2-4c11-bdff-931e91ef7a3e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:43.374199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedcfbe-41f2-4c11-bdff-931e91ef7a3e None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:43.375614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 18:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:21:43.383664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec2be-bec8-4dfa-a858-56883506de15 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:43.384183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec2be-bec8-4dfa-a858-56883506de15 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:43.384183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec2be-bec8-4dfa-a858-56883506de15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:43.405429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-7ddec2be-bec8-4dfa-a858-56883506de15 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:21:43.406640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7ddec2be-bec8-4dfa-a858-56883506de15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:43.415095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 18:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:21:43.581463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedcfbe-41f2-4c11-bdff-931e91ef7a3e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:21:43.596952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedcfbe-41f2-4c11-bdff-931e91ef7a3e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:21:43.602797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8de55d-c497-480e-bc7c-a6d32ff3a8c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:21:43.603423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8de55d-c497-480e-bc7c-a6d32ff3a8c4 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:43.603746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8de55d-c497-480e-bc7c-a6d32ff3a8c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:43.603952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8de55d-c497-480e-bc7c-a6d32ff3a8c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:43.612487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8de55d-c497-480e-bc7c-a6d32ff3a8c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:21:43.614157 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8de55d-c497-480e-bc7c-a6d32ff3a8c4 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:21:43.623902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 763/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:21:44.458995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d31fd8-c173-453f-b10d-fdf2e6dd9728 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:44.459567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d31fd8-c173-453f-b10d-fdf2e6dd9728 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:44.459567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d31fd8-c173-453f-b10d-fdf2e6dd9728 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:44.460957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 18:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:21:44.468022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e82e3-aa29-4fba-8232-953b9e2dc833 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:44.468498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e82e3-aa29-4fba-8232-953b9e2dc833 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:44.468626 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e82e3-aa29-4fba-8232-953b9e2dc833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:44.497093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8b4e82e3-aa29-4fba-8232-953b9e2dc833 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:21:44.498344 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8b4e82e3-aa29-4fba-8232-953b9e2dc833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:44.508610 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 18:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:21:44.666102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d31fd8-c173-453f-b10d-fdf2e6dd9728 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:21:44.690453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d31fd8-c173-453f-b10d-fdf2e6dd9728 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:21:44.698619 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0723e4-4af5-400d-ab08-6344678a6c95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:21:44.699228 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0723e4-4af5-400d-ab08-6344678a6c95 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:44.699508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0723e4-4af5-400d-ab08-6344678a6c95 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:44.699780 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0723e4-4af5-400d-ab08-6344678a6c95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:44.708658 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0723e4-4af5-400d-ab08-6344678a6c95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:21:44.710361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0723e4-4af5-400d-ab08-6344678a6c95 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:21:44.720913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 763/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:21:48.851541 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b9892-88be-4ca6-b136-76048028f416 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:48.852109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b9892-88be-4ca6-b136-76048028f416 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:48.852109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b9892-88be-4ca6-b136-76048028f416 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:48.853376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:21:48.858980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f9b2b-5338-4607-af7b-dce706922386 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:48.859417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f9b2b-5338-4607-af7b-dce706922386 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:48.859519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f9b2b-5338-4607-af7b-dce706922386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:48.889601 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1f3f9b2b-5338-4607-af7b-dce706922386 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:21:48.890778 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1f3f9b2b-5338-4607-af7b-dce706922386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:48.899170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:21:49.207698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b9892-88be-4ca6-b136-76048028f416 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:21:49.209473 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0e8b9892-88be-4ca6-b136-76048028f416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:49.290027 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b9892-88be-4ca6-b136-76048028f416 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:21:49.294040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663dbc-18f9-40db-b07f-d79740180e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:21:49.294650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663dbc-18f9-40db-b07f-d79740180e87 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:49.294927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663dbc-18f9-40db-b07f-d79740180e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:49.295197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663dbc-18f9-40db-b07f-d79740180e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:49.304939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14663dbc-18f9-40db-b07f-d79740180e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:21:49.306435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14663dbc-18f9-40db-b07f-d79740180e87 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:21:49.316660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 766/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:21:51.235392 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c471930-84a1-443c-b60a-2f058b03c7eb None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:51.236274 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c471930-84a1-443c-b60a-2f058b03c7eb None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:51.236274 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c471930-84a1-443c-b60a-2f058b03c7eb None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:51.238450 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:21:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:21:51.247301 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73c151-b523-4247-a7f3-77b7b72aac7a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:51.248011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73c151-b523-4247-a7f3-77b7b72aac7a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:51.248217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73c151-b523-4247-a7f3-77b7b72aac7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:51.273031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4b73c151-b523-4247-a7f3-77b7b72aac7a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:21:51.274415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4b73c151-b523-4247-a7f3-77b7b72aac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:51.283246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:21:51.565917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c471930-84a1-443c-b60a-2f058b03c7eb None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:21:51.580086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c471930-84a1-443c-b60a-2f058b03c7eb None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:21:51.584547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795f369-b3a7-497b-b9b9-7df8a677de1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:21:51.585171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795f369-b3a7-497b-b9b9-7df8a677de1f service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:51.585506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795f369-b3a7-497b-b9b9-7df8a677de1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:51.585782 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795f369-b3a7-497b-b9b9-7df8a677de1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:51.595014 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795f369-b3a7-497b-b9b9-7df8a677de1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:21:51.596441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795f369-b3a7-497b-b9b9-7df8a677de1f service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:21:51.606010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 766/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:21:55.406807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86a9f2-db89-44f7-85e7-ac48dc1a3383 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:55.407323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86a9f2-db89-44f7-85e7-ac48dc1a3383 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:55.407420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86a9f2-db89-44f7-85e7-ac48dc1a3383 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:55.409617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:21:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:21:55.417981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d1bfd-e884-488b-884e-3fcf1d238e56 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:55.418397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d1bfd-e884-488b-884e-3fcf1d238e56 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:55.418550 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d1bfd-e884-488b-884e-3fcf1d238e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:55.442488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4d7d1bfd-e884-488b-884e-3fcf1d238e56 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:21:55.443722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4d7d1bfd-e884-488b-884e-3fcf1d238e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:55.451773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:21:56.003909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86a9f2-db89-44f7-85e7-ac48dc1a3383 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:21:56.007008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7a86a9f2-db89-44f7-85e7-ac48dc1a3383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:56.083246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:21:56.098471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86a9f2-db89-44f7-85e7-ac48dc1a3383 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:21:56.103054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fda21-a61a-4333-a2eb-bfc3d964a59b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:21:56.103673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fda21-a61a-4333-a2eb-bfc3d964a59b service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:56.103959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fda21-a61a-4333-a2eb-bfc3d964a59b service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:56.104227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fda21-a61a-4333-a2eb-bfc3d964a59b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:56.113951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fda21-a61a-4333-a2eb-bfc3d964a59b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:21:56.115407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fda21-a61a-4333-a2eb-bfc3d964a59b service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:21:56.125125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 769/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:21:58.211249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5ee8e-8cc9-46be-a1cb-8fbbb3e0ea47 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:58.211851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5ee8e-8cc9-46be-a1cb-8fbbb3e0ea47 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:58.211851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5ee8e-8cc9-46be-a1cb-8fbbb3e0ea47 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:58.213218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 18:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:21:58.218762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd782d4-e402-40a0-940f-87fda7000eb4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:58.219210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd782d4-e402-40a0-940f-87fda7000eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:58.219305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd782d4-e402-40a0-940f-87fda7000eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:58.241205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0fd782d4-e402-40a0-940f-87fda7000eb4 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:21:58.242507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0fd782d4-e402-40a0-940f-87fda7000eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:58.251856 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:21:58.802756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5ee8e-8cc9-46be-a1cb-8fbbb3e0ea47 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:21:58.804877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1de5ee8e-8cc9-46be-a1cb-8fbbb3e0ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:21:58.818857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5ee8e-8cc9-46be-a1cb-8fbbb3e0ea47 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:21:58.822736 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df258de2-6b6e-445b-aa7b-4cade70bcbea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:21:58.823335 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df258de2-6b6e-445b-aa7b-4cade70bcbea service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:21:58.823618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df258de2-6b6e-445b-aa7b-4cade70bcbea service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:21:58.823884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df258de2-6b6e-445b-aa7b-4cade70bcbea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:21:58.832978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df258de2-6b6e-445b-aa7b-4cade70bcbea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:21:58.834406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df258de2-6b6e-445b-aa7b-4cade70bcbea service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:21:58.843883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 769/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:22:08.235657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=11 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:22:08.839801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:23.387131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c2cbf-04fa-4699-ba3b-ac9be8b25770 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.388251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c2cbf-04fa-4699-ba3b-ac9be8b25770 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.389020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c2cbf-04fa-4699-ba3b-ac9be8b25770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.400227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cbf94-50ce-4927-8396-9a2c2faba570 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.401443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cbf94-50ce-4927-8396-9a2c2faba570 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.401885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cbf94-50ce-4927-8396-9a2c2faba570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.423884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-638c2cbf-04fa-4699-ba3b-ac9be8b25770 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:23.430955 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-638c2cbf-04fa-4699-ba3b-ac9be8b25770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:23.432421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-707cbf94-50ce-4927-8396-9a2c2faba570 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:23.436741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-707cbf94-50ce-4927-8396-9a2c2faba570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:23.447836 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 771/1540] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:23.458379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff3d27-b8a2-4087-90a1-e48e020d2d50 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.458871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 770/1541] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:23.459569 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff3d27-b8a2-4087-90a1-e48e020d2d50 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.460056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff3d27-b8a2-4087-90a1-e48e020d2d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.468423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1354c-311f-433c-9d76-4faec807d97b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.472771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1354c-311f-433c-9d76-4faec807d97b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.472771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1354c-311f-433c-9d76-4faec807d97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.494785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0cff3d27-b8a2-4087-90a1-e48e020d2d50 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:23.496323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0cff3d27-b8a2-4087-90a1-e48e020d2d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:23.510678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 772/1542] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:23.515882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff3d27-b8a2-4087-90a1-e48e020d2d50 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:23.530451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-afe1354c-311f-433c-9d76-4faec807d97b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:23.531691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-afe1354c-311f-433c-9d76-4faec807d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:23.535217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff3d27-b8a2-4087-90a1-e48e020d2d50 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:23.543214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdd9b7-2d34-46f6-8bff-4f2ce221e7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:23.544122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdd9b7-2d34-46f6-8bff-4f2ce221e7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.544568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdd9b7-2d34-46f6-8bff-4f2ce221e7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.545542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdd9b7-2d34-46f6-8bff-4f2ce221e7d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.546384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdd9b7-2d34-46f6-8bff-4f2ce221e7d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:23:23.546846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdd9b7-2d34-46f6-8bff-4f2ce221e7d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:23.548681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdd9b7-2d34-46f6-8bff-4f2ce221e7d3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:23.555029 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 771/1543] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:23.556433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1354c-311f-433c-9d76-4faec807d97b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:23.569693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1354c-311f-433c-9d76-4faec807d97b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:23.570756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 773/1544] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:23:23.578464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdd9b7-2d34-46f6-8bff-4f2ce221e7d3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:23.585717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036638f-48dc-4b34-a4f9-3513a73fe475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:23.585717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036638f-48dc-4b34-a4f9-3513a73fe475 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.585717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036638f-48dc-4b34-a4f9-3513a73fe475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.585717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036638f-48dc-4b34-a4f9-3513a73fe475 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.586267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036638f-48dc-4b34-a4f9-3513a73fe475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:23:23.586371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036638f-48dc-4b34-a4f9-3513a73fe475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:23.587316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: WARNING py.warnings [None req-e036638f-48dc-4b34-a4f9-3513a73fe475 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:23:23.587316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: warnings.warn(msg) Aug 26 18:23:23.587316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: Aug 26 18:23:23.588278 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036638f-48dc-4b34-a4f9-3513a73fe475 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:23.596599 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdd9b7-2d34-46f6-8bff-4f2ce221e7d3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:23.604901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414b3f3-af94-4d01-9d34-6da890fc071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:23.605845 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414b3f3-af94-4d01-9d34-6da890fc071a admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.606281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414b3f3-af94-4d01-9d34-6da890fc071a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.606718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414b3f3-af94-4d01-9d34-6da890fc071a admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.607998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414b3f3-af94-4d01-9d34-6da890fc071a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:23.609262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: WARNING py.warnings [None req-2414b3f3-af94-4d01-9d34-6da890fc071a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:23:23.609262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: warnings.warn(msg) Aug 26 18:23:23.609262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: Aug 26 18:23:23.610821 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414b3f3-af94-4d01-9d34-6da890fc071a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:23.612852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 772/1545] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:23:23.620885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036638f-48dc-4b34-a4f9-3513a73fe475 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:23.640608 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036638f-48dc-4b34-a4f9-3513a73fe475 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:23.661474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7d83f-ba4f-4240-b6e1-c997a0d75efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:23.662227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7d83f-ba4f-4240-b6e1-c997a0d75efe admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.662518 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7d83f-ba4f-4240-b6e1-c997a0d75efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.662794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7d83f-ba4f-4240-b6e1-c997a0d75efe admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.663514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7d83f-ba4f-4240-b6e1-c997a0d75efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:23.665797 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7d83f-ba4f-4240-b6e1-c997a0d75efe admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:23.677406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 774/1546] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:23 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:23:23.681380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414b3f3-af94-4d01-9d34-6da890fc071a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:23.716749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 773/1547] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:23 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:23.717999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7d83f-ba4f-4240-b6e1-c997a0d75efe admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:23.815657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414b3f3-af94-4d01-9d34-6da890fc071a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:23.825273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6a4c-faa2-473e-86e4-0c31788508bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:23.826449 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6a4c-faa2-473e-86e4-0c31788508bc admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.826954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6a4c-faa2-473e-86e4-0c31788508bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.827447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6a4c-faa2-473e-86e4-0c31788508bc admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.832546 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6a4c-faa2-473e-86e4-0c31788508bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:23.832994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7d83f-ba4f-4240-b6e1-c997a0d75efe admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:23.835958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6a4c-faa2-473e-86e4-0c31788508bc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:23.857579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11182b-1332-42a7-82fc-438288f0dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:23.858267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11182b-1332-42a7-82fc-438288f0dba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.858556 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11182b-1332-42a7-82fc-438288f0dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.858883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11182b-1332-42a7-82fc-438288f0dba9 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.859553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11182b-1332-42a7-82fc-438288f0dba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:23.860668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: WARNING py.warnings [None req-fa11182b-1332-42a7-82fc-438288f0dba9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:23:23.860668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: warnings.warn(msg) Aug 26 18:23:23.860668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: Aug 26 18:23:23.862002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11182b-1332-42a7-82fc-438288f0dba9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:23.890344 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 775/1548] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:23 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:23:23.897919 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6a4c-faa2-473e-86e4-0c31788508bc admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:23.915075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6a4c-faa2-473e-86e4-0c31788508bc admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:23.915300 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 774/1549] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:23 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:23.920219 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11182b-1332-42a7-82fc-438288f0dba9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:23.923350 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b2252-cc12-4fcf-bb57-7c4a1641be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:23.924250 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b2252-cc12-4fcf-bb57-7c4a1641be1a admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.924782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b2252-cc12-4fcf-bb57-7c4a1641be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.925264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b2252-cc12-4fcf-bb57-7c4a1641be1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.926165 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b2252-cc12-4fcf-bb57-7c4a1641be1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:23.932741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b2252-cc12-4fcf-bb57-7c4a1641be1a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:23.936111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11182b-1332-42a7-82fc-438288f0dba9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:23.951807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 776/1550] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:23.953933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61174e-ac74-4622-9d54-b1c5aaca8270 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.954554 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61174e-ac74-4622-9d54-b1c5aaca8270 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.955049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61174e-ac74-4622-9d54-b1c5aaca8270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.960742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf6d85-3d73-402b-a793-018304eee00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:23.960742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6d85-3d73-402b-a793-018304eee00b admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:23.960742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6d85-3d73-402b-a793-018304eee00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:23.960742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6d85-3d73-402b-a793-018304eee00b admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:23.961173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6d85-3d73-402b-a793-018304eee00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:23.961173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6d85-3d73-402b-a793-018304eee00b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:23.983815 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 775/1551] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:23.983815 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf6d85-3d73-402b-a793-018304eee00b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:23.992810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0f61174e-ac74-4622-9d54-b1c5aaca8270 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:23.994461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf6d85-3d73-402b-a793-018304eee00b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:23.994876 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0f61174e-ac74-4622-9d54-b1c5aaca8270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.008824 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 777/1552] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.010035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61174e-ac74-4622-9d54-b1c5aaca8270 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.016740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272a96e-401d-4f74-ac0a-e598d43dbe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.016740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a96e-401d-4f74-ac0a-e598d43dbe99 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.016740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a96e-401d-4f74-ac0a-e598d43dbe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.017100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a96e-401d-4f74-ac0a-e598d43dbe99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.017564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272a96e-401d-4f74-ac0a-e598d43dbe99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.019187 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272a96e-401d-4f74-ac0a-e598d43dbe99 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.031322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61174e-ac74-4622-9d54-b1c5aaca8270 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.038450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a35b0-89d5-47b6-9f15-8cf17a193fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.039426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a35b0-89d5-47b6-9f15-8cf17a193fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.039928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a35b0-89d5-47b6-9f15-8cf17a193fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.040418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a35b0-89d5-47b6-9f15-8cf17a193fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.040987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 776/1553] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:24.041613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a35b0-89d5-47b6-9f15-8cf17a193fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.042495 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bf018-f541-431c-90af-c6c556b6fe5a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.042789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bf018-f541-431c-90af-c6c556b6fe5a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.043070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bf018-f541-431c-90af-c6c556b6fe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.044126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a35b0-89d5-47b6-9f15-8cf17a193fc2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.068074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 778/1554] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:24.069748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a35b0-89d5-47b6-9f15-8cf17a193fc2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.081032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ed9bf018-f541-431c-90af-c6c556b6fe5a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.082267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ed9bf018-f541-431c-90af-c6c556b6fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.087413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a35b0-89d5-47b6-9f15-8cf17a193fc2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.097417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 777/1555] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.098662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df8533-6095-4cc5-ab5b-86ae5f0c1212 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.098948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df8533-6095-4cc5-ab5b-86ae5f0c1212 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.099223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df8533-6095-4cc5-ab5b-86ae5f0c1212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.100370 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827c539-bd40-4cce-831a-49f7288944f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.101548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827c539-bd40-4cce-831a-49f7288944f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.101833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827c539-bd40-4cce-831a-49f7288944f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.102103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827c539-bd40-4cce-831a-49f7288944f0 admin admin] PATH_INFO: `/v3/projects/c525ea582b264cd5866aa7f403999cba/users/c019d1c81a764d42b98222c8146b8ce2/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.118510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827c539-bd40-4cce-831a-49f7288944f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c525ea582b264cd5866aa7f403999cba, user_id=c019d1c81a764d42b98222c8146b8ce2, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.119616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: WARNING py.warnings [None req-5827c539-bd40-4cce-831a-49f7288944f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:23:24.119616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: warnings.warn(msg) Aug 26 18:23:24.119616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: Aug 26 18:23:24.122074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827c539-bd40-4cce-831a-49f7288944f0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.122861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a0df8533-6095-4cc5-ab5b-86ae5f0c1212 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.124070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a0df8533-6095-4cc5-ab5b-86ae5f0c1212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.137084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 778/1556] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.137911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df8533-6095-4cc5-ab5b-86ae5f0c1212 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.145777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 779/1557] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:24 2022] PUT /identity/v3/projects/c525ea582b264cd5866aa7f403999cba/users/c019d1c81a764d42b98222c8146b8ce2/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:24.146366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f0184-1ed3-4f49-b29b-69b5c2406a7f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.146673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f0184-1ed3-4f49-b29b-69b5c2406a7f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.146951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f0184-1ed3-4f49-b29b-69b5c2406a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.150807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df8533-6095-4cc5-ab5b-86ae5f0c1212 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.167406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9a3f0184-1ed3-4f49-b29b-69b5c2406a7f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.169190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9a3f0184-1ed3-4f49-b29b-69b5c2406a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.213816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:24.218571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caab699-3585-4648-b30e-f51315fa110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.219250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caab699-3585-4648-b30e-f51315fa110d admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.219533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caab699-3585-4648-b30e-f51315fa110d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.219879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caab699-3585-4648-b30e-f51315fa110d admin admin] PATH_INFO: `/v3/projects/e80ad22c76dc477aaa450d15738dc301/users/743d108dcfd844dc8225bb7fd701b00a/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.231621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:24.236341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caab699-3585-4648-b30e-f51315fa110d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80ad22c76dc477aaa450d15738dc301, user_id=743d108dcfd844dc8225bb7fd701b00a, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.239077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caab699-3585-4648-b30e-f51315fa110d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.240513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 780/1558] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.241803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851492c-c816-4e99-a687-796dc1eb38d5 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.242092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851492c-c816-4e99-a687-796dc1eb38d5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.242372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851492c-c816-4e99-a687-796dc1eb38d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.253819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 779/1559] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:24 2022] PUT /identity/v3/projects/e80ad22c76dc477aaa450d15738dc301/users/743d108dcfd844dc8225bb7fd701b00a/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:24.257553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caab699-3585-4648-b30e-f51315fa110d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.262860 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1851492c-c816-4e99-a687-796dc1eb38d5 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.265542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1851492c-c816-4e99-a687-796dc1eb38d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.318342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caab699-3585-4648-b30e-f51315fa110d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.323445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b21112-492f-456f-bb4c-5d4cf82ad7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.324061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b21112-492f-456f-bb4c-5d4cf82ad7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.324340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b21112-492f-456f-bb4c-5d4cf82ad7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.324611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b21112-492f-456f-bb4c-5d4cf82ad7b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.325365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 781/1560] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.325491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b21112-492f-456f-bb4c-5d4cf82ad7b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:23:24.325580 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b21112-492f-456f-bb4c-5d4cf82ad7b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.326770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a933f-e56a-4856-905a-f67773fa8414 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.327056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a933f-e56a-4856-905a-f67773fa8414 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.327245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b21112-492f-456f-bb4c-5d4cf82ad7b4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.327346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a933f-e56a-4856-905a-f67773fa8414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.339322 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 780/1561] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:23:24.340586 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0404b0-bde3-4c86-ae4b-5a70f1000468 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.340912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0404b0-bde3-4c86-ae4b-5a70f1000468 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.341167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0404b0-bde3-4c86-ae4b-5a70f1000468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.351369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-be5a933f-e56a-4856-905a-f67773fa8414 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.352564 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-be5a933f-e56a-4856-905a-f67773fa8414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.360900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 782/1562] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.361260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-dd0404b0-bde3-4c86-ae4b-5a70f1000468 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.362087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aee7d8-d8f7-4b1b-b03d-4f4562838315 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.362373 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aee7d8-d8f7-4b1b-b03d-4f4562838315 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.362505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dd0404b0-bde3-4c86-ae4b-5a70f1000468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.362611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aee7d8-d8f7-4b1b-b03d-4f4562838315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.372880 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 781/1563] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.374085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8f44d-b55b-4c8e-8cc9-9d16b8a10a69 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.374365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8f44d-b55b-4c8e-8cc9-9d16b8a10a69 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.374635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8f44d-b55b-4c8e-8cc9-9d16b8a10a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.383440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a1aee7d8-d8f7-4b1b-b03d-4f4562838315 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.384653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a1aee7d8-d8f7-4b1b-b03d-4f4562838315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.392836 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 783/1564] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.394065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465afe7-a059-41b3-8158-5f71fe87cb8f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.394345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465afe7-a059-41b3-8158-5f71fe87cb8f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.394527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-24a8f44d-b55b-4c8e-8cc9-9d16b8a10a69 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.394649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465afe7-a059-41b3-8158-5f71fe87cb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.395690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-24a8f44d-b55b-4c8e-8cc9-9d16b8a10a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.403905 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 782/1565] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.405074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb1801-3f08-4cec-a680-308c42856f57 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.405452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb1801-3f08-4cec-a680-308c42856f57 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.405726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb1801-3f08-4cec-a680-308c42856f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.419299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9465afe7-a059-41b3-8158-5f71fe87cb8f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.420507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9465afe7-a059-41b3-8158-5f71fe87cb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.428349 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 784/1566] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.429639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d978f-e260-4007-9745-3ef308a89b79 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.429873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d978f-e260-4007-9745-3ef308a89b79 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.430114 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d978f-e260-4007-9745-3ef308a89b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.432843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fecb1801-3f08-4cec-a680-308c42856f57 None None] MFA Rules not processed for user `743d108dcfd844dc8225bb7fd701b00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.434105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fecb1801-3f08-4cec-a680-308c42856f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.449016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-cc4d978f-e260-4007-9745-3ef308a89b79 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.450190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cc4d978f-e260-4007-9745-3ef308a89b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.457953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 785/1567] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.458697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d978f-e260-4007-9745-3ef308a89b79 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.467688 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d978f-e260-4007-9745-3ef308a89b79 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.472861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20a11b-b4e5-4658-9a9c-8159884534af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.473356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20a11b-b4e5-4658-9a9c-8159884534af admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.473671 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20a11b-b4e5-4658-9a9c-8159884534af admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.473943 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20a11b-b4e5-4658-9a9c-8159884534af admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.474576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20a11b-b4e5-4658-9a9c-8159884534af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.476504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20a11b-b4e5-4658-9a9c-8159884534af admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.500245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 783/1568] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.504950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b29ddd-47cd-480a-8b3f-2d02887e9747 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.504950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b29ddd-47cd-480a-8b3f-2d02887e9747 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.504950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b29ddd-47cd-480a-8b3f-2d02887e9747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.514168 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 786/1569] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:24.515031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20a11b-b4e5-4658-9a9c-8159884534af admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.532105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d5b29ddd-47cd-480a-8b3f-2d02887e9747 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.532808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d5b29ddd-47cd-480a-8b3f-2d02887e9747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.583353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20a11b-b4e5-4658-9a9c-8159884534af admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.588007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628cc73-f67e-40bc-b3ef-0d88242c457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.588668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628cc73-f67e-40bc-b3ef-0d88242c457e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.589005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628cc73-f67e-40bc-b3ef-0d88242c457e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.589281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628cc73-f67e-40bc-b3ef-0d88242c457e admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.589962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628cc73-f67e-40bc-b3ef-0d88242c457e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:23:24.590268 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628cc73-f67e-40bc-b3ef-0d88242c457e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.592018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628cc73-f67e-40bc-b3ef-0d88242c457e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.592291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:24.601840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 784/1570] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.602761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b29ddd-47cd-480a-8b3f-2d02887e9747 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.610637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 787/1571] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:23:24.610637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f5c30-bab9-4f20-ab28-7d5511cf89d7 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.610637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f5c30-bab9-4f20-ab28-7d5511cf89d7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.610637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f5c30-bab9-4f20-ab28-7d5511cf89d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.625141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-668f5c30-bab9-4f20-ab28-7d5511cf89d7 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.626340 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-668f5c30-bab9-4f20-ab28-7d5511cf89d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.634302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 788/1572] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.635763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f5c30-bab9-4f20-ab28-7d5511cf89d7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.644841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f5c30-bab9-4f20-ab28-7d5511cf89d7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.649314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96078ae-7012-4c05-99e7-3e922344e84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.650149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96078ae-7012-4c05-99e7-3e922344e84f admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.650149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96078ae-7012-4c05-99e7-3e922344e84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.650410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96078ae-7012-4c05-99e7-3e922344e84f admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.651104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96078ae-7012-4c05-99e7-3e922344e84f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:23:24.651415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96078ae-7012-4c05-99e7-3e922344e84f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.653021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96078ae-7012-4c05-99e7-3e922344e84f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.661908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b29ddd-47cd-480a-8b3f-2d02887e9747 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.664998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 789/1573] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:23:24.665800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4861b88-3264-40e0-9dc0-5a308c9dbf0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.666101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96078ae-7012-4c05-99e7-3e922344e84f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.666529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4861b88-3264-40e0-9dc0-5a308c9dbf0b service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.666748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4861b88-3264-40e0-9dc0-5a308c9dbf0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.666975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4861b88-3264-40e0-9dc0-5a308c9dbf0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.676137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96078ae-7012-4c05-99e7-3e922344e84f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.681115 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4861b88-3264-40e0-9dc0-5a308c9dbf0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.681430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdeaba-123c-47fc-8f58-2574a0e7b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.682080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdeaba-123c-47fc-8f58-2574a0e7b2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.682512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdeaba-123c-47fc-8f58-2574a0e7b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.682620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4861b88-3264-40e0-9dc0-5a308c9dbf0b service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.682788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdeaba-123c-47fc-8f58-2574a0e7b2e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.683437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdeaba-123c-47fc-8f58-2574a0e7b2e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:23:24.683747 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdeaba-123c-47fc-8f58-2574a0e7b2e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.685392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdeaba-123c-47fc-8f58-2574a0e7b2e8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.687091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:24.693045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 785/1574] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:24.693728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4861b88-3264-40e0-9dc0-5a308c9dbf0b service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.699491 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 790/1575] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:23:24.700902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4347add-261f-4d0b-963d-7cffceb9dc4b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.701129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4347add-261f-4d0b-963d-7cffceb9dc4b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.701408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4347add-261f-4d0b-963d-7cffceb9dc4b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.702885 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 791/1576] 10.222.0.45 () {54 vars in 962 bytes} [Fri Aug 26 18:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:23:24.703582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4347add-261f-4d0b-963d-7cffceb9dc4b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.713544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4861b88-3264-40e0-9dc0-5a308c9dbf0b service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.716446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4347add-261f-4d0b-963d-7cffceb9dc4b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.718725 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b36c46-5fed-47ed-a449-8887885691de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.719340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b36c46-5fed-47ed-a449-8887885691de admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.719630 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b36c46-5fed-47ed-a449-8887885691de admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.719939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b36c46-5fed-47ed-a449-8887885691de admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.720632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b36c46-5fed-47ed-a449-8887885691de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.721730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46656966-e8e8-4808-b30d-f028b1e76fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.722326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46656966-e8e8-4808-b30d-f028b1e76fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.722598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46656966-e8e8-4808-b30d-f028b1e76fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.722925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46656966-e8e8-4808-b30d-f028b1e76fa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.723567 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46656966-e8e8-4808-b30d-f028b1e76fa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:23:24.723714 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b36c46-5fed-47ed-a449-8887885691de admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.723892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46656966-e8e8-4808-b30d-f028b1e76fa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.725487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46656966-e8e8-4808-b30d-f028b1e76fa6 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.738887 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 792/1577] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:23:24.741169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46656966-e8e8-4808-b30d-f028b1e76fa6 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.751019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 786/1578] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:24.751019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b36c46-5fed-47ed-a449-8887885691de admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.754525 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46656966-e8e8-4808-b30d-f028b1e76fa6 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.760466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083c43a-6d1e-4043-9af2-3a24b999015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.761201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083c43a-6d1e-4043-9af2-3a24b999015a admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.761480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083c43a-6d1e-4043-9af2-3a24b999015a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.761752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083c43a-6d1e-4043-9af2-3a24b999015a admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.762444 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083c43a-6d1e-4043-9af2-3a24b999015a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.762773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b36c46-5fed-47ed-a449-8887885691de admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.764838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083c43a-6d1e-4043-9af2-3a24b999015a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.767779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38c8df-0492-4e22-bee7-7942d0e71b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.768387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38c8df-0492-4e22-bee7-7942d0e71b3c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.768662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38c8df-0492-4e22-bee7-7942d0e71b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.768994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38c8df-0492-4e22-bee7-7942d0e71b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.769609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38c8df-0492-4e22-bee7-7942d0e71b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:23:24.769909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38c8df-0492-4e22-bee7-7942d0e71b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.771535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38c8df-0492-4e22-bee7-7942d0e71b3c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.792528 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 787/1579] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:23:24.792528 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38c8df-0492-4e22-bee7-7942d0e71b3c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.799395 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38c8df-0492-4e22-bee7-7942d0e71b3c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.805315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dffce8-9e80-448c-8886-21454439ad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.806062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dffce8-9e80-448c-8886-21454439ad23 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.806441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dffce8-9e80-448c-8886-21454439ad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.806795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dffce8-9e80-448c-8886-21454439ad23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.807259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 793/1580] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/projects => generated 393 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:24.807975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083c43a-6d1e-4043-9af2-3a24b999015a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.809321 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dffce8-9e80-448c-8886-21454439ad23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.811299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dffce8-9e80-448c-8886-21454439ad23 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.842040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 788/1581] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:24.846907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1c6c0-3625-4147-9b0a-17a53f925cd4 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.847288 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1c6c0-3625-4147-9b0a-17a53f925cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.847564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1c6c0-3625-4147-9b0a-17a53f925cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.883984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083c43a-6d1e-4043-9af2-3a24b999015a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.893388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fbd1c6c0-3625-4147-9b0a-17a53f925cd4 None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:24.894757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fbd1c6c0-3625-4147-9b0a-17a53f925cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:24.952238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1215f9-4e2b-4770-87f9-0e1839c031ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.953065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1215f9-4e2b-4770-87f9-0e1839c031ff admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.953344 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1215f9-4e2b-4770-87f9-0e1839c031ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.953615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1215f9-4e2b-4770-87f9-0e1839c031ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.954260 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1215f9-4e2b-4770-87f9-0e1839c031ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.956182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1215f9-4e2b-4770-87f9-0e1839c031ff admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:24.972158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 789/1582] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:24.973193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1c6c0-3625-4147-9b0a-17a53f925cd4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.984946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1c6c0-3625-4147-9b0a-17a53f925cd4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:24.989500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf00f5c-06af-4852-bf3d-6cfb51f11eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:24.990088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf00f5c-06af-4852-bf3d-6cfb51f11eae admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:24.990453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf00f5c-06af-4852-bf3d-6cfb51f11eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:24.990729 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf00f5c-06af-4852-bf3d-6cfb51f11eae admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:24.991361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf00f5c-06af-4852-bf3d-6cfb51f11eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:24.991693 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 794/1583] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:24.992625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1215f9-4e2b-4770-87f9-0e1839c031ff admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:24.993395 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf00f5c-06af-4852-bf3d-6cfb51f11eae admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.020208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 790/1584] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:24 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:25.021127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf00f5c-06af-4852-bf3d-6cfb51f11eae admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.033105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:25.053664 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:25.082267 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1215f9-4e2b-4770-87f9-0e1839c031ff admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.110821 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf00f5c-06af-4852-bf3d-6cfb51f11eae admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.115740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce278e-a13b-4218-a2df-b0e7c0c045fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.116358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce278e-a13b-4218-a2df-b0e7c0c045fd admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.116637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce278e-a13b-4218-a2df-b0e7c0c045fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.117019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce278e-a13b-4218-a2df-b0e7c0c045fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.117717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce278e-a13b-4218-a2df-b0e7c0c045fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.119717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce278e-a13b-4218-a2df-b0e7c0c045fd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.157887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 791/1585] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:25 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:25.157887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce278e-a13b-4218-a2df-b0e7c0c045fd admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.160883 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d03c5-d3b6-438c-86a2-d028ddeb770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.162579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d03c5-d3b6-438c-86a2-d028ddeb770b admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.163159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d03c5-d3b6-438c-86a2-d028ddeb770b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.163634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d03c5-d3b6-438c-86a2-d028ddeb770b admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.164616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d03c5-d3b6-438c-86a2-d028ddeb770b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.166650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d03c5-d3b6-438c-86a2-d028ddeb770b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.178244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 795/1586] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:25.179612 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d03c5-d3b6-438c-86a2-d028ddeb770b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.190616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d03c5-d3b6-438c-86a2-d028ddeb770b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.235007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce278e-a13b-4218-a2df-b0e7c0c045fd admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.239795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163ed26-b91d-4993-9c0d-3de4f8531143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.240606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ed26-b91d-4993-9c0d-3de4f8531143 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.240795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ed26-b91d-4993-9c0d-3de4f8531143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.240999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ed26-b91d-4993-9c0d-3de4f8531143 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.241819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163ed26-b91d-4993-9c0d-3de4f8531143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.243910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163ed26-b91d-4993-9c0d-3de4f8531143 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.252852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4bcf-e4b0-4ce3-8a78-8b3e88ec885e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.254053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4bcf-e4b0-4ce3-8a78-8b3e88ec885e admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.254224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4bcf-e4b0-4ce3-8a78-8b3e88ec885e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.254599 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4bcf-e4b0-4ce3-8a78-8b3e88ec885e admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.255394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b4bcf-e4b0-4ce3-8a78-8b3e88ec885e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.257779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b4bcf-e4b0-4ce3-8a78-8b3e88ec885e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.270442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 792/1587] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:25 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:25.271830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163ed26-b91d-4993-9c0d-3de4f8531143 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.286026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 796/1588] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:25 2022] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:25.287095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4bcf-e4b0-4ce3-8a78-8b3e88ec885e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.299042 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4bcf-e4b0-4ce3-8a78-8b3e88ec885e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.304507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ab527-7f8b-4dcb-b3ce-957e4ebfab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.305356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ab527-7f8b-4dcb-b3ce-957e4ebfab4a admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.305807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ab527-7f8b-4dcb-b3ce-957e4ebfab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.306156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ab527-7f8b-4dcb-b3ce-957e4ebfab4a admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.306830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ab527-7f8b-4dcb-b3ce-957e4ebfab4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.309634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ab527-7f8b-4dcb-b3ce-957e4ebfab4a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.335419 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 797/1589] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:25 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:25.336247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ab527-7f8b-4dcb-b3ce-957e4ebfab4a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.348058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ab527-7f8b-4dcb-b3ce-957e4ebfab4a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.353179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2623560-3c2e-4a37-8397-6bdedecc6f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.353449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163ed26-b91d-4993-9c0d-3de4f8531143 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.353829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2623560-3c2e-4a37-8397-6bdedecc6f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.354112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2623560-3c2e-4a37-8397-6bdedecc6f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.354387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2623560-3c2e-4a37-8397-6bdedecc6f41 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.355054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2623560-3c2e-4a37-8397-6bdedecc6f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.357037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2623560-3c2e-4a37-8397-6bdedecc6f41 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.359306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30696de-3aa0-4d14-8960-a48f32fcab71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.360089 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30696de-3aa0-4d14-8960-a48f32fcab71 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.360342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30696de-3aa0-4d14-8960-a48f32fcab71 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.360603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30696de-3aa0-4d14-8960-a48f32fcab71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.379967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:25.383340 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 798/1590] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:25 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:25.384509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2623560-3c2e-4a37-8397-6bdedecc6f41 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.396266 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2623560-3c2e-4a37-8397-6bdedecc6f41 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.401909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b5d75-0cab-4eac-8209-bccc4d5ee18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.402598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b5d75-0cab-4eac-8209-bccc4d5ee18e admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.402884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b5d75-0cab-4eac-8209-bccc4d5ee18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.403206 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b5d75-0cab-4eac-8209-bccc4d5ee18e admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.403868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b5d75-0cab-4eac-8209-bccc4d5ee18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.405936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b5d75-0cab-4eac-8209-bccc4d5ee18e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.423441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30696de-3aa0-4d14-8960-a48f32fcab71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.425184 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30696de-3aa0-4d14-8960-a48f32fcab71 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.432384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 799/1591] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:25 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:25.434865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 793/1592] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:25.435749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30696de-3aa0-4d14-8960-a48f32fcab71 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.436681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b5d75-0cab-4eac-8209-bccc4d5ee18e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.446621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30696de-3aa0-4d14-8960-a48f32fcab71 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.447056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b5d75-0cab-4eac-8209-bccc4d5ee18e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.450673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088fcaa-19ea-4c52-84d3-54eebba8dedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.451284 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088fcaa-19ea-4c52-84d3-54eebba8dedf admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.451583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088fcaa-19ea-4c52-84d3-54eebba8dedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.451840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088fcaa-19ea-4c52-84d3-54eebba8dedf admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.452491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088fcaa-19ea-4c52-84d3-54eebba8dedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.453002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51040a1-b670-49fd-b361-ee04fc62156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.453608 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51040a1-b670-49fd-b361-ee04fc62156c admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.454016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51040a1-b670-49fd-b361-ee04fc62156c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.454138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088fcaa-19ea-4c52-84d3-54eebba8dedf admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.454313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51040a1-b670-49fd-b361-ee04fc62156c admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.455059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51040a1-b670-49fd-b361-ee04fc62156c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.456743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51040a1-b670-49fd-b361-ee04fc62156c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.466116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 794/1593] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:25.466999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088fcaa-19ea-4c52-84d3-54eebba8dedf admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.468253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 800/1594] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:25.471645 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51040a1-b670-49fd-b361-ee04fc62156c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.481774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088fcaa-19ea-4c52-84d3-54eebba8dedf admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.482850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51040a1-b670-49fd-b361-ee04fc62156c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.486753 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41abcdc-63c5-4234-a75c-686d47aa3a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.487396 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41abcdc-63c5-4234-a75c-686d47aa3a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.487639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41abcdc-63c5-4234-a75c-686d47aa3a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.487997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41abcdc-63c5-4234-a75c-686d47aa3a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.488767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41abcdc-63c5-4234-a75c-686d47aa3a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.491878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca9939-ccd8-4f04-a8ae-918253e10b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.491982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41abcdc-63c5-4234-a75c-686d47aa3a5e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.492074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca9939-ccd8-4f04-a8ae-918253e10b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.492074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca9939-ccd8-4f04-a8ae-918253e10b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.492074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca9939-ccd8-4f04-a8ae-918253e10b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.492074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca9939-ccd8-4f04-a8ae-918253e10b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.494474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca9939-ccd8-4f04-a8ae-918253e10b6e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.502384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 795/1595] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:25.503271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41abcdc-63c5-4234-a75c-686d47aa3a5e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.515769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 801/1596] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:25.515769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca9939-ccd8-4f04-a8ae-918253e10b6e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.517661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41abcdc-63c5-4234-a75c-686d47aa3a5e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.522653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36f64e-814e-4a75-887b-76da2566e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.523274 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f64e-814e-4a75-887b-76da2566e8cd admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.523557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f64e-814e-4a75-887b-76da2566e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.523833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f64e-814e-4a75-887b-76da2566e8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.524618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36f64e-814e-4a75-887b-76da2566e8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.526274 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36f64e-814e-4a75-887b-76da2566e8cd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.537699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca9939-ccd8-4f04-a8ae-918253e10b6e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.538967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 796/1597] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:25.539699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36f64e-814e-4a75-887b-76da2566e8cd admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.545452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04465b-8305-422a-b84b-587cfb2cf8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.546312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04465b-8305-422a-b84b-587cfb2cf8ad admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.546654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04465b-8305-422a-b84b-587cfb2cf8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.547008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04465b-8305-422a-b84b-587cfb2cf8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.547960 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04465b-8305-422a-b84b-587cfb2cf8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.550371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04465b-8305-422a-b84b-587cfb2cf8ad admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.551291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36f64e-814e-4a75-887b-76da2566e8cd admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.553528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:25.557370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b8d0-04c2-4b8b-94c2-ec13697b641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.558434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b8d0-04c2-4b8b-94c2-ec13697b641f admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.558882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b8d0-04c2-4b8b-94c2-ec13697b641f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.559162 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b8d0-04c2-4b8b-94c2-ec13697b641f admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.560038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42b8d0-04c2-4b8b-94c2-ec13697b641f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.561707 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42b8d0-04c2-4b8b-94c2-ec13697b641f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.572142 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 802/1598] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:25.573089 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04465b-8305-422a-b84b-587cfb2cf8ad admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.573220 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 797/1599] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:25.574055 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b8d0-04c2-4b8b-94c2-ec13697b641f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.585040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b8d0-04c2-4b8b-94c2-ec13697b641f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.585227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04465b-8305-422a-b84b-587cfb2cf8ad admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.590111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c53e0e-0835-48ba-8baa-39b517422a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.590264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87668f-f180-4f49-a344-9e81a60c9496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.590730 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c53e0e-0835-48ba-8baa-39b517422a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.590865 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87668f-f180-4f49-a344-9e81a60c9496 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.591024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c53e0e-0835-48ba-8baa-39b517422a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.591120 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87668f-f180-4f49-a344-9e81a60c9496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.591282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c53e0e-0835-48ba-8baa-39b517422a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.591388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87668f-f180-4f49-a344-9e81a60c9496 admin admin] PATH_INFO: `/v3/projects/4e1167fc380043c5b04a6746d715003a/users/cde02839effc4354a4fd7e82c1dc8e26/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.591938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c53e0e-0835-48ba-8baa-39b517422a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.593601 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c53e0e-0835-48ba-8baa-39b517422a69 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.607172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 798/1600] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:25.608050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c53e0e-0835-48ba-8baa-39b517422a69 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.608535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87668f-f180-4f49-a344-9e81a60c9496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1167fc380043c5b04a6746d715003a, user_id=cde02839effc4354a4fd7e82c1dc8e26, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.611659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87668f-f180-4f49-a344-9e81a60c9496 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.618769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c53e0e-0835-48ba-8baa-39b517422a69 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.624733 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95fc12-db91-4fbd-8281-01331c660a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.625429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95fc12-db91-4fbd-8281-01331c660a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.626111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95fc12-db91-4fbd-8281-01331c660a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.626395 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95fc12-db91-4fbd-8281-01331c660a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.627250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95fc12-db91-4fbd-8281-01331c660a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.629239 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95fc12-db91-4fbd-8281-01331c660a26 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.632568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 803/1601] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:25 2022] PUT /identity/v3/projects/4e1167fc380043c5b04a6746d715003a/users/cde02839effc4354a4fd7e82c1dc8e26/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:25.634380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87668f-f180-4f49-a344-9e81a60c9496 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.661676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 799/1602] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:25.662688 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95fc12-db91-4fbd-8281-01331c660a26 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.681834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95fc12-db91-4fbd-8281-01331c660a26 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.735574 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87668f-f180-4f49-a344-9e81a60c9496 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.741653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b47c2-4952-466c-9c2a-04fab092d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.742675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b47c2-4952-466c-9c2a-04fab092d449 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.747851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b47c2-4952-466c-9c2a-04fab092d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.748245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b47c2-4952-466c-9c2a-04fab092d449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.749101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b47c2-4952-466c-9c2a-04fab092d449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.750977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b47c2-4952-466c-9c2a-04fab092d449 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.766379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 804/1603] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:25.767762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b47c2-4952-466c-9c2a-04fab092d449 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.779513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c23cb9-65cb-4b07-83f0-dd3b5451e485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.780147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c23cb9-65cb-4b07-83f0-dd3b5451e485 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.780601 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c23cb9-65cb-4b07-83f0-dd3b5451e485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.781537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c23cb9-65cb-4b07-83f0-dd3b5451e485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.782221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c23cb9-65cb-4b07-83f0-dd3b5451e485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.782824 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b47c2-4952-466c-9c2a-04fab092d449 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.784374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c23cb9-65cb-4b07-83f0-dd3b5451e485 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.788897 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577aa41-7d46-4cb7-917b-03b67697df9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.790058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577aa41-7d46-4cb7-917b-03b67697df9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.790557 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577aa41-7d46-4cb7-917b-03b67697df9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.791000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577aa41-7d46-4cb7-917b-03b67697df9f admin admin] PATH_INFO: `/v3/projects/1a8356be55fb4b19a95da8b77c6e2f9a/users/c78657cb0d4144cfaf0a7be1e3388ed0/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.800703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 800/1604] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:25.800703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c23cb9-65cb-4b07-83f0-dd3b5451e485 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.812117 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c23cb9-65cb-4b07-83f0-dd3b5451e485 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.816754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577aa41-7d46-4cb7-917b-03b67697df9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8356be55fb4b19a95da8b77c6e2f9a, user_id=c78657cb0d4144cfaf0a7be1e3388ed0, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.816931 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551a91c-5d00-46c2-bb67-fddd25e73492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.817769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551a91c-5d00-46c2-bb67-fddd25e73492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.818054 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551a91c-5d00-46c2-bb67-fddd25e73492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.818334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551a91c-5d00-46c2-bb67-fddd25e73492 admin admin] PATH_INFO: `/v3/projects/94477a3f4db448a1bc29ff7c8f54fdc9/users/362761a8e75e496a93800d227072963f/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.821233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577aa41-7d46-4cb7-917b-03b67697df9f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.837375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551a91c-5d00-46c2-bb67-fddd25e73492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94477a3f4db448a1bc29ff7c8f54fdc9, user_id=362761a8e75e496a93800d227072963f, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.840422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551a91c-5d00-46c2-bb67-fddd25e73492 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.842450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 805/1605] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:25 2022] PUT /identity/v3/projects/1a8356be55fb4b19a95da8b77c6e2f9a/users/c78657cb0d4144cfaf0a7be1e3388ed0/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:25.844887 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb064c45-52a2-412a-b40c-d829fe710b7d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.845434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb064c45-52a2-412a-b40c-d829fe710b7d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.845781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb064c45-52a2-412a-b40c-d829fe710b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.858255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 801/1606] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:25 2022] PUT /identity/v3/projects/94477a3f4db448a1bc29ff7c8f54fdc9/users/362761a8e75e496a93800d227072963f/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:25.859596 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551a91c-5d00-46c2-bb67-fddd25e73492 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.867109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-eb064c45-52a2-412a-b40c-d829fe710b7d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:25.868177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-eb064c45-52a2-412a-b40c-d829fe710b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:25.901101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:25.943190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 806/1607] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:25.943190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd2c13-59eb-473b-9f89-b6f04a93da84 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.943190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd2c13-59eb-473b-9f89-b6f04a93da84 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.943190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd2c13-59eb-473b-9f89-b6f04a93da84 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.943190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 807/1608] 10.222.0.45 () {54 vars in 912 bytes} [Fri Aug 26 18:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:23:25.948292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd2c13-59eb-473b-9f89-b6f04a93da84 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:25.958311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551a91c-5d00-46c2-bb67-fddd25e73492 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.964686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d30cd-695b-462f-93c1-f7b9662989d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.964960 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd2c13-59eb-473b-9f89-b6f04a93da84 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:25.965698 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d30cd-695b-462f-93c1-f7b9662989d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.966045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d30cd-695b-462f-93c1-f7b9662989d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.966464 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d30cd-695b-462f-93c1-f7b9662989d0 admin admin] PATH_INFO: `/v3/projects/e08fd105aec0470083ba4e31980144ca/users/1004e825774c48b59a8c238e1ce4c5d7/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.971926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17db55d-8d11-4857-a454-393a551b23a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:25.972659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db55d-8d11-4857-a454-393a551b23a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:25.973061 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db55d-8d11-4857-a454-393a551b23a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:25.973253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db55d-8d11-4857-a454-393a551b23a7 admin admin] PATH_INFO: `/v3/projects/dd848c03af214b948ab01dee79cb7c34/users/85158030e4904eab877dc5da3a6bbd33/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:25.985996 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d30cd-695b-462f-93c1-f7b9662989d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08fd105aec0470083ba4e31980144ca, user_id=1004e825774c48b59a8c238e1ce4c5d7, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:25.988828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d30cd-695b-462f-93c1-f7b9662989d0 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:25.995913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17db55d-8d11-4857-a454-393a551b23a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd848c03af214b948ab01dee79cb7c34, user_id=85158030e4904eab877dc5da3a6bbd33, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:26.000594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17db55d-8d11-4857-a454-393a551b23a7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:26.007234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 802/1609] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:25 2022] PUT /identity/v3/projects/e08fd105aec0470083ba4e31980144ca/users/1004e825774c48b59a8c238e1ce4c5d7/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:26.008317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d30cd-695b-462f-93c1-f7b9662989d0 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:26.027396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 808/1610] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:25 2022] PUT /identity/v3/projects/dd848c03af214b948ab01dee79cb7c34/users/85158030e4904eab877dc5da3a6bbd33/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:26.028947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035c66b-9719-4d92-abf0-7dd4a50ae5f1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:26.029387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035c66b-9719-4d92-abf0-7dd4a50ae5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:26.029761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035c66b-9719-4d92-abf0-7dd4a50ae5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:26.057843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2035c66b-9719-4d92-abf0-7dd4a50ae5f1 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:26.059506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2035c66b-9719-4d92-abf0-7dd4a50ae5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:26.080765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:26.099415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d30cd-695b-462f-93c1-f7b9662989d0 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:26.161095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 809/1611] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:26.164145 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee895fd3-5649-45a9-8558-9e2486ab1b69 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:26.164637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee895fd3-5649-45a9-8558-9e2486ab1b69 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:26.164940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee895fd3-5649-45a9-8558-9e2486ab1b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:26.181411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7b78f-6c78-456e-9dc6-a1dd2858bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:26.182474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7b78f-6c78-456e-9dc6-a1dd2858bd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:26.184469 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7b78f-6c78-456e-9dc6-a1dd2858bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:26.184856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7b78f-6c78-456e-9dc6-a1dd2858bd5c admin admin] PATH_INFO: `/v3/projects/80a905d4d8b140bf8a30530e403d2209/users/a18d614cf7fc4aa6b12c295bbf1308b4/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:26.202841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ee895fd3-5649-45a9-8558-9e2486ab1b69 None None] MFA Rules not processed for user `362761a8e75e496a93800d227072963f`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:26.205053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ee895fd3-5649-45a9-8558-9e2486ab1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:26.208476 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7b78f-6c78-456e-9dc6-a1dd2858bd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a905d4d8b140bf8a30530e403d2209, user_id=a18d614cf7fc4aa6b12c295bbf1308b4, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:26.211825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7b78f-6c78-456e-9dc6-a1dd2858bd5c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:26.233160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 803/1612] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:26 2022] PUT /identity/v3/projects/80a905d4d8b140bf8a30530e403d2209/users/a18d614cf7fc4aa6b12c295bbf1308b4/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:26.245912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd522e5-5927-425b-8393-b571c7a3eefd None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:26.245912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd522e5-5927-425b-8393-b571c7a3eefd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:26.245912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd522e5-5927-425b-8393-b571c7a3eefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:26.270865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0bd522e5-5927-425b-8393-b571c7a3eefd None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:26.272268 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0bd522e5-5927-425b-8393-b571c7a3eefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:26.291414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 810/1613] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:26.292632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee895fd3-5649-45a9-8558-9e2486ab1b69 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:26.294606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ee895fd3-5649-45a9-8558-9e2486ab1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:26.312460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:26.376558 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 804/1614] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:23:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:26.377517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea092a-b1e6-415f-93df-1aa4cbcf0104 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:26.377803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea092a-b1e6-415f-93df-1aa4cbcf0104 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:26.378078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea092a-b1e6-415f-93df-1aa4cbcf0104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:26.380134 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee895fd3-5649-45a9-8558-9e2486ab1b69 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:26.413209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-dcea092a-b1e6-415f-93df-1aa4cbcf0104 None None] MFA Rules not processed for user `1004e825774c48b59a8c238e1ce4c5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:26.415172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dcea092a-b1e6-415f-93df-1aa4cbcf0104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:26.449236 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0ccc2-382b-4e71-b230-3424e712f931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:26.450433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0ccc2-382b-4e71-b230-3424e712f931 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:26.450718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0ccc2-382b-4e71-b230-3424e712f931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:26.450995 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0ccc2-382b-4e71-b230-3424e712f931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:26.489558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:26.529126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 805/1615] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:26.530543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0fd2-e684-4fe9-864f-33863ad62551 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:26.531088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0fd2-e684-4fe9-864f-33863ad62551 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:26.531457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0fd2-e684-4fe9-864f-33863ad62551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:26.552259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9ebc0fd2-e684-4fe9-864f-33863ad62551 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:26.553594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9ebc0fd2-e684-4fe9-864f-33863ad62551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:26.571705 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0ccc2-382b-4e71-b230-3424e712f931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:26.573397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0ccc2-382b-4e71-b230-3424e712f931 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:26.585837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 811/1616] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:26.586550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0ccc2-382b-4e71-b230-3424e712f931 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:26.607483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0ccc2-382b-4e71-b230-3424e712f931 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:26.614137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e629-4c19-426d-82bc-e65d79303632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:26.615010 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e629-4c19-426d-82bc-e65d79303632 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:26.615345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e629-4c19-426d-82bc-e65d79303632 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:26.615728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e629-4c19-426d-82bc-e65d79303632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:26.632483 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 806/1617] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:26.634303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361beba-5b4e-49df-9a15-29db2f58ebbd None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:26.634807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361beba-5b4e-49df-9a15-29db2f58ebbd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:26.635911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361beba-5b4e-49df-9a15-29db2f58ebbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:26.641124 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4e629-4c19-426d-82bc-e65d79303632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:26.642747 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4e629-4c19-426d-82bc-e65d79303632 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:26.654391 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 812/1618] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:26.655054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e629-4c19-426d-82bc-e65d79303632 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:26.665979 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e629-4c19-426d-82bc-e65d79303632 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:26.673383 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de560bd-7a3c-43c5-89fb-02f9654da5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:26.674019 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de560bd-7a3c-43c5-89fb-02f9654da5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:26.674397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de560bd-7a3c-43c5-89fb-02f9654da5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:26.674673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de560bd-7a3c-43c5-89fb-02f9654da5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:26.675325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de560bd-7a3c-43c5-89fb-02f9654da5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:26.675444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9361beba-5b4e-49df-9a15-29db2f58ebbd None None] MFA Rules not processed for user `a18d614cf7fc4aa6b12c295bbf1308b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:26.676855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9361beba-5b4e-49df-9a15-29db2f58ebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:26.677297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de560bd-7a3c-43c5-89fb-02f9654da5a0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:26.725658 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 813/1619] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:26 2022] POST /identity/v3/projects => generated 363 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:26.726582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de560bd-7a3c-43c5-89fb-02f9654da5a0 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:26.772251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:26.881733 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 807/1620] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:26.881733 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361beba-5b4e-49df-9a15-29db2f58ebbd None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:26.882368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de560bd-7a3c-43c5-89fb-02f9654da5a0 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:26.882368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0a6b8-d9e8-4fe7-884f-44f42246654e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:26.882368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0a6b8-d9e8-4fe7-884f-44f42246654e service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:26.882368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0a6b8-d9e8-4fe7-884f-44f42246654e service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:26.882884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0a6b8-d9e8-4fe7-884f-44f42246654e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:26.882987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361beba-5b4e-49df-9a15-29db2f58ebbd None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:27.046854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0a6b8-d9e8-4fe7-884f-44f42246654e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:27.048595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0a6b8-d9e8-4fe7-884f-44f42246654e service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:27.051078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf073-7e11-476a-adfb-500c1c392c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:27.051782 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf073-7e11-476a-adfb-500c1c392c1b admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:27.052196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf073-7e11-476a-adfb-500c1c392c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:27.052685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf073-7e11-476a-adfb-500c1c392c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:27.053438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faf073-7e11-476a-adfb-500c1c392c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:27.055669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faf073-7e11-476a-adfb-500c1c392c1b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:27.064351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 814/1621] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:27.065725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0a6b8-d9e8-4fe7-884f-44f42246654e service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:27.098231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 808/1622] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:26 2022] POST /identity/v3/projects => generated 371 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:27.101756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf073-7e11-476a-adfb-500c1c392c1b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:27.110852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:27.167630 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0a6b8-d9e8-4fe7-884f-44f42246654e service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:27.214145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf073-7e11-476a-adfb-500c1c392c1b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:27.221709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c069a1-c1fc-4bc8-bb40-51fab04005c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:27.222353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c069a1-c1fc-4bc8-bb40-51fab04005c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:27.222635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c069a1-c1fc-4bc8-bb40-51fab04005c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:27.222908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c069a1-c1fc-4bc8-bb40-51fab04005c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:27.224167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c069a1-c1fc-4bc8-bb40-51fab04005c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:27.226703 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c069a1-c1fc-4bc8-bb40-51fab04005c5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:27.264693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 809/1623] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:27 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:27.268823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee2a8d-1a5b-468a-be5a-8def6c74fe43 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:27.269428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee2a8d-1a5b-468a-be5a-8def6c74fe43 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:27.269715 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee2a8d-1a5b-468a-be5a-8def6c74fe43 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:27.271544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 810/1624] 10.222.0.45 () {54 vars in 962 bytes} [Fri Aug 26 18:23:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:23:27.272118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaa713-a401-4212-915d-dfb569e551d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:27.272266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee2a8d-1a5b-468a-be5a-8def6c74fe43 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:27.272774 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaa713-a401-4212-915d-dfb569e551d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:27.273113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaa713-a401-4212-915d-dfb569e551d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:27.273389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaa713-a401-4212-915d-dfb569e551d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:27.290325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee2a8d-1a5b-468a-be5a-8def6c74fe43 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:27.296536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaa713-a401-4212-915d-dfb569e551d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:27.296823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1cfee-8197-4b48-8747-a032e45dd4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:27.297577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1cfee-8197-4b48-8747-a032e45dd4fd admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:27.297865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1cfee-8197-4b48-8747-a032e45dd4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:27.298030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaa713-a401-4212-915d-dfb569e551d8 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:27.298127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1cfee-8197-4b48-8747-a032e45dd4fd admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:27.298775 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1cfee-8197-4b48-8747-a032e45dd4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:27.301674 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1cfee-8197-4b48-8747-a032e45dd4fd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:27.337408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 815/1625] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:27.338346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaa713-a401-4212-915d-dfb569e551d8 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:27.342353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 811/1626] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:27 2022] POST /identity/v3/users => generated 292 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:27.350364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932175-04f9-4c52-98e6-ba5e049e97f7 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:27.350673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932175-04f9-4c52-98e6-ba5e049e97f7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:27.350928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932175-04f9-4c52-98e6-ba5e049e97f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:27.366779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaa713-a401-4212-915d-dfb569e551d8 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:27.382869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-19932175-04f9-4c52-98e6-ba5e049e97f7 None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:27.384177 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-19932175-04f9-4c52-98e6-ba5e049e97f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:27.385918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa6c0a-1e86-4a8b-92a6-941b448b0813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:27.388175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa6c0a-1e86-4a8b-92a6-941b448b0813 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:27.388463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa6c0a-1e86-4a8b-92a6-941b448b0813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:27.391026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa6c0a-1e86-4a8b-92a6-941b448b0813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:27.391733 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa6c0a-1e86-4a8b-92a6-941b448b0813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:27.397650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa6c0a-1e86-4a8b-92a6-941b448b0813 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:27.420940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 816/1627] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:27.426280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa6c0a-1e86-4a8b-92a6-941b448b0813 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:27.448267 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa6c0a-1e86-4a8b-92a6-941b448b0813 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:27.462710 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869d25c-5aef-4d5f-9e51-cfbf76fec97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:27.464600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869d25c-5aef-4d5f-9e51-cfbf76fec97e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:27.468837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869d25c-5aef-4d5f-9e51-cfbf76fec97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:27.469169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869d25c-5aef-4d5f-9e51-cfbf76fec97e admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:27.472275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869d25c-5aef-4d5f-9e51-cfbf76fec97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:27.481620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869d25c-5aef-4d5f-9e51-cfbf76fec97e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:27.518744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 817/1628] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:27.519710 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869d25c-5aef-4d5f-9e51-cfbf76fec97e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:27.525861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:27.548202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869d25c-5aef-4d5f-9e51-cfbf76fec97e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:27.559276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bd67b-cf7c-43b9-bd27-e85a428e5e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:27.560047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bd67b-cf7c-43b9-bd27-e85a428e5e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:27.560336 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bd67b-cf7c-43b9-bd27-e85a428e5e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:27.560615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bd67b-cf7c-43b9-bd27-e85a428e5e0f admin admin] PATH_INFO: `/v3/projects/7ba06b29b8cd4d7fb1c4fc20fd101b3e/users/d5410545c5e043e4aba606b4a4be8132/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:27.579959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bd67b-cf7c-43b9-bd27-e85a428e5e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba06b29b8cd4d7fb1c4fc20fd101b3e, user_id=d5410545c5e043e4aba606b4a4be8132, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:27.583060 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bd67b-cf7c-43b9-bd27-e85a428e5e0f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:27.595651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 812/1629] 10.222.0.45 () {58 vars in 1059 bytes} [Fri Aug 26 18:23:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:27.596349 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19932175-04f9-4c52-98e6-ba5e049e97f7 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:27.615143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 818/1630] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:27 2022] PUT /identity/v3/projects/7ba06b29b8cd4d7fb1c4fc20fd101b3e/users/d5410545c5e043e4aba606b4a4be8132/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:27.617194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bd67b-cf7c-43b9-bd27-e85a428e5e0f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:27.633928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19932175-04f9-4c52-98e6-ba5e049e97f7 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:27.823693 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bd67b-cf7c-43b9-bd27-e85a428e5e0f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:27.825942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad1650-ae31-4bc3-bc18-2f1a2e74c86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:27.826866 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad1650-ae31-4bc3-bc18-2f1a2e74c86f admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:27.827189 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad1650-ae31-4bc3-bc18-2f1a2e74c86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:27.827522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad1650-ae31-4bc3-bc18-2f1a2e74c86f admin admin] PATH_INFO: `/v3/projects/b8a289b8eab74c849b4fe2e85f4e95de/users/289ac45029634f61875bf21d67efa8fd/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:27.839018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a6ea2-7767-43da-9db0-947968fb0d19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:27.840069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a6ea2-7767-43da-9db0-947968fb0d19 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:27.840202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a6ea2-7767-43da-9db0-947968fb0d19 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:27.840426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a6ea2-7767-43da-9db0-947968fb0d19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:27.865737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad1650-ae31-4bc3-bc18-2f1a2e74c86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a289b8eab74c849b4fe2e85f4e95de, user_id=289ac45029634f61875bf21d67efa8fd, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:27.875425 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad1650-ae31-4bc3-bc18-2f1a2e74c86f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:27.908063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 813/1631] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:27 2022] PUT /identity/v3/projects/b8a289b8eab74c849b4fe2e85f4e95de/users/289ac45029634f61875bf21d67efa8fd/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:27.909231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad1650-ae31-4bc3-bc18-2f1a2e74c86f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:27.928692 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:28.007282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a6ea2-7767-43da-9db0-947968fb0d19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:28.008952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a6ea2-7767-43da-9db0-947968fb0d19 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:28.032264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 819/1632] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:28.034592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a6ea2-7767-43da-9db0-947968fb0d19 service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:28.062406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a6ea2-7767-43da-9db0-947968fb0d19 service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:28.064158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad1650-ae31-4bc3-bc18-2f1a2e74c86f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:28.076694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f113e2-f5f4-4c7d-880a-17551d51e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:28.077885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f113e2-f5f4-4c7d-880a-17551d51e2cb admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:28.077885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f113e2-f5f4-4c7d-880a-17551d51e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:28.077885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f113e2-f5f4-4c7d-880a-17551d51e2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:28.078687 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f113e2-f5f4-4c7d-880a-17551d51e2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:28.080323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f113e2-f5f4-4c7d-880a-17551d51e2cb admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:28.086766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c18292-8411-43c7-ad88-24c72a130d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:28.087741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c18292-8411-43c7-ad88-24c72a130d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:28.091069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c18292-8411-43c7-ad88-24c72a130d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:28.091567 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c18292-8411-43c7-ad88-24c72a130d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:28.092579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c18292-8411-43c7-ad88-24c72a130d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:28.094674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c18292-8411-43c7-ad88-24c72a130d1d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:28.105526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 814/1633] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:28.107371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 820/1634] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:28.114049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f113e2-f5f4-4c7d-880a-17551d51e2cb admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:28.122020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c18292-8411-43c7-ad88-24c72a130d1d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:28.141238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f113e2-f5f4-4c7d-880a-17551d51e2cb admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:28.150930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c18292-8411-43c7-ad88-24c72a130d1d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:28.154560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487fd1d-4c7c-4ebf-92d6-83d901c40403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:28.155291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487fd1d-4c7c-4ebf-92d6-83d901c40403 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:28.155567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487fd1d-4c7c-4ebf-92d6-83d901c40403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:28.155845 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487fd1d-4c7c-4ebf-92d6-83d901c40403 admin admin] PATH_INFO: `/v3/projects/b8a289b8eab74c849b4fe2e85f4e95de/users/289ac45029634f61875bf21d67efa8fd/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:28.161841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2690d-ec2d-441e-8dad-af310f309735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:28.162595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2690d-ec2d-441e-8dad-af310f309735 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:28.163881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2690d-ec2d-441e-8dad-af310f309735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:28.164255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2690d-ec2d-441e-8dad-af310f309735 admin admin] PATH_INFO: `/v3/projects/7ba06b29b8cd4d7fb1c4fc20fd101b3e/users/d5410545c5e043e4aba606b4a4be8132/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:28.168851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2690d-ec2d-441e-8dad-af310f309735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba06b29b8cd4d7fb1c4fc20fd101b3e, user_id=d5410545c5e043e4aba606b4a4be8132, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:28.174455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2690d-ec2d-441e-8dad-af310f309735 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:28.175566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487fd1d-4c7c-4ebf-92d6-83d901c40403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a289b8eab74c849b4fe2e85f4e95de, user_id=289ac45029634f61875bf21d67efa8fd, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:28.185509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487fd1d-4c7c-4ebf-92d6-83d901c40403 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:28.203086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 821/1635] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:28 2022] PUT /identity/v3/projects/7ba06b29b8cd4d7fb1c4fc20fd101b3e/users/d5410545c5e043e4aba606b4a4be8132/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:28.214055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f2b2f-8e39-4ed3-b198-46c14d878ae7 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:28.214413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f2b2f-8e39-4ed3-b198-46c14d878ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:28.214758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f2b2f-8e39-4ed3-b198-46c14d878ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:28.226983 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 815/1636] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:28 2022] PUT /identity/v3/projects/b8a289b8eab74c849b4fe2e85f4e95de/users/289ac45029634f61875bf21d67efa8fd/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:28.237180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a44c-38ef-4759-a900-5b8c0319bec7 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:28.237823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a44c-38ef-4759-a900-5b8c0319bec7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:28.238301 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a44c-38ef-4759-a900-5b8c0319bec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:28.278028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2f8f2b2f-8e39-4ed3-b198-46c14d878ae7 None None] MFA Rules not processed for user `d5410545c5e043e4aba606b4a4be8132`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:28.279274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2f8f2b2f-8e39-4ed3-b198-46c14d878ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:28.300275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8d64a44c-38ef-4759-a900-5b8c0319bec7 None None] MFA Rules not processed for user `289ac45029634f61875bf21d67efa8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:28.301906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8d64a44c-38ef-4759-a900-5b8c0319bec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:28.381752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:28.446518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 822/1637] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:28.460101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f2b2f-8e39-4ed3-b198-46c14d878ae7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:28.474149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 816/1638] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:23:28.548966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f2b2f-8e39-4ed3-b198-46c14d878ae7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:28.552799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576fe10-c4da-415d-8229-f181f399b599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:28.553456 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576fe10-c4da-415d-8229-f181f399b599 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:28.553774 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576fe10-c4da-415d-8229-f181f399b599 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:28.554045 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576fe10-c4da-415d-8229-f181f399b599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:28.564982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576fe10-c4da-415d-8229-f181f399b599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:28.566487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576fe10-c4da-415d-8229-f181f399b599 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:28.579283 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 823/1639] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:28.617681 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a44c-38ef-4759-a900-5b8c0319bec7 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:28.633280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a44c-38ef-4759-a900-5b8c0319bec7 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:28.637220 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce8507-320a-4dc9-8ba7-3daa461921a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:28.637828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce8507-320a-4dc9-8ba7-3daa461921a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:28.638124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce8507-320a-4dc9-8ba7-3daa461921a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:28.638398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce8507-320a-4dc9-8ba7-3daa461921a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:28.657564 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ab43-a55b-476b-ba61-35ff1758b30e None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:28.657853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ab43-a55b-476b-ba61-35ff1758b30e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:28.658132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ab43-a55b-476b-ba61-35ff1758b30e None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:28.659873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 824/1640] 10.222.0.45 () {54 vars in 912 bytes} [Fri Aug 26 18:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:23:28.671150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab1bfd-f38a-45df-911d-13ff9ec62206 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:28.671432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab1bfd-f38a-45df-911d-13ff9ec62206 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:28.671706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab1bfd-f38a-45df-911d-13ff9ec62206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:28.690215 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce8507-320a-4dc9-8ba7-3daa461921a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:28.691688 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce8507-320a-4dc9-8ba7-3daa461921a0 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:28.719008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4bab1bfd-f38a-45df-911d-13ff9ec62206 None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:28.726523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4bab1bfd-f38a-45df-911d-13ff9ec62206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:28.742264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 817/1641] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:28.783943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce8507-320a-4dc9-8ba7-3daa461921a0 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:28.801455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce8507-320a-4dc9-8ba7-3daa461921a0 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:28.812797 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aceab0-5853-4b4c-980e-5ec7fa84e561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:28.813436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aceab0-5853-4b4c-980e-5ec7fa84e561 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:28.813722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aceab0-5853-4b4c-980e-5ec7fa84e561 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:28.814003 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aceab0-5853-4b4c-980e-5ec7fa84e561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:28.870874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:28.933149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aceab0-5853-4b4c-980e-5ec7fa84e561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:28.934825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aceab0-5853-4b4c-980e-5ec7fa84e561 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:28.936284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 825/1642] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:23:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:23:28.948174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 818/1643] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:28.958862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab1bfd-f38a-45df-911d-13ff9ec62206 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:28.976745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab1bfd-f38a-45df-911d-13ff9ec62206 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:28.981104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5f79f-ec9d-4c7a-9aa0-39473e83f68b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:28.981738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5f79f-ec9d-4c7a-9aa0-39473e83f68b service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:28.982019 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5f79f-ec9d-4c7a-9aa0-39473e83f68b service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:28.982297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5f79f-ec9d-4c7a-9aa0-39473e83f68b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:29.104595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5f79f-ec9d-4c7a-9aa0-39473e83f68b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:29.106065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5f79f-ec9d-4c7a-9aa0-39473e83f68b service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:29.127835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 826/1644] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:29.402029 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aceab0-5853-4b4c-980e-5ec7fa84e561 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:29.421814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aceab0-5853-4b4c-980e-5ec7fa84e561 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:29.432551 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688c485-5243-4e9c-8c1b-a2b1a5eb52ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:29.436111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688c485-5243-4e9c-8c1b-a2b1a5eb52ab service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:29.436408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688c485-5243-4e9c-8c1b-a2b1a5eb52ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:29.436692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688c485-5243-4e9c-8c1b-a2b1a5eb52ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:29.472590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688c485-5243-4e9c-8c1b-a2b1a5eb52ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:29.476348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688c485-5243-4e9c-8c1b-a2b1a5eb52ab service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:29.516397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 819/1645] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:31.561680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5f79f-ec9d-4c7a-9aa0-39473e83f68b service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:31.824044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5f79f-ec9d-4c7a-9aa0-39473e83f68b service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:31.850910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:31.850910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:31.851833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:31.851833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] PATH_INFO: `/v3/users/743d108dcfd844dc8225bb7fd701b00a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:31.857613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=743d108dcfd844dc8225bb7fd701b00a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:31.870329 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: WARNING py.warnings [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:23:31.870329 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: warnings.warn(msg) Aug 26 18:23:31.870329 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: Aug 26 18:23:31.876012 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:32.112812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743d108dcfd844dc8225bb7fd701b00a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:32.113492 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743d108dcfd844dc8225bb7fd701b00a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:32.131197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743d108dcfd844dc8225bb7fd701b00a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:32.164675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743d108dcfd844dc8225bb7fd701b00a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:32.165868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743d108dcfd844dc8225bb7fd701b00a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:32.187926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:32.226408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 827/1646] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:23:31 2022] DELETE /identity/v3/users/743d108dcfd844dc8225bb7fd701b00a => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:32.233193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25707fa7-a354-470d-a154-d87c9b8d0b12 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:32.233748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25707fa7-a354-470d-a154-d87c9b8d0b12 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:32.233748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25707fa7-a354-470d-a154-d87c9b8d0b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:32.277223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-25707fa7-a354-470d-a154-d87c9b8d0b12 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:32.280898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-25707fa7-a354-470d-a154-d87c9b8d0b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:32.478725 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 820/1647] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:32.499479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:32.503659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:32.702772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b0412-6646-44ec-bd3b-045392484343 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:32.706673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a51be7-fa9e-4957-b3f3-38dfb517a122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:32.707447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a51be7-fa9e-4957-b3f3-38dfb517a122 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:32.707797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a51be7-fa9e-4957-b3f3-38dfb517a122 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:32.708146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a51be7-fa9e-4957-b3f3-38dfb517a122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:32.718602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a51be7-fa9e-4957-b3f3-38dfb517a122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:32.720324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a51be7-fa9e-4957-b3f3-38dfb517a122 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:32.732686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 828/1648] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:34.771804 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25707fa7-a354-470d-a154-d87c9b8d0b12 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:34.775595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-25707fa7-a354-470d-a154-d87c9b8d0b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:34.821861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25707fa7-a354-470d-a154-d87c9b8d0b12 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:34.856183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:34.857119 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:34.857565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:34.858290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] PATH_INFO: `/v3/projects/e80ad22c76dc477aaa450d15738dc301` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:34.859630 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80ad22c76dc477aaa450d15738dc301)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:34.861640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: WARNING py.warnings [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 18:23:34.861640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: warnings.warn(msg) Aug 26 18:23:34.861640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: Aug 26 18:23:34.863228 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:34.906396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791794f-e4da-4963-aab6-7d96cb888551 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:34.906986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791794f-e4da-4963-aab6-7d96cb888551 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:34.906986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791794f-e4da-4963-aab6-7d96cb888551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:34.954259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:34.975713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80ad22c76dc477aaa450d15738dc301', 'request_id': 'req-f5eb2c6f-12b9-40a0-a606-ae090472cc92'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:34.980145 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6791794f-e4da-4963-aab6-7d96cb888551 None None] MFA Rules not processed for user `c019d1c81a764d42b98222c8146b8ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:34.981537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6791794f-e4da-4963-aab6-7d96cb888551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:34.993122 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80ad22c76dc477aaa450d15738dc301', 'request_id': 'req-f5eb2c6f-12b9-40a0-a606-ae090472cc92'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:35.019700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80ad22c76dc477aaa450d15738dc301', 'request_id': 'req-f5eb2c6f-12b9-40a0-a606-ae090472cc92'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:35.036043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] The token cache is being invalidate because project e80ad22c76dc477aaa450d15738dc301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:23:35.036344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:35.037380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f5eb2c6f-12b9-40a0-a606-ae090472cc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:35.039459 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 821/1649] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:23:34 2022] DELETE /identity/v3/projects/e80ad22c76dc477aaa450d15738dc301 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:35.044946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78383d28-5b2c-4bec-a3ca-a972bf1d1ada None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:35.046202 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78383d28-5b2c-4bec-a3ca-a972bf1d1ada None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:35.047118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78383d28-5b2c-4bec-a3ca-a972bf1d1ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:35.091868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-78383d28-5b2c-4bec-a3ca-a972bf1d1ada None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:35.093380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-78383d28-5b2c-4bec-a3ca-a972bf1d1ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:35.149185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 829/1650] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:35.151754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38c1ed-2395-4ecd-b073-7b626b53d43a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:35.152041 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38c1ed-2395-4ecd-b073-7b626b53d43a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:35.152315 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38c1ed-2395-4ecd-b073-7b626b53d43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:35.208937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-be38c1ed-2395-4ecd-b073-7b626b53d43a None None] MFA Rules not processed for user `c019d1c81a764d42b98222c8146b8ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:35.210159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-be38c1ed-2395-4ecd-b073-7b626b53d43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:35.226930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 830/1651] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:35.239179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38c1ed-2395-4ecd-b073-7b626b53d43a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:35.242281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-be38c1ed-2395-4ecd-b073-7b626b53d43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:35.247551 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 822/1652] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:35.256161 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261ab42-5fdc-4900-9b69-3024ca13b030 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:35.256451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261ab42-5fdc-4900-9b69-3024ca13b030 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:35.256755 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261ab42-5fdc-4900-9b69-3024ca13b030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:35.301298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d261ab42-5fdc-4900-9b69-3024ca13b030 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:35.302354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d261ab42-5fdc-4900-9b69-3024ca13b030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:35.327874 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 823/1653] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:35.328862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261ab42-5fdc-4900-9b69-3024ca13b030 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:35.362149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261ab42-5fdc-4900-9b69-3024ca13b030 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:35.377711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7753c1-ef0d-40ad-b58f-cbed8922b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:35.378351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7753c1-ef0d-40ad-b58f-cbed8922b2cf admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:35.378793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7753c1-ef0d-40ad-b58f-cbed8922b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:35.379069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7753c1-ef0d-40ad-b58f-cbed8922b2cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:35.380192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7753c1-ef0d-40ad-b58f-cbed8922b2cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:23:35.380503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7753c1-ef0d-40ad-b58f-cbed8922b2cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:35.382179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7753c1-ef0d-40ad-b58f-cbed8922b2cf admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:35.454681 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 824/1654] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:23:35.459590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7753c1-ef0d-40ad-b58f-cbed8922b2cf admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:35.464916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38c1ed-2395-4ecd-b073-7b626b53d43a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:35.483321 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7753c1-ef0d-40ad-b58f-cbed8922b2cf admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:35.500284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512b8f-b93f-4f0c-b5d4-20035c6e86c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:35.501185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512b8f-b93f-4f0c-b5d4-20035c6e86c6 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:35.501599 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512b8f-b93f-4f0c-b5d4-20035c6e86c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:35.501999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512b8f-b93f-4f0c-b5d4-20035c6e86c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:35.516332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643f6a5-2f3e-49f0-9e59-777a5cd6b3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:35.517556 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643f6a5-2f3e-49f0-9e59-777a5cd6b3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:35.517860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643f6a5-2f3e-49f0-9e59-777a5cd6b3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:35.518128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643f6a5-2f3e-49f0-9e59-777a5cd6b3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:35.519597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643f6a5-2f3e-49f0-9e59-777a5cd6b3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:35.521786 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643f6a5-2f3e-49f0-9e59-777a5cd6b3d9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:35.523906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36512b8f-b93f-4f0c-b5d4-20035c6e86c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:35.526473 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36512b8f-b93f-4f0c-b5d4-20035c6e86c6 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:35.530856 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:35.567006 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 831/1655] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:23:35.603061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 825/1656] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:35 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:35.607276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512b8f-b93f-4f0c-b5d4-20035c6e86c6 service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:35.628092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512b8f-b93f-4f0c-b5d4-20035c6e86c6 service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:35.747019 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f8aa9-20b0-4c5b-bc35-ceb3d8db5bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:35.747779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f8aa9-20b0-4c5b-bc35-ceb3d8db5bfe admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:35.748061 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f8aa9-20b0-4c5b-bc35-ceb3d8db5bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:35.748331 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f8aa9-20b0-4c5b-bc35-ceb3d8db5bfe admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:35.749016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f8aa9-20b0-4c5b-bc35-ceb3d8db5bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:35.753871 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f8aa9-20b0-4c5b-bc35-ceb3d8db5bfe admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:35.820780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 832/1657] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:35 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:35.824897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643f6a5-2f3e-49f0-9e59-777a5cd6b3d9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:35.835287 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643f6a5-2f3e-49f0-9e59-777a5cd6b3d9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:35.850871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3276c3-9706-4b89-9163-ccf390d3f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:35.851515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3276c3-9706-4b89-9163-ccf390d3f6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:35.851852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3276c3-9706-4b89-9163-ccf390d3f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:35.852149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3276c3-9706-4b89-9163-ccf390d3f6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:35.852875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3276c3-9706-4b89-9163-ccf390d3f6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:35.854765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3276c3-9706-4b89-9163-ccf390d3f6aa admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:35.902147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f8aa9-20b0-4c5b-bc35-ceb3d8db5bfe admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:35.903490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 826/1658] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:35.912966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f8aa9-20b0-4c5b-bc35-ceb3d8db5bfe admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:35.918730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d67154-f002-4e37-a824-2f1d9c4b1ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:35.919631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d67154-f002-4e37-a824-2f1d9c4b1ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:35.920103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d67154-f002-4e37-a824-2f1d9c4b1ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:35.920544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d67154-f002-4e37-a824-2f1d9c4b1ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:35.921413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d67154-f002-4e37-a824-2f1d9c4b1ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:35.923589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d67154-f002-4e37-a824-2f1d9c4b1ba9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:35.958384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3276c3-9706-4b89-9163-ccf390d3f6aa admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:35.959391 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 833/1659] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:35.970148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3276c3-9706-4b89-9163-ccf390d3f6aa admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:35.989819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393bfd9-bade-4281-85c2-7714cbf0d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:35.990779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393bfd9-bade-4281-85c2-7714cbf0d9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:35.991234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393bfd9-bade-4281-85c2-7714cbf0d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:35.991671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393bfd9-bade-4281-85c2-7714cbf0d9e4 admin admin] PATH_INFO: `/v3/projects/3daae743d8b6423e9c6890bb4065fd8b/users/1d06e5ea0a8e4f4f87738b6d54d98a05/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:36.027111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393bfd9-bade-4281-85c2-7714cbf0d9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3daae743d8b6423e9c6890bb4065fd8b, user_id=1d06e5ea0a8e4f4f87738b6d54d98a05, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:36.031230 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393bfd9-bade-4281-85c2-7714cbf0d9e4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:36.075150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8030e-6716-4c7f-b18c-2f2af3092036 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:36.075670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8030e-6716-4c7f-b18c-2f2af3092036 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:36.076123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8030e-6716-4c7f-b18c-2f2af3092036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:36.079216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 827/1660] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:35 2022] PUT /identity/v3/projects/3daae743d8b6423e9c6890bb4065fd8b/users/1d06e5ea0a8e4f4f87738b6d54d98a05/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:36.124567 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f1c8030e-6716-4c7f-b18c-2f2af3092036 None None] MFA Rules not processed for user `1d06e5ea0a8e4f4f87738b6d54d98a05`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:36.127813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f1c8030e-6716-4c7f-b18c-2f2af3092036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:36.241014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 834/1661] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:36.245645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393bfd9-bade-4281-85c2-7714cbf0d9e4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:36.363696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:36.403007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393bfd9-bade-4281-85c2-7714cbf0d9e4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:36.412276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673535a-69da-420e-a335-57669ad71775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:36.414084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673535a-69da-420e-a335-57669ad71775 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:36.414597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673535a-69da-420e-a335-57669ad71775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:36.415938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673535a-69da-420e-a335-57669ad71775 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:36.418013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673535a-69da-420e-a335-57669ad71775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:36.441182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673535a-69da-420e-a335-57669ad71775 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:36.516701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 828/1662] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:36 2022] POST /identity/v3/projects => generated 373 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:36.518103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8030e-6716-4c7f-b18c-2f2af3092036 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:36.543263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8030e-6716-4c7f-b18c-2f2af3092036 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:36.720281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4728c6-d9f9-497b-aa40-cf4c173b12d7 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:36.720955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4728c6-d9f9-497b-aa40-cf4c173b12d7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:36.721305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4728c6-d9f9-497b-aa40-cf4c173b12d7 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:36.723793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 829/1663] 10.222.0.45 () {54 vars in 912 bytes} [Fri Aug 26 18:23:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:23:36.735009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38867de-a178-4068-a13d-35cc78b3befb None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:36.735391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38867de-a178-4068-a13d-35cc78b3befb None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:36.735861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38867de-a178-4068-a13d-35cc78b3befb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:36.779024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faf990-792a-44ba-8366-8eb42f7e428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:36.780627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faf990-792a-44ba-8366-8eb42f7e428c admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:36.783709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faf990-792a-44ba-8366-8eb42f7e428c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:36.785910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faf990-792a-44ba-8366-8eb42f7e428c admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:36.787475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faf990-792a-44ba-8366-8eb42f7e428c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:36.800534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faf990-792a-44ba-8366-8eb42f7e428c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:36.849357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:36.884997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 835/1664] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:36 2022] POST /identity/v3/users => generated 293 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:36.887266 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faf990-792a-44ba-8366-8eb42f7e428c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:36.897122 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f38867de-a178-4068-a13d-35cc78b3befb None None] MFA Rules not processed for user `78487667b3334cf09fed51b697cbf759`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:36.898631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f38867de-a178-4068-a13d-35cc78b3befb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:36.912987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faf990-792a-44ba-8366-8eb42f7e428c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:36.923544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdc81e-9aa6-4417-a6cc-257ccfba50f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:36.925111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdc81e-9aa6-4417-a6cc-257ccfba50f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:36.926499 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdc81e-9aa6-4417-a6cc-257ccfba50f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:36.926784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdc81e-9aa6-4417-a6cc-257ccfba50f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:36.927456 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdc81e-9aa6-4417-a6cc-257ccfba50f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:36.929439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdc81e-9aa6-4417-a6cc-257ccfba50f0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:36.964886 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 836/1665] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:36.967435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdc81e-9aa6-4417-a6cc-257ccfba50f0 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:36.995866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdc81e-9aa6-4417-a6cc-257ccfba50f0 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:37.008407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b0c5a-2dcc-4fb5-9c0d-d15886b841ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:37.009222 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b0c5a-2dcc-4fb5-9c0d-d15886b841ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:37.009409 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 830/1666] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:23:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:23:37.009684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b0c5a-2dcc-4fb5-9c0d-d15886b841ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:37.010051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b0c5a-2dcc-4fb5-9c0d-d15886b841ae admin admin] PATH_INFO: `/v3/projects/db3d520a8e3b441080f64e4834b9ec43/users/dc0f353d48764de9a27a162edd1d0395/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:37.013355 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38867de-a178-4068-a13d-35cc78b3befb None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:37.015115 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f38867de-a178-4068-a13d-35cc78b3befb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:37.029200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b0c5a-2dcc-4fb5-9c0d-d15886b841ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3d520a8e3b441080f64e4834b9ec43, user_id=dc0f353d48764de9a27a162edd1d0395, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:37.035973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38867de-a178-4068-a13d-35cc78b3befb None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:37.037345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b0c5a-2dcc-4fb5-9c0d-d15886b841ae admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:37.048620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f146c-4b21-46c4-9970-968afdcd0404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:37.049299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f146c-4b21-46c4-9970-968afdcd0404 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:37.049677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f146c-4b21-46c4-9970-968afdcd0404 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:37.049851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f146c-4b21-46c4-9970-968afdcd0404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:37.062676 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 837/1667] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:36 2022] PUT /identity/v3/projects/db3d520a8e3b441080f64e4834b9ec43/users/dc0f353d48764de9a27a162edd1d0395/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:37.064392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b0c5a-2dcc-4fb5-9c0d-d15886b841ae admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:37.073265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f146c-4b21-46c4-9970-968afdcd0404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:37.074731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f146c-4b21-46c4-9970-968afdcd0404 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:37.100774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 831/1668] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:37.230043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b0c5a-2dcc-4fb5-9c0d-d15886b841ae admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:37.246167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83733b47-f257-4210-be8a-fa856f0b3b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:37.247189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83733b47-f257-4210-be8a-fa856f0b3b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:37.247689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83733b47-f257-4210-be8a-fa856f0b3b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:37.248166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83733b47-f257-4210-be8a-fa856f0b3b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:37.250110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83733b47-f257-4210-be8a-fa856f0b3b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:37.254350 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83733b47-f257-4210-be8a-fa856f0b3b3a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:37.276652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 838/1669] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:37.280836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f146c-4b21-46c4-9970-968afdcd0404 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:37.302932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f146c-4b21-46c4-9970-968afdcd0404 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:37.317883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4892b-22ab-4e69-8459-7d01849fc31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:37.318590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4892b-22ab-4e69-8459-7d01849fc31c admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:37.318867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4892b-22ab-4e69-8459-7d01849fc31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:37.319136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4892b-22ab-4e69-8459-7d01849fc31c admin admin] PATH_INFO: `/v3/projects/db3d520a8e3b441080f64e4834b9ec43/users/dc0f353d48764de9a27a162edd1d0395/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:37.321928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4892b-22ab-4e69-8459-7d01849fc31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3d520a8e3b441080f64e4834b9ec43, user_id=dc0f353d48764de9a27a162edd1d0395, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:37.325454 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4892b-22ab-4e69-8459-7d01849fc31c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:37.364572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 832/1670] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:37 2022] PUT /identity/v3/projects/db3d520a8e3b441080f64e4834b9ec43/users/dc0f353d48764de9a27a162edd1d0395/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:37.375951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105bcb5-5b48-4144-8fe3-923c2dfc4e20 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:37.376234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105bcb5-5b48-4144-8fe3-923c2dfc4e20 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:37.376507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105bcb5-5b48-4144-8fe3-923c2dfc4e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:37.437844 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a105bcb5-5b48-4144-8fe3-923c2dfc4e20 None None] MFA Rules not processed for user `dc0f353d48764de9a27a162edd1d0395`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:37.439107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a105bcb5-5b48-4144-8fe3-923c2dfc4e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:37.630719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 839/1671] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:37.640704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4892b-22ab-4e69-8459-7d01849fc31c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:37.643370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-88f4892b-22ab-4e69-8459-7d01849fc31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:37.757914 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4892b-22ab-4e69-8459-7d01849fc31c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:37.769210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96092-528f-4916-a2b3-8d6c73ab78be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:37.769852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96092-528f-4916-a2b3-8d6c73ab78be service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:37.770128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96092-528f-4916-a2b3-8d6c73ab78be service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:37.770399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96092-528f-4916-a2b3-8d6c73ab78be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:37.791891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e96092-528f-4916-a2b3-8d6c73ab78be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:37.794563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e96092-528f-4916-a2b3-8d6c73ab78be service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:37.821653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 833/1672] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:38.224632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105bcb5-5b48-4144-8fe3-923c2dfc4e20 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:38.227356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a105bcb5-5b48-4144-8fe3-923c2dfc4e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:38.343218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:38.424804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105bcb5-5b48-4144-8fe3-923c2dfc4e20 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:38.445981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb228c-2300-4053-b02c-d9ac17c1697e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9eef8921de43f18245f47559f3fa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:38.446787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb228c-2300-4053-b02c-d9ac17c1697e service placement] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:38.447168 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb228c-2300-4053-b02c-d9ac17c1697e service placement] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:38.447657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb228c-2300-4053-b02c-d9ac17c1697e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:38.458924 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-79eb228c-2300-4053-b02c-d9ac17c1697e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:38.505278 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a172b-c40b-47f4-8a7d-e659d6949df9 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:38.506124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a172b-c40b-47f4-8a7d-e659d6949df9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:38.506611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a172b-c40b-47f4-8a7d-e659d6949df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:38.530122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb228c-2300-4053-b02c-d9ac17c1697e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:38.532363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb228c-2300-4053-b02c-d9ac17c1697e service placement] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:38.553107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 840/1673] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:38.627001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-890a172b-c40b-47f4-8a7d-e659d6949df9 None None] MFA Rules not processed for user `c78657cb0d4144cfaf0a7be1e3388ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:38.635504 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-890a172b-c40b-47f4-8a7d-e659d6949df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:38.682808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb228c-2300-4053-b02c-d9ac17c1697e service placement] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:38.812616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:38.840763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb228c-2300-4053-b02c-d9ac17c1697e service placement] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:38.852652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711fe57-d3a5-4bef-973b-bc05c8ff2b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:38.853393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711fe57-d3a5-4bef-973b-bc05c8ff2b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:38.853672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711fe57-d3a5-4bef-973b-bc05c8ff2b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:38.853940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711fe57-d3a5-4bef-973b-bc05c8ff2b03 admin admin] PATH_INFO: `/v3/users/1d06e5ea0a8e4f4f87738b6d54d98a05` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:38.858332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711fe57-d3a5-4bef-973b-bc05c8ff2b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d06e5ea0a8e4f4f87738b6d54d98a05)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:38.863547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711fe57-d3a5-4bef-973b-bc05c8ff2b03 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:38.956391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 834/1674] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:38.969393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba46c96-4902-4003-b3ba-8230eee46510 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:38.973099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba46c96-4902-4003-b3ba-8230eee46510 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:38.974541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba46c96-4902-4003-b3ba-8230eee46510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:38.993306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6711fe57-d3a5-4bef-973b-bc05c8ff2b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d06e5ea0a8e4f4f87738b6d54d98a05'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:38.994810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6711fe57-d3a5-4bef-973b-bc05c8ff2b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d06e5ea0a8e4f4f87738b6d54d98a05'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:39.016238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6711fe57-d3a5-4bef-973b-bc05c8ff2b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d06e5ea0a8e4f4f87738b6d54d98a05'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:39.024873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6711fe57-d3a5-4bef-973b-bc05c8ff2b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d06e5ea0a8e4f4f87738b6d54d98a05'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:39.026076 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6711fe57-d3a5-4bef-973b-bc05c8ff2b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d06e5ea0a8e4f4f87738b6d54d98a05'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:39.032980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-5ba46c96-4902-4003-b3ba-8230eee46510 None None] MFA Rules not processed for user `c78657cb0d4144cfaf0a7be1e3388ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:39.032980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5ba46c96-4902-4003-b3ba-8230eee46510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:39.060927 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 835/1675] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:39.067791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba46c96-4902-4003-b3ba-8230eee46510 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:39.067978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 841/1676] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:23:38 2022] DELETE /identity/v3/users/1d06e5ea0a8e4f4f87738b6d54d98a05 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:39.072304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56eafd-e643-4999-a588-aea6797e382b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:39.072304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56eafd-e643-4999-a588-aea6797e382b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:39.072546 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56eafd-e643-4999-a588-aea6797e382b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:39.073974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5ba46c96-4902-4003-b3ba-8230eee46510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:39.112820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9d56eafd-e643-4999-a588-aea6797e382b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:39.113904 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9d56eafd-e643-4999-a588-aea6797e382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:39.237939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:39.265865 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 842/1677] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:39.314516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba46c96-4902-4003-b3ba-8230eee46510 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:39.317566 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56eafd-e643-4999-a588-aea6797e382b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:39.319249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9d56eafd-e643-4999-a588-aea6797e382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:39.502699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56eafd-e643-4999-a588-aea6797e382b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:39.523590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56faeb-847c-4dd0-b445-1a95588a0095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:39.524549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56faeb-847c-4dd0-b445-1a95588a0095 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:39.524549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56faeb-847c-4dd0-b445-1a95588a0095 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:39.524836 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56faeb-847c-4dd0-b445-1a95588a0095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:39.549741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56faeb-847c-4dd0-b445-1a95588a0095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:39.558794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56faeb-847c-4dd0-b445-1a95588a0095 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:39.573320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53ec36-d80b-4c77-bbd3-054f17401ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:39.573976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53ec36-d80b-4c77-bbd3-054f17401ce7 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:39.577349 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53ec36-d80b-4c77-bbd3-054f17401ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:39.579502 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53ec36-d80b-4c77-bbd3-054f17401ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:39.586653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ba53ec36-d80b-4c77-bbd3-054f17401ce7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:39.590295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 843/1678] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:39.885492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53ec36-d80b-4c77-bbd3-054f17401ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:39.896325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53ec36-d80b-4c77-bbd3-054f17401ce7 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:39.912227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 836/1679] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 845 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:41.844112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56faeb-847c-4dd0-b445-1a95588a0095 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:41.845247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-da56faeb-847c-4dd0-b445-1a95588a0095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:41.864935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56faeb-847c-4dd0-b445-1a95588a0095 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:41.879324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:41.880153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:41.880498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:41.880807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] PATH_INFO: `/v3/projects/3daae743d8b6423e9c6890bb4065fd8b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:41.882311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3daae743d8b6423e9c6890bb4065fd8b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:41.893915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:42.060553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3daae743d8b6423e9c6890bb4065fd8b', 'request_id': 'req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:42.087494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3daae743d8b6423e9c6890bb4065fd8b', 'request_id': 'req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:42.102828 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3daae743d8b6423e9c6890bb4065fd8b', 'request_id': 'req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:42.159939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] The token cache is being invalidate because project 3daae743d8b6423e9c6890bb4065fd8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:23:42.160314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:42.194356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:42.204966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58b4fd-d834-410a-a986-e0408fd32901 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:42.206281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 844/1680] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:23:41 2022] DELETE /identity/v3/projects/3daae743d8b6423e9c6890bb4065fd8b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:42.206412 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58b4fd-d834-410a-a986-e0408fd32901 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:42.206781 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58b4fd-d834-410a-a986-e0408fd32901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:42.216919 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:42.219340 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:42.223171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:42.262249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9d58b4fd-d834-410a-a986-e0408fd32901 None None] MFA Rules not processed for user `c78657cb0d4144cfaf0a7be1e3388ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:42.281438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9d58b4fd-d834-410a-a986-e0408fd32901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:42.443511 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d0ed2-eb7e-4e59-adb4-b80842a64ba9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:42.476584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:42.477531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:42.477963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:42.477963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] PATH_INFO: `/v3/users/dc0f353d48764de9a27a162edd1d0395` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:42.482384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0f353d48764de9a27a162edd1d0395)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:42.484390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:42.499091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 837/1681] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:23:42.545672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e2321-1f02-43e5-b73f-84739e1a3b9e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:42.546136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e2321-1f02-43e5-b73f-84739e1a3b9e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:42.546562 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e2321-1f02-43e5-b73f-84739e1a3b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:42.629258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:42.634445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c09e2321-1f02-43e5-b73f-84739e1a3b9e None None] MFA Rules not processed for user `cde02839effc4354a4fd7e82c1dc8e26`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:42.640179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c09e2321-1f02-43e5-b73f-84739e1a3b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:42.702304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0f353d48764de9a27a162edd1d0395'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:42.706018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0f353d48764de9a27a162edd1d0395'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:42.742425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0f353d48764de9a27a162edd1d0395'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:42.764616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0f353d48764de9a27a162edd1d0395'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:42.765741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0f353d48764de9a27a162edd1d0395'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:42.834032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 845/1682] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:23:42 2022] DELETE /identity/v3/users/dc0f353d48764de9a27a162edd1d0395 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:42.956937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 838/1683] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:23:43.397983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:43.399518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:43.578161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e0bd9-1aa7-4671-9190-a32cac794fe9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:43.612613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727930a3-cf26-4b4e-aa93-d1820b8013fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:43.613603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727930a3-cf26-4b4e-aa93-d1820b8013fd service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:43.614045 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727930a3-cf26-4b4e-aa93-d1820b8013fd service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:43.614318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727930a3-cf26-4b4e-aa93-d1820b8013fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:43.718773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727930a3-cf26-4b4e-aa93-d1820b8013fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:43.720486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727930a3-cf26-4b4e-aa93-d1820b8013fd service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:43.726477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b07565-bedb-4b0a-8a4b-11f508e0443e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:43.727036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b07565-bedb-4b0a-8a4b-11f508e0443e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:43.727036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b07565-bedb-4b0a-8a4b-11f508e0443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:43.760762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 846/1684] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:43.912322 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f3b07565-bedb-4b0a-8a4b-11f508e0443e None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:43.913422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f3b07565-bedb-4b0a-8a4b-11f508e0443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:44.069446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373d92c-509f-43a7-b6e4-f755f40c58ea None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:44.069645 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373d92c-509f-43a7-b6e4-f755f40c58ea None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:44.070462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373d92c-509f-43a7-b6e4-f755f40c58ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:44.157912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c373d92c-509f-43a7-b6e4-f755f40c58ea None None] MFA Rules not processed for user `85158030e4904eab877dc5da3a6bbd33`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:44.159156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c373d92c-509f-43a7-b6e4-f755f40c58ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:44.187493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 839/1685] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:23:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:23:44.231817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:44.260132 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b07565-bedb-4b0a-8a4b-11f508e0443e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:44.266052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f3b07565-bedb-4b0a-8a4b-11f508e0443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:44.313130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:44.409794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 847/1686] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:23:44.473934 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b07565-bedb-4b0a-8a4b-11f508e0443e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:44.474609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373d92c-509f-43a7-b6e4-f755f40c58ea None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:44.476077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c373d92c-509f-43a7-b6e4-f755f40c58ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:44.486607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fed2e2-870b-4859-b651-f334d18faeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:44.487618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fed2e2-870b-4859-b651-f334d18faeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:44.488067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fed2e2-870b-4859-b651-f334d18faeae admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:44.488483 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fed2e2-870b-4859-b651-f334d18faeae admin admin] PATH_INFO: `/v3/users/a18d614cf7fc4aa6b12c295bbf1308b4` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:44.491736 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fed2e2-870b-4859-b651-f334d18faeae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18d614cf7fc4aa6b12c295bbf1308b4)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:44.494337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fed2e2-870b-4859-b651-f334d18faeae admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:44.607356 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-62fed2e2-870b-4859-b651-f334d18faeae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18d614cf7fc4aa6b12c295bbf1308b4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:44.642353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-62fed2e2-870b-4859-b651-f334d18faeae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18d614cf7fc4aa6b12c295bbf1308b4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:44.643395 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-62fed2e2-870b-4859-b651-f334d18faeae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18d614cf7fc4aa6b12c295bbf1308b4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:44.655936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-62fed2e2-870b-4859-b651-f334d18faeae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18d614cf7fc4aa6b12c295bbf1308b4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:44.669928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-62fed2e2-870b-4859-b651-f334d18faeae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18d614cf7fc4aa6b12c295bbf1308b4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:44.679362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 840/1687] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:23:44 2022] DELETE /identity/v3/users/a18d614cf7fc4aa6b12c295bbf1308b4 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:23:44.681259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a97225-371a-4e29-88f1-8f36060fed07 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:44.681544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a97225-371a-4e29-88f1-8f36060fed07 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:44.681975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a97225-371a-4e29-88f1-8f36060fed07 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:44.688604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 841/1688] 10.222.0.45 () {54 vars in 912 bytes} [Fri Aug 26 18:23:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:23:44.689862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a97225-371a-4e29-88f1-8f36060fed07 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:44.697265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-56a97225-371a-4e29-88f1-8f36060fed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:44.738466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373d92c-509f-43a7-b6e4-f755f40c58ea None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:44.844038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a97225-371a-4e29-88f1-8f36060fed07 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:44.853208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2601f-fbcb-4e86-a810-7728fb5e2009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:44.854404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2601f-fbcb-4e86-a810-7728fb5e2009 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:44.854735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2601f-fbcb-4e86-a810-7728fb5e2009 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:44.855044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2601f-fbcb-4e86-a810-7728fb5e2009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:44.857462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1ca2601f-fbcb-4e86-a810-7728fb5e2009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:44.913865 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51380e71-eeb3-4650-a6b8-86d25a142fa4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:44.914509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51380e71-eeb3-4650-a6b8-86d25a142fa4 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:44.935768 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51380e71-eeb3-4650-a6b8-86d25a142fa4 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:44.936292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51380e71-eeb3-4650-a6b8-86d25a142fa4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:44.942930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-51380e71-eeb3-4650-a6b8-86d25a142fa4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:44.981387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:45.090443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:45.099766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2601f-fbcb-4e86-a810-7728fb5e2009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:45.118062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2601f-fbcb-4e86-a810-7728fb5e2009 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:45.124140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51380e71-eeb3-4650-a6b8-86d25a142fa4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:45.128351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51380e71-eeb3-4650-a6b8-86d25a142fa4 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:45.143437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 848/1689] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:23:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 18:23:45.160569 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288b93a-2122-482e-83ae-aaa7c19927ce None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:45.161073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288b93a-2122-482e-83ae-aaa7c19927ce None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:45.161533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288b93a-2122-482e-83ae-aaa7c19927ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:45.174795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 842/1690] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:45.178999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a928ab-160e-473d-a233-4a497ca22b9d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:45.181581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a928ab-160e-473d-a233-4a497ca22b9d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:45.181869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a928ab-160e-473d-a233-4a497ca22b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:45.266814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-52a928ab-160e-473d-a233-4a497ca22b9d None None] MFA Rules not processed for user `78487667b3334cf09fed51b697cbf759`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:45.275166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-52a928ab-160e-473d-a233-4a497ca22b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:45.282451 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1288b93a-2122-482e-83ae-aaa7c19927ce None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:45.283708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1288b93a-2122-482e-83ae-aaa7c19927ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:45.471253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 843/1691] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:23:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:45.472330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a928ab-160e-473d-a233-4a497ca22b9d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:45.478004 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-52a928ab-160e-473d-a233-4a497ca22b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:45.617894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 849/1692] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:45.618930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288b93a-2122-482e-83ae-aaa7c19927ce None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:45.628823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1288b93a-2122-482e-83ae-aaa7c19927ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:45.693564 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288b93a-2122-482e-83ae-aaa7c19927ce None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:45.724203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea3166-e3b5-43a1-aa62-ba310ec6df6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:45.724909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3166-e3b5-43a1-aa62-ba310ec6df6d service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:45.725195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3166-e3b5-43a1-aa62-ba310ec6df6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:45.725472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3166-e3b5-43a1-aa62-ba310ec6df6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:45.747101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea3166-e3b5-43a1-aa62-ba310ec6df6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:45.752386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea3166-e3b5-43a1-aa62-ba310ec6df6d service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:45.783929 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 850/1693] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:45.784866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea3166-e3b5-43a1-aa62-ba310ec6df6d service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:45.821282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea3166-e3b5-43a1-aa62-ba310ec6df6d service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:45.826239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be8afe-5f6b-4567-adfc-204d07411540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:45.826870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be8afe-5f6b-4567-adfc-204d07411540 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:45.827162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be8afe-5f6b-4567-adfc-204d07411540 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:45.827436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be8afe-5f6b-4567-adfc-204d07411540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:45.839680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be8afe-5f6b-4567-adfc-204d07411540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:45.841332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be8afe-5f6b-4567-adfc-204d07411540 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:45.859928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a928ab-160e-473d-a233-4a497ca22b9d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:45.870876 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 851/1694] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:45.909788 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7918b8-e789-48ed-a91a-d17ffecaad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:45.911540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7918b8-e789-48ed-a91a-d17ffecaad2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:45.912307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7918b8-e789-48ed-a91a-d17ffecaad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:45.913162 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7918b8-e789-48ed-a91a-d17ffecaad2f admin admin] PATH_INFO: `/v3/projects/db3d520a8e3b441080f64e4834b9ec43` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:45.919490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7918b8-e789-48ed-a91a-d17ffecaad2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3d520a8e3b441080f64e4834b9ec43)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:45.933555 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7918b8-e789-48ed-a91a-d17ffecaad2f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:46.041359 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ca7918b8-e789-48ed-a91a-d17ffecaad2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3d520a8e3b441080f64e4834b9ec43', 'request_id': 'req-ca7918b8-e789-48ed-a91a-d17ffecaad2f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:46.057180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ca7918b8-e789-48ed-a91a-d17ffecaad2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3d520a8e3b441080f64e4834b9ec43', 'request_id': 'req-ca7918b8-e789-48ed-a91a-d17ffecaad2f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:46.072432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ca7918b8-e789-48ed-a91a-d17ffecaad2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3d520a8e3b441080f64e4834b9ec43', 'request_id': 'req-ca7918b8-e789-48ed-a91a-d17ffecaad2f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:46.109796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ca7918b8-e789-48ed-a91a-d17ffecaad2f admin admin] The token cache is being invalidate because project db3d520a8e3b441080f64e4834b9ec43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:23:46.110589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ca7918b8-e789-48ed-a91a-d17ffecaad2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:46.112842 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ca7918b8-e789-48ed-a91a-d17ffecaad2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:46.122178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 844/1695] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:23:45 2022] DELETE /identity/v3/projects/db3d520a8e3b441080f64e4834b9ec43 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:46.122646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2e73-8216-417e-aef4-aa603c5d64a2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:46.122934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2e73-8216-417e-aef4-aa603c5d64a2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:46.123207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2e73-8216-417e-aef4-aa603c5d64a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:46.187852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-042b2e73-8216-417e-aef4-aa603c5d64a2 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:46.191720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-042b2e73-8216-417e-aef4-aa603c5d64a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:46.384009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68c617-beb2-48cc-91a1-05d5240884ae None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:46.384300 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68c617-beb2-48cc-91a1-05d5240884ae None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:46.384575 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68c617-beb2-48cc-91a1-05d5240884ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:46.391490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 852/1696] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:46.422507 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:46.456436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ef68c617-beb2-48cc-91a1-05d5240884ae None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:46.460182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ef68c617-beb2-48cc-91a1-05d5240884ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:46.506737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b2e73-8216-417e-aef4-aa603c5d64a2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:46.519232 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 845/1697] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:46.525308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b2e73-8216-417e-aef4-aa603c5d64a2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:46.554012 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b209a03-2abb-44f3-bab4-d3fd5613a98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:46.554717 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b209a03-2abb-44f3-bab4-d3fd5613a98a admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:46.555706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b209a03-2abb-44f3-bab4-d3fd5613a98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:46.556136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b209a03-2abb-44f3-bab4-d3fd5613a98a admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:46.564366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b209a03-2abb-44f3-bab4-d3fd5613a98a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:23:46.564746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b209a03-2abb-44f3-bab4-d3fd5613a98a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:46.568256 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b209a03-2abb-44f3-bab4-d3fd5613a98a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:46.655497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68c617-beb2-48cc-91a1-05d5240884ae None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:46.667949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 853/1698] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:23:46.670347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68c617-beb2-48cc-91a1-05d5240884ae None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:46.683516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0f57f-41de-4c28-a015-fc052f52ac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:46.684391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0f57f-41de-4c28-a015-fc052f52ac16 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:46.686284 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0f57f-41de-4c28-a015-fc052f52ac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:46.686735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0f57f-41de-4c28-a015-fc052f52ac16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:46.687642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0f57f-41de-4c28-a015-fc052f52ac16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:46.690619 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0f57f-41de-4c28-a015-fc052f52ac16 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:46.742707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b209a03-2abb-44f3-bab4-d3fd5613a98a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:46.743866 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 846/1699] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:46 2022] POST /identity/v3/projects => generated 363 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:46.760500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b209a03-2abb-44f3-bab4-d3fd5613a98a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:46.916553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:46.949926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acaaf0-176a-4f66-8f90-a4a1acd5653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:46.950696 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acaaf0-176a-4f66-8f90-a4a1acd5653b admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:46.951107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acaaf0-176a-4f66-8f90-a4a1acd5653b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:46.951381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acaaf0-176a-4f66-8f90-a4a1acd5653b admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:46.952054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acaaf0-176a-4f66-8f90-a4a1acd5653b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:46.958382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acaaf0-176a-4f66-8f90-a4a1acd5653b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:47.046471 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0f57f-41de-4c28-a015-fc052f52ac16 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:47.047325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 854/1700] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:46 2022] POST /identity/v3/users => generated 282 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:47.066912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0f57f-41de-4c28-a015-fc052f52ac16 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:47.079973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dc5e5-a6d3-4936-b800-438aa33934f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:47.081885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dc5e5-a6d3-4936-b800-438aa33934f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:47.082223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dc5e5-a6d3-4936-b800-438aa33934f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:47.082321 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dc5e5-a6d3-4936-b800-438aa33934f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:47.084618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dc5e5-a6d3-4936-b800-438aa33934f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:47.089863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dc5e5-a6d3-4936-b800-438aa33934f5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:47.118860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 847/1701] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:47.119667 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acaaf0-176a-4f66-8f90-a4a1acd5653b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:47.145160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acaaf0-176a-4f66-8f90-a4a1acd5653b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:47.165000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd7ea8-bd66-494f-ac08-950adb7fd49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:47.165675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd7ea8-bd66-494f-ac08-950adb7fd49c admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:47.166003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd7ea8-bd66-494f-ac08-950adb7fd49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:47.166379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd7ea8-bd66-494f-ac08-950adb7fd49c admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:47.169035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd7ea8-bd66-494f-ac08-950adb7fd49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:47.172405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd7ea8-bd66-494f-ac08-950adb7fd49c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:47.207091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 855/1702] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:47.211464 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dc5e5-a6d3-4936-b800-438aa33934f5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:47.228892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dc5e5-a6d3-4936-b800-438aa33934f5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:47.239682 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed7b49-d149-4c1e-a33a-d27f837383cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:47.240419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed7b49-d149-4c1e-a33a-d27f837383cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:47.240755 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed7b49-d149-4c1e-a33a-d27f837383cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:47.241062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed7b49-d149-4c1e-a33a-d27f837383cc admin admin] PATH_INFO: `/v3/projects/8851f11d59ac48c49ae11a3386fb13d5/users/dc03aea306754b19a6691036d1fdf2a8/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:47.291364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed7b49-d149-4c1e-a33a-d27f837383cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8851f11d59ac48c49ae11a3386fb13d5, user_id=dc03aea306754b19a6691036d1fdf2a8, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:47.294378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed7b49-d149-4c1e-a33a-d27f837383cc admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:47.325055 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 848/1703] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:47 2022] PUT /identity/v3/projects/8851f11d59ac48c49ae11a3386fb13d5/users/dc03aea306754b19a6691036d1fdf2a8/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:47.339708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3892fb-9c03-47a1-a0a5-5f8a8590cfba None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:47.340063 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3892fb-9c03-47a1-a0a5-5f8a8590cfba None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:47.340346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3892fb-9c03-47a1-a0a5-5f8a8590cfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:47.422123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3c3892fb-9c03-47a1-a0a5-5f8a8590cfba None None] MFA Rules not processed for user `dc03aea306754b19a6691036d1fdf2a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:47.423619 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3c3892fb-9c03-47a1-a0a5-5f8a8590cfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:47.649432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 856/1704] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:47.649662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed7b49-d149-4c1e-a33a-d27f837383cc admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:47.843983 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed7b49-d149-4c1e-a33a-d27f837383cc admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:47.851869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22ccf0-2451-4a41-b647-64d0bca29adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:47.853118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22ccf0-2451-4a41-b647-64d0bca29adb admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:47.853606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22ccf0-2451-4a41-b647-64d0bca29adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:47.854091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22ccf0-2451-4a41-b647-64d0bca29adb admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:47.856112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22ccf0-2451-4a41-b647-64d0bca29adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:47.859294 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22ccf0-2451-4a41-b647-64d0bca29adb admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:47.948905 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 849/1705] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:47 2022] POST /identity/v3/projects => generated 365 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:47.952589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3892fb-9c03-47a1-a0a5-5f8a8590cfba None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:47.969699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3892fb-9c03-47a1-a0a5-5f8a8590cfba None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:48.116437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5470425-cd14-491b-ac61-9cd1b3aac745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:48.118928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5470425-cd14-491b-ac61-9cd1b3aac745 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:48.119614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5470425-cd14-491b-ac61-9cd1b3aac745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:48.121605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5470425-cd14-491b-ac61-9cd1b3aac745 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:48.124263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5470425-cd14-491b-ac61-9cd1b3aac745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:48.130862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5470425-cd14-491b-ac61-9cd1b3aac745 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:48.202959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 857/1706] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:47 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:48.203774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22ccf0-2451-4a41-b647-64d0bca29adb admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:48.236119 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22ccf0-2451-4a41-b647-64d0bca29adb admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:48.257659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ff2c5-476d-4744-afe7-fa7de1b619ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:48.261639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ff2c5-476d-4744-afe7-fa7de1b619ae admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:48.265788 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ff2c5-476d-4744-afe7-fa7de1b619ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:48.268933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ff2c5-476d-4744-afe7-fa7de1b619ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:48.272709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ff2c5-476d-4744-afe7-fa7de1b619ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:48.275909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ff2c5-476d-4744-afe7-fa7de1b619ae admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:48.332753 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 850/1707] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:23:48.340150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5470425-cd14-491b-ac61-9cd1b3aac745 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:48.382329 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5470425-cd14-491b-ac61-9cd1b3aac745 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:48.399881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76acdf-2896-4f64-a6ab-de1199dd9bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:48.402993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76acdf-2896-4f64-a6ab-de1199dd9bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:48.403818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76acdf-2896-4f64-a6ab-de1199dd9bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:48.405795 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76acdf-2896-4f64-a6ab-de1199dd9bf5 admin admin] PATH_INFO: `/v3/projects/d1370231433643ff9a9fb4beac3bf2e9/users/f17f70d9a7ef4524a105c39780f0806e/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:48.463102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76acdf-2896-4f64-a6ab-de1199dd9bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1370231433643ff9a9fb4beac3bf2e9, user_id=f17f70d9a7ef4524a105c39780f0806e, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:48.479383 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76acdf-2896-4f64-a6ab-de1199dd9bf5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:48.528899 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ff2c5-476d-4744-afe7-fa7de1b619ae admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:48.546236 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 858/1708] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:48 2022] PUT /identity/v3/projects/d1370231433643ff9a9fb4beac3bf2e9/users/f17f70d9a7ef4524a105c39780f0806e/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:48.551306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ff2c5-476d-4744-afe7-fa7de1b619ae admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:48.737465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76acdf-2896-4f64-a6ab-de1199dd9bf5 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:48.739328 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3d76acdf-2896-4f64-a6ab-de1199dd9bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:48.818464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:48.819145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fc717-0d71-45b1-a05a-06dd6b3c74a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:48.819983 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fc717-0d71-45b1-a05a-06dd6b3c74a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:48.821171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fc717-0d71-45b1-a05a-06dd6b3c74a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:48.823876 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fc717-0d71-45b1-a05a-06dd6b3c74a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:48.825633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fc717-0d71-45b1-a05a-06dd6b3c74a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:48.830183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fc717-0d71-45b1-a05a-06dd6b3c74a2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:48.866849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76acdf-2896-4f64-a6ab-de1199dd9bf5 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:48.872561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:48.875809 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 851/1709] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:48.883256 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:48.883609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:48.883824 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] PATH_INFO: `/v3/users/362761a8e75e496a93800d227072963f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:48.885188 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=362761a8e75e496a93800d227072963f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:48.887619 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:48.894611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edd1f1-6fcb-4ec5-bcc8-de4b86bcc5a2 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:48.900403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edd1f1-6fcb-4ec5-bcc8-de4b86bcc5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:48.901036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edd1f1-6fcb-4ec5-bcc8-de4b86bcc5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:48.968940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362761a8e75e496a93800d227072963f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:48.969746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362761a8e75e496a93800d227072963f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:48.982222 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362761a8e75e496a93800d227072963f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:48.996983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362761a8e75e496a93800d227072963f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:48.997873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362761a8e75e496a93800d227072963f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:49.020183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b9edd1f1-6fcb-4ec5-bcc8-de4b86bcc5a2 None None] MFA Rules not processed for user `78487667b3334cf09fed51b697cbf759`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:49.037406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b9edd1f1-6fcb-4ec5-bcc8-de4b86bcc5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:49.062042 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 859/1710] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:23:48 2022] DELETE /identity/v3/users/362761a8e75e496a93800d227072963f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:23:49.062042 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:49.077529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:49.082387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:49.196402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 852/1711] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Aug 26 18:23:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:49.198980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a7e9e-6691-49d8-83cb-fd367e403dad None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:49.199434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a7e9e-6691-49d8-83cb-fd367e403dad None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:49.204900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a7e9e-6691-49d8-83cb-fd367e403dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:49.292956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-813a7e9e-6691-49d8-83cb-fd367e403dad None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:49.294537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e1e0e-795c-45ac-ba7d-923b95a32a17 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:49.294878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-813a7e9e-6691-49d8-83cb-fd367e403dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:49.313000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84bd4-bbb7-4a39-a804-d38602ab912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:49.316453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84bd4-bbb7-4a39-a804-d38602ab912c admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:49.316833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84bd4-bbb7-4a39-a804-d38602ab912c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:49.317125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84bd4-bbb7-4a39-a804-d38602ab912c admin admin] PATH_INFO: `/v3/projects/d1370231433643ff9a9fb4beac3bf2e9/users/f17f70d9a7ef4524a105c39780f0806e/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:49.322933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a84bd4-bbb7-4a39-a804-d38602ab912c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1370231433643ff9a9fb4beac3bf2e9, user_id=f17f70d9a7ef4524a105c39780f0806e, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:49.326188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 853/1712] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:49.327220 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a7e9e-6691-49d8-83cb-fd367e403dad None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:49.332209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-813a7e9e-6691-49d8-83cb-fd367e403dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:49.334386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a84bd4-bbb7-4a39-a804-d38602ab912c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:49.363641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a7e9e-6691-49d8-83cb-fd367e403dad None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:49.369654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 860/1713] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:49 2022] PUT /identity/v3/projects/d1370231433643ff9a9fb4beac3bf2e9/users/f17f70d9a7ef4524a105c39780f0806e/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:49.370994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84bd4-bbb7-4a39-a804-d38602ab912c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:49.378951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e7a84bd4-bbb7-4a39-a804-d38602ab912c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:49.485298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:49.577614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84bd4-bbb7-4a39-a804-d38602ab912c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:49.589888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939d687-d2bc-4d2b-9d26-1986ecf85b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:49.590485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939d687-d2bc-4d2b-9d26-1986ecf85b42 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:49.590764 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939d687-d2bc-4d2b-9d26-1986ecf85b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:49.591043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939d687-d2bc-4d2b-9d26-1986ecf85b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:49.613857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:49.622691 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939d687-d2bc-4d2b-9d26-1986ecf85b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:49.627320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:49.627775 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:49.628195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] PATH_INFO: `/v3/projects/80a905d4d8b140bf8a30530e403d2209` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:49.630919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a905d4d8b140bf8a30530e403d2209)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:49.632968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939d687-d2bc-4d2b-9d26-1986ecf85b42 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:49.635371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:49.670348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 861/1714] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:49.674291 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cb567-ae01-4cb5-9410-73586d8abcfb None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:49.674587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cb567-ae01-4cb5-9410-73586d8abcfb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:49.682282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cb567-ae01-4cb5-9410-73586d8abcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:49.770520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a905d4d8b140bf8a30530e403d2209', 'request_id': 'req-8a7d19fc-fd60-4c76-99a6-60ede070a39f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:49.773483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-525cb567-ae01-4cb5-9410-73586d8abcfb None None] MFA Rules not processed for user `f17f70d9a7ef4524a105c39780f0806e`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:49.778229 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-525cb567-ae01-4cb5-9410-73586d8abcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:49.813931 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a905d4d8b140bf8a30530e403d2209', 'request_id': 'req-8a7d19fc-fd60-4c76-99a6-60ede070a39f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:49.849140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a905d4d8b140bf8a30530e403d2209', 'request_id': 'req-8a7d19fc-fd60-4c76-99a6-60ede070a39f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:49.921348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] The token cache is being invalidate because project 80a905d4d8b140bf8a30530e403d2209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:23:49.926088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:49.931321 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:49.942258 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 854/1715] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:23:49 2022] DELETE /identity/v3/projects/80a905d4d8b140bf8a30530e403d2209 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:49.945373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:49.952527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:50.021759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 862/1716] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:50.021759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74542c-fde0-4640-a4a8-5728162555d8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:50.021759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74542c-fde0-4640-a4a8-5728162555d8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:50.023970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74542c-fde0-4640-a4a8-5728162555d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:50.066829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-de74542c-fde0-4640-a4a8-5728162555d8 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:50.068041 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-de74542c-fde0-4640-a4a8-5728162555d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:50.194173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:50.210906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d19fc-fd60-4c76-99a6-60ede070a39f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:50.223390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac51857-c87a-41b7-8344-468cc2144b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:50.224074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac51857-c87a-41b7-8344-468cc2144b64 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:50.224661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac51857-c87a-41b7-8344-468cc2144b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:50.224661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac51857-c87a-41b7-8344-468cc2144b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:50.230131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3ac51857-c87a-41b7-8344-468cc2144b64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:50.273524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 863/1717] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:50.274631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74542c-fde0-4640-a4a8-5728162555d8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:50.281127 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-de74542c-fde0-4640-a4a8-5728162555d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:50.509693 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74542c-fde0-4640-a4a8-5728162555d8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:50.521959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4839259-a9cb-49c1-8238-9b83ee421973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:50.523392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4839259-a9cb-49c1-8238-9b83ee421973 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:50.524382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4839259-a9cb-49c1-8238-9b83ee421973 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:50.525154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4839259-a9cb-49c1-8238-9b83ee421973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:50.528986 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac51857-c87a-41b7-8344-468cc2144b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:50.530754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac51857-c87a-41b7-8344-468cc2144b64 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:50.545512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 855/1718] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:50.547295 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86f2cc-62f1-49bd-be5e-9273d73deae6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:50.547602 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86f2cc-62f1-49bd-be5e-9273d73deae6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:50.548092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86f2cc-62f1-49bd-be5e-9273d73deae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:50.576594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4839259-a9cb-49c1-8238-9b83ee421973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:50.580814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4839259-a9cb-49c1-8238-9b83ee421973 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:50.588087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3b86f2cc-62f1-49bd-be5e-9273d73deae6 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:50.591116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3b86f2cc-62f1-49bd-be5e-9273d73deae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:50.606422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 856/1719] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:50.611209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86f2cc-62f1-49bd-be5e-9273d73deae6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:50.642381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 864/1720] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:50.650265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86f2cc-62f1-49bd-be5e-9273d73deae6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:50.667219 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfea318-1c62-4b04-be5b-64d305d5e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:50.668295 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfea318-1c62-4b04-be5b-64d305d5e98b admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:50.668811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfea318-1c62-4b04-be5b-64d305d5e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:50.669224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfea318-1c62-4b04-be5b-64d305d5e98b admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:50.670151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfea318-1c62-4b04-be5b-64d305d5e98b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:23:50.670459 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfea318-1c62-4b04-be5b-64d305d5e98b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:50.672250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfea318-1c62-4b04-be5b-64d305d5e98b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:50.710802 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 857/1721] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:23:50.719763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4839259-a9cb-49c1-8238-9b83ee421973 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:50.748103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4839259-a9cb-49c1-8238-9b83ee421973 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:50.786590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb42943-84e1-410e-b15e-b08dea854ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:50.787364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb42943-84e1-410e-b15e-b08dea854ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:50.787750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb42943-84e1-410e-b15e-b08dea854ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:50.796817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb42943-84e1-410e-b15e-b08dea854ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:50.798154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb42943-84e1-410e-b15e-b08dea854ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:50.801991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb42943-84e1-410e-b15e-b08dea854ca7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:50.831278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:50.942990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfea318-1c62-4b04-be5b-64d305d5e98b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:50.961518 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfea318-1c62-4b04-be5b-64d305d5e98b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:50.972018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 865/1722] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:50 2022] POST /identity/v3/projects => generated 381 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:50.979599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45f212-8b9b-41bf-bdb8-19abdf2c77a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:50.980254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45f212-8b9b-41bf-bdb8-19abdf2c77a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:50.980540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45f212-8b9b-41bf-bdb8-19abdf2c77a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:50.981003 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45f212-8b9b-41bf-bdb8-19abdf2c77a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:50.983980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb42943-84e1-410e-b15e-b08dea854ca7 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:50.995091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7d45f212-8b9b-41bf-bdb8-19abdf2c77a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:51.179151 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb42943-84e1-410e-b15e-b08dea854ca7 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:51.195164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa105db5-9d18-4bba-87fa-183f83fe2205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:51.195916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105db5-9d18-4bba-87fa-183f83fe2205 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:51.196254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105db5-9d18-4bba-87fa-183f83fe2205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:51.196529 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105db5-9d18-4bba-87fa-183f83fe2205 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:51.197874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa105db5-9d18-4bba-87fa-183f83fe2205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:51.200059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa105db5-9d18-4bba-87fa-183f83fe2205 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:51.263634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 866/1723] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:50 2022] POST /identity/v3/users => generated 291 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:51.266919 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa105db5-9d18-4bba-87fa-183f83fe2205 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:51.308290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa105db5-9d18-4bba-87fa-183f83fe2205 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:51.309092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45f212-8b9b-41bf-bdb8-19abdf2c77a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:51.310676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45f212-8b9b-41bf-bdb8-19abdf2c77a9 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:51.326106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8abb-10fd-4a4e-963c-28fdd3de786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:51.326756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8abb-10fd-4a4e-963c-28fdd3de786b admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:51.327032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8abb-10fd-4a4e-963c-28fdd3de786b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:51.327304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8abb-10fd-4a4e-963c-28fdd3de786b admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:51.327962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf8abb-10fd-4a4e-963c-28fdd3de786b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:51.329683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf8abb-10fd-4a4e-963c-28fdd3de786b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:51.363610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 858/1724] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:23:51.382252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 867/1725] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:51.382601 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45f212-8b9b-41bf-bdb8-19abdf2c77a9 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:51.415855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45f212-8b9b-41bf-bdb8-19abdf2c77a9 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:51.455127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dff5c2-d366-416b-bcf1-b59539e2b93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:51.459524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dff5c2-d366-416b-bcf1-b59539e2b93c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:51.464267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dff5c2-d366-416b-bcf1-b59539e2b93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:51.464267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dff5c2-d366-416b-bcf1-b59539e2b93c admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:51.466555 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dff5c2-d366-416b-bcf1-b59539e2b93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:51.473052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dff5c2-d366-416b-bcf1-b59539e2b93c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:51.496263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 859/1726] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:51.500697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8abb-10fd-4a4e-963c-28fdd3de786b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:51.519245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8abb-10fd-4a4e-963c-28fdd3de786b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:51.536743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc4cb3-ade6-41f8-b0d9-70ca0007448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:51.543661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc4cb3-ade6-41f8-b0d9-70ca0007448f admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:51.545559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc4cb3-ade6-41f8-b0d9-70ca0007448f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:51.546946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc4cb3-ade6-41f8-b0d9-70ca0007448f admin admin] PATH_INFO: `/v3/projects/49d3ede1c95e4574929b8e90232b61d0/users/e9bd6d42b8fc45e5b57e861c90abab83/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:51.615668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc4cb3-ade6-41f8-b0d9-70ca0007448f admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d3ede1c95e4574929b8e90232b61d0, user_id=e9bd6d42b8fc45e5b57e861c90abab83, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:51.619586 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc4cb3-ade6-41f8-b0d9-70ca0007448f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:51.643460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 868/1727] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:51 2022] PUT /identity/v3/projects/49d3ede1c95e4574929b8e90232b61d0/users/e9bd6d42b8fc45e5b57e861c90abab83/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:51.654889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca933-083b-40e1-bf0d-b95794cfbbf4 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:51.655628 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca933-083b-40e1-bf0d-b95794cfbbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:51.655628 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca933-083b-40e1-bf0d-b95794cfbbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:51.740154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-61bca933-083b-40e1-bf0d-b95794cfbbf4 None None] MFA Rules not processed for user `e9bd6d42b8fc45e5b57e861c90abab83`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:51.741440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-61bca933-083b-40e1-bf0d-b95794cfbbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:51.849076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:51.882981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 860/1728] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:51.886800 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc4cb3-ade6-41f8-b0d9-70ca0007448f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:52.102732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc4cb3-ade6-41f8-b0d9-70ca0007448f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:52.123997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39904698-2474-4295-8e48-a0e3901256fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:52.126835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39904698-2474-4295-8e48-a0e3901256fb admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:52.129142 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39904698-2474-4295-8e48-a0e3901256fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:52.130304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39904698-2474-4295-8e48-a0e3901256fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:52.132241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39904698-2474-4295-8e48-a0e3901256fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:52.148681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39904698-2474-4295-8e48-a0e3901256fb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:52.329745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 869/1729] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:51 2022] POST /identity/v3/projects => generated 379 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:52.331013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca933-083b-40e1-bf0d-b95794cfbbf4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:52.350796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca933-083b-40e1-bf0d-b95794cfbbf4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:52.541463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c665d-2f7a-4824-b8eb-2273c294728c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:52.548144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c665d-2f7a-4824-b8eb-2273c294728c admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:52.549110 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c665d-2f7a-4824-b8eb-2273c294728c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:52.550302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c665d-2f7a-4824-b8eb-2273c294728c admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:52.552290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c665d-2f7a-4824-b8eb-2273c294728c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:52.572048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c665d-2f7a-4824-b8eb-2273c294728c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:52.645666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 861/1730] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:52 2022] POST /identity/v3/users => generated 296 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:52.649427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39904698-2474-4295-8e48-a0e3901256fb admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:52.685501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39904698-2474-4295-8e48-a0e3901256fb admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:52.714782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260a62c-7ae7-4118-b015-dce9e478fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:52.715740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260a62c-7ae7-4118-b015-dce9e478fdbb admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:52.717823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260a62c-7ae7-4118-b015-dce9e478fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:52.725202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260a62c-7ae7-4118-b015-dce9e478fdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:52.727906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260a62c-7ae7-4118-b015-dce9e478fdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:52.736074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260a62c-7ae7-4118-b015-dce9e478fdbb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:52.786991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 870/1731] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:52.791420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c665d-2f7a-4824-b8eb-2273c294728c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:52.807020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c665d-2f7a-4824-b8eb-2273c294728c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:52.832352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd0152-6c6d-4970-996c-3edc8163524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:52.833090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd0152-6c6d-4970-996c-3edc8163524b admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:52.838662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd0152-6c6d-4970-996c-3edc8163524b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:52.838981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd0152-6c6d-4970-996c-3edc8163524b admin admin] PATH_INFO: `/v3/projects/5d999cbd937b48ce926709a4e53c442e/users/67283fbc13ea4ba983e37ecd35bba346/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:52.898608 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd0152-6c6d-4970-996c-3edc8163524b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d999cbd937b48ce926709a4e53c442e, user_id=67283fbc13ea4ba983e37ecd35bba346, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:52.918051 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd0152-6c6d-4970-996c-3edc8163524b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:52.956636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 862/1732] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:52 2022] PUT /identity/v3/projects/5d999cbd937b48ce926709a4e53c442e/users/67283fbc13ea4ba983e37ecd35bba346/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:52.960540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260a62c-7ae7-4118-b015-dce9e478fdbb admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:52.975620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260a62c-7ae7-4118-b015-dce9e478fdbb admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:53.064975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:53.278347 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dffb8c-2f36-458d-b9a4-5e1464c85054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:53.278805 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dffb8c-2f36-458d-b9a4-5e1464c85054 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:53.282623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dffb8c-2f36-458d-b9a4-5e1464c85054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:53.282623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dffb8c-2f36-458d-b9a4-5e1464c85054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:53.291809 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dffb8c-2f36-458d-b9a4-5e1464c85054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:53.296482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dffb8c-2f36-458d-b9a4-5e1464c85054 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:53.324536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 871/1733] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:23:53.328048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd0152-6c6d-4970-996c-3edc8163524b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:53.345754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd0152-6c6d-4970-996c-3edc8163524b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:53.359739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a9a5b-63a3-4c10-8167-c53b281e7664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:53.360491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a9a5b-63a3-4c10-8167-c53b281e7664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:53.360797 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a9a5b-63a3-4c10-8167-c53b281e7664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:53.361084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a9a5b-63a3-4c10-8167-c53b281e7664 admin admin] PATH_INFO: `/v3/projects/5d999cbd937b48ce926709a4e53c442e/users/67283fbc13ea4ba983e37ecd35bba346/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:53.383276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a9a5b-63a3-4c10-8167-c53b281e7664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d999cbd937b48ce926709a4e53c442e, user_id=67283fbc13ea4ba983e37ecd35bba346, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:53.412801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a9a5b-63a3-4c10-8167-c53b281e7664 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:53.439409 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dffb8c-2f36-458d-b9a4-5e1464c85054 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:53.442143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e6dffb8c-2f36-458d-b9a4-5e1464c85054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:53.488593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dffb8c-2f36-458d-b9a4-5e1464c85054 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:53.490424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 863/1734] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:23:53 2022] PUT /identity/v3/projects/5d999cbd937b48ce926709a4e53c442e/users/67283fbc13ea4ba983e37ecd35bba346/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:53.499403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcb44a-d43f-4526-a79d-6a78d798bdb3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:53.499696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcb44a-d43f-4526-a79d-6a78d798bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:53.501271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcb44a-d43f-4526-a79d-6a78d798bdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:53.609521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-90dcb44a-d43f-4526-a79d-6a78d798bdb3 None None] MFA Rules not processed for user `cde02839effc4354a4fd7e82c1dc8e26`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:53.628450 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-90dcb44a-d43f-4526-a79d-6a78d798bdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:53.704291 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:53.705356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:53.705801 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:53.706222 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] PATH_INFO: `/v3/projects/94477a3f4db448a1bc29ff7c8f54fdc9` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:53.708988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94477a3f4db448a1bc29ff7c8f54fdc9)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:53.711140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:53.822640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94477a3f4db448a1bc29ff7c8f54fdc9', 'request_id': 'req-44edff7d-cec6-48fd-8966-f67fef060a37'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:53.844635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 864/1735] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:53.850585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6603b-e6a1-47c3-95a7-2f35b1f3e5c8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:53.850877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6603b-e6a1-47c3-95a7-2f35b1f3e5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:53.851149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6603b-e6a1-47c3-95a7-2f35b1f3e5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:53.858787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94477a3f4db448a1bc29ff7c8f54fdc9', 'request_id': 'req-44edff7d-cec6-48fd-8966-f67fef060a37'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:53.889538 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94477a3f4db448a1bc29ff7c8f54fdc9', 'request_id': 'req-44edff7d-cec6-48fd-8966-f67fef060a37'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:53.932312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d7c6603b-e6a1-47c3-95a7-2f35b1f3e5c8 None None] MFA Rules not processed for user `67283fbc13ea4ba983e37ecd35bba346`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:53.935877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d7c6603b-e6a1-47c3-95a7-2f35b1f3e5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:53.961193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] The token cache is being invalidate because project 94477a3f4db448a1bc29ff7c8f54fdc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:23:53.961659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:53.962464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:53.965450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 872/1736] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:23:53 2022] DELETE /identity/v3/projects/94477a3f4db448a1bc29ff7c8f54fdc9 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:53.975032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:53.978436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:54.035339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:54.122910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:54.139301 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 865/1737] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:54.193470 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edff7d-cec6-48fd-8966-f67fef060a37 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:54.210145 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:54.211726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:54.213191 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:54.214506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] PATH_INFO: `/v3/users/d5410545c5e043e4aba606b4a4be8132` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:54.217896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5410545c5e043e4aba606b4a4be8132)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:54.223812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:54.228752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6603b-e6a1-47c3-95a7-2f35b1f3e5c8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:54.230627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d7c6603b-e6a1-47c3-95a7-2f35b1f3e5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:54.342918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5410545c5e043e4aba606b4a4be8132'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:54.343816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5410545c5e043e4aba606b4a4be8132'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:54.357392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5410545c5e043e4aba606b4a4be8132'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:54.374150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5410545c5e043e4aba606b4a4be8132'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:54.375020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5410545c5e043e4aba606b4a4be8132'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:54.406738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 873/1738] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:23:53 2022] DELETE /identity/v3/users/d5410545c5e043e4aba606b4a4be8132 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:54.426412 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6603b-e6a1-47c3-95a7-2f35b1f3e5c8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:54.580017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebdfec-14d9-4cbc-bd25-fe1a86b61fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:54.582778 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebdfec-14d9-4cbc-bd25-fe1a86b61fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:54.583747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebdfec-14d9-4cbc-bd25-fe1a86b61fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:54.584041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebdfec-14d9-4cbc-bd25-fe1a86b61fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:54.589687 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-abebdfec-14d9-4cbc-bd25-fe1a86b61fe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:54.834176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebdfec-14d9-4cbc-bd25-fe1a86b61fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:54.835805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebdfec-14d9-4cbc-bd25-fe1a86b61fe1 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:54.865998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 866/1739] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:23:55.020494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:55.023363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:55.053437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78111e4a-4add-481e-b52d-74babcff8030 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:55.063820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d148d2-afe0-48e2-bf1a-a58aa118be42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:55.064766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d148d2-afe0-48e2-bf1a-a58aa118be42 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:55.065062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d148d2-afe0-48e2-bf1a-a58aa118be42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:55.065345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d148d2-afe0-48e2-bf1a-a58aa118be42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:55.070848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f4d148d2-afe0-48e2-bf1a-a58aa118be42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:55.207748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d148d2-afe0-48e2-bf1a-a58aa118be42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:55.209895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d148d2-afe0-48e2-bf1a-a58aa118be42 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:55.225498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 874/1740] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:55.241188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33765f9-e0b9-4a2e-b5af-2d8dd770f1d1 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:55.241474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33765f9-e0b9-4a2e-b5af-2d8dd770f1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:55.241751 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33765f9-e0b9-4a2e-b5af-2d8dd770f1d1 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:55.243449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 867/1741] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:23:55.256120 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5573-a110-4ba1-b325-49c5234cbc6a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:55.256652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5573-a110-4ba1-b325-49c5234cbc6a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:55.257129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5573-a110-4ba1-b325-49c5234cbc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:55.334211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ae9d5573-a110-4ba1-b325-49c5234cbc6a None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:55.342910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ae9d5573-a110-4ba1-b325-49c5234cbc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:55.538490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:55.640524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 875/1742] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:23:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:55.656364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33765f9-e0b9-4a2e-b5af-2d8dd770f1d1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:55.659186 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e33765f9-e0b9-4a2e-b5af-2d8dd770f1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:55.826051 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:55.876468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33765f9-e0b9-4a2e-b5af-2d8dd770f1d1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:55.886869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:55.889495 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:55.889979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:55.890301 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] PATH_INFO: `/v3/users/dc03aea306754b19a6691036d1fdf2a8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:55.908250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc03aea306754b19a6691036d1fdf2a8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:55.914289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:55.978820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d5573-a110-4ba1-b325-49c5234cbc6a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:55.981228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ae9d5573-a110-4ba1-b325-49c5234cbc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:56.020698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d5573-a110-4ba1-b325-49c5234cbc6a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:56.057467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7811b-e279-4c8e-b5ed-0cd7b5034cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:56.059338 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7811b-e279-4c8e-b5ed-0cd7b5034cce service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:56.060293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7811b-e279-4c8e-b5ed-0cd7b5034cce service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:56.063522 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7811b-e279-4c8e-b5ed-0cd7b5034cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:56.087498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc03aea306754b19a6691036d1fdf2a8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:56.095928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7811b-e279-4c8e-b5ed-0cd7b5034cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:56.103175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7811b-e279-4c8e-b5ed-0cd7b5034cce service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:56.131376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc03aea306754b19a6691036d1fdf2a8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:56.138290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc03aea306754b19a6691036d1fdf2a8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:56.147094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 876/1743] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:56.159455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc03aea306754b19a6691036d1fdf2a8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:56.191949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc03aea306754b19a6691036d1fdf2a8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:56.207059 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 868/1744] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:23:55 2022] DELETE /identity/v3/users/dc03aea306754b19a6691036d1fdf2a8 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:56.208755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb27f7b-0c57-4bd2-b6cc-9dda10549053 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:56.209053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb27f7b-0c57-4bd2-b6cc-9dda10549053 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:56.209329 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb27f7b-0c57-4bd2-b6cc-9dda10549053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:56.251790 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fdb27f7b-0c57-4bd2-b6cc-9dda10549053 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:56.253137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fdb27f7b-0c57-4bd2-b6cc-9dda10549053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:56.457482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 877/1745] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:56.496316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:56.500332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:56.659193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbc671-61af-4db9-ae58-22e6ca504fed admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:56.668473 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90609a4-ed6d-4482-b99d-fb6b76a0b4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:56.669044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90609a4-ed6d-4482-b99d-fb6b76a0b4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:56.669329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90609a4-ed6d-4482-b99d-fb6b76a0b4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:56.669607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90609a4-ed6d-4482-b99d-fb6b76a0b4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:56.690718 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90609a4-ed6d-4482-b99d-fb6b76a0b4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:56.692469 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90609a4-ed6d-4482-b99d-fb6b76a0b4d4 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:56.718202 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 869/1746] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:23:57.231047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639cd10-b12c-4907-a545-cdb0fc0c9669 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:57.232863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639cd10-b12c-4907-a545-cdb0fc0c9669 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:57.232863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639cd10-b12c-4907-a545-cdb0fc0c9669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:57.269973 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9639cd10-b12c-4907-a545-cdb0fc0c9669 None None] MFA Rules not processed for user `85158030e4904eab877dc5da3a6bbd33`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:57.271341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9639cd10-b12c-4907-a545-cdb0fc0c9669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:57.470683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 878/1747] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:58.688399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52695e81-a719-4829-a5cc-396c70ce1fb4 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:58.689069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52695e81-a719-4829-a5cc-396c70ce1fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:58.689178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52695e81-a719-4829-a5cc-396c70ce1fb4 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:58.691036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 870/1748] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:23:58.714422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639cd10-b12c-4907-a545-cdb0fc0c9669 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:58.716060 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9639cd10-b12c-4907-a545-cdb0fc0c9669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:58.776381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639cd10-b12c-4907-a545-cdb0fc0c9669 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:58.793315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86425e-fea8-45f6-a2ab-4e2f5556671d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:58.793603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86425e-fea8-45f6-a2ab-4e2f5556671d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:58.793882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86425e-fea8-45f6-a2ab-4e2f5556671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:58.803019 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:58.803677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:58.803963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:58.803963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6 admin admin] PATH_INFO: `/v3/projects/7ba06b29b8cd4d7fb1c4fc20fd101b3e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:58.806443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba06b29b8cd4d7fb1c4fc20fd101b3e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:58.808434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:58.879541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fa86425e-fea8-45f6-a2ab-4e2f5556671d None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:58.881953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fa86425e-fea8-45f6-a2ab-4e2f5556671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:59.011172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba06b29b8cd4d7fb1c4fc20fd101b3e', 'request_id': 'req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:59.027177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba06b29b8cd4d7fb1c4fc20fd101b3e', 'request_id': 'req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:59.046778 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba06b29b8cd4d7fb1c4fc20fd101b3e', 'request_id': 'req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:59.067193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:59.069043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6 admin admin] The token cache is being invalidate because project 7ba06b29b8cd4d7fb1c4fc20fd101b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:23:59.069560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:59.077258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-32e9bcc9-e7ae-4bdc-8a9d-28a911a0c3e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:59.085854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 879/1749] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:23:58 2022] DELETE /identity/v3/projects/7ba06b29b8cd4d7fb1c4fc20fd101b3e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:59.087437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e991720-794b-4015-b8fc-fd8cfccc3c96 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:59.087930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e991720-794b-4015-b8fc-fd8cfccc3c96 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:59.088294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e991720-794b-4015-b8fc-fd8cfccc3c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:59.105563 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:59.123516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 871/1750] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:23:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:23:59.132867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0e991720-794b-4015-b8fc-fd8cfccc3c96 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:59.134255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0e991720-794b-4015-b8fc-fd8cfccc3c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:59.387749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 880/1751] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:59.396812 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d80f4-4d4d-429f-a5e7-24968474f2ee None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:59.397115 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d80f4-4d4d-429f-a5e7-24968474f2ee None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:59.397898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d80f4-4d4d-429f-a5e7-24968474f2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:59.439859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a67d80f4-4d4d-429f-a5e7-24968474f2ee None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:23:59.442052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a67d80f4-4d4d-429f-a5e7-24968474f2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:59.473531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 872/1752] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:23:59.477902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e991720-794b-4015-b8fc-fd8cfccc3c96 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:59.490670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e991720-794b-4015-b8fc-fd8cfccc3c96 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:59.520632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae70c1-7921-4dff-aea2-c0c79692571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:59.521849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae70c1-7921-4dff-aea2-c0c79692571b admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:59.536680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae70c1-7921-4dff-aea2-c0c79692571b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:59.541663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae70c1-7921-4dff-aea2-c0c79692571b admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:59.545600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae70c1-7921-4dff-aea2-c0c79692571b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:23:59.547327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae70c1-7921-4dff-aea2-c0c79692571b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:59.550169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae70c1-7921-4dff-aea2-c0c79692571b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:59.573993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 881/1753] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:23:59.577773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d80f4-4d4d-429f-a5e7-24968474f2ee None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:59.612611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d80f4-4d4d-429f-a5e7-24968474f2ee None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:59.627799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b990df-0648-4cb7-962b-963046fd51d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:59.628750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b990df-0648-4cb7-962b-963046fd51d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:59.629266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b990df-0648-4cb7-962b-963046fd51d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:59.629736 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b990df-0648-4cb7-962b-963046fd51d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:59.630581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b990df-0648-4cb7-962b-963046fd51d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:59.641421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b990df-0648-4cb7-962b-963046fd51d3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:59.657512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae70c1-7921-4dff-aea2-c0c79692571b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:59.658701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-73ae70c1-7921-4dff-aea2-c0c79692571b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:59.690031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae70c1-7921-4dff-aea2-c0c79692571b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:59.705356 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 873/1754] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:23:59 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:23:59.709846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b990df-0648-4cb7-962b-963046fd51d3 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:59.709969 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:59.710537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:59.710829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:59.711110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] PATH_INFO: `/v3/projects/8851f11d59ac48c49ae11a3386fb13d5` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:23:59.713975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8851f11d59ac48c49ae11a3386fb13d5)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:23:59.736040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:23:59.885572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8851f11d59ac48c49ae11a3386fb13d5', 'request_id': 'req-08bbb971-3187-473f-88dd-2cfa1304d764'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:59.891114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b990df-0648-4cb7-962b-963046fd51d3 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:23:59.901841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8851f11d59ac48c49ae11a3386fb13d5', 'request_id': 'req-08bbb971-3187-473f-88dd-2cfa1304d764'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:59.913637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8851f11d59ac48c49ae11a3386fb13d5', 'request_id': 'req-08bbb971-3187-473f-88dd-2cfa1304d764'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:59.952013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] The token cache is being invalidate because project 8851f11d59ac48c49ae11a3386fb13d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:23:59.954500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:59.964102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:23:59.971496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 882/1755] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:23:59 2022] DELETE /identity/v3/projects/8851f11d59ac48c49ae11a3386fb13d5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:23:59.973352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:23:59.976281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:23:59.998279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893f6b0-8fca-4e58-ae8c-d18fae583cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:23:59.998563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893f6b0-8fca-4e58-ae8c-d18fae583cad admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:23:59.999195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893f6b0-8fca-4e58-ae8c-d18fae583cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:23:59.999195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893f6b0-8fca-4e58-ae8c-d18fae583cad admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:00.000893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893f6b0-8fca-4e58-ae8c-d18fae583cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:00.003338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893f6b0-8fca-4e58-ae8c-d18fae583cad admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:00.036240 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 874/1756] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:23:59 2022] POST /identity/v3/users => generated 290 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:00.037455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893f6b0-8fca-4e58-ae8c-d18fae583cad admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:00.039488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a893f6b0-8fca-4e58-ae8c-d18fae583cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:00.061119 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893f6b0-8fca-4e58-ae8c-d18fae583cad admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:00.076340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:00.077381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:00.077887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:00.078497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] PATH_INFO: `/v3/users/f17f70d9a7ef4524a105c39780f0806e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:00.080897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17f70d9a7ef4524a105c39780f0806e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:00.083230 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:00.111490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbb971-3187-473f-88dd-2cfa1304d764 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:00.123892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c4aa-b382-4e49-87bf-54d2dab230de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:00.126475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c4aa-b382-4e49-87bf-54d2dab230de service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:00.127016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c4aa-b382-4e49-87bf-54d2dab230de service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:00.127364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c4aa-b382-4e49-87bf-54d2dab230de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:00.131926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3033c4aa-b382-4e49-87bf-54d2dab230de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:00.181474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c4aa-b382-4e49-87bf-54d2dab230de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:00.183305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c4aa-b382-4e49-87bf-54d2dab230de service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:00.184457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17f70d9a7ef4524a105c39780f0806e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:00.199746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:00.212212 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:00.220892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 883/1757] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:23:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:00.222330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c4aa-b382-4e49-87bf-54d2dab230de service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:00.226638 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3033c4aa-b382-4e49-87bf-54d2dab230de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:00.235326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17f70d9a7ef4524a105c39780f0806e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:00.236069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17f70d9a7ef4524a105c39780f0806e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:00.255543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17f70d9a7ef4524a105c39780f0806e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:00.263285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c4aa-b382-4e49-87bf-54d2dab230de service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:00.274420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aac144-06b2-4afb-ae9b-12916c735c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:00.274906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aac144-06b2-4afb-ae9b-12916c735c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:00.275186 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aac144-06b2-4afb-ae9b-12916c735c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:00.275454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aac144-06b2-4afb-ae9b-12916c735c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:00.276154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aac144-06b2-4afb-ae9b-12916c735c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:00.276265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17f70d9a7ef4524a105c39780f0806e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:00.278052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aac144-06b2-4afb-ae9b-12916c735c96 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:00.295040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 875/1758] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:00 2022] DELETE /identity/v3/users/f17f70d9a7ef4524a105c39780f0806e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:00.304085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 884/1759] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:00.309533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:00.312591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:00.484464 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461237a-5f32-40aa-8cf3-f098ea0cbaa3 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:00.494515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084c664-2383-46d7-a0ee-a1e6eb5d208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:00.495516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084c664-2383-46d7-a0ee-a1e6eb5d208d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:00.495839 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084c664-2383-46d7-a0ee-a1e6eb5d208d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:00.498625 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084c664-2383-46d7-a0ee-a1e6eb5d208d admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:00.499351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084c664-2383-46d7-a0ee-a1e6eb5d208d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:00.501515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084c664-2383-46d7-a0ee-a1e6eb5d208d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:00.533396 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 876/1760] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:00.534234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aac144-06b2-4afb-ae9b-12916c735c96 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:00.555503 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aac144-06b2-4afb-ae9b-12916c735c96 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:00.575356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93485dd7-cddc-4861-9be2-6b9dd401feae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:00.576053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93485dd7-cddc-4861-9be2-6b9dd401feae admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:00.576332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93485dd7-cddc-4861-9be2-6b9dd401feae admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:00.576831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93485dd7-cddc-4861-9be2-6b9dd401feae admin admin] PATH_INFO: `/v3/projects/868d04972ae14f6f982e772543317718/users/2db6c12c54a24dc6b67077de31a9e110/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:00.608403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93485dd7-cddc-4861-9be2-6b9dd401feae admin admin] RBAC: Authorizing `identity:create_grant(project_id=868d04972ae14f6f982e772543317718, user_id=2db6c12c54a24dc6b67077de31a9e110, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:00.611305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93485dd7-cddc-4861-9be2-6b9dd401feae admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:00.657176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 885/1761] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:00 2022] PUT /identity/v3/projects/868d04972ae14f6f982e772543317718/users/2db6c12c54a24dc6b67077de31a9e110/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:00.658309 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b67b4-171a-4c65-bc18-b0ab69ef854d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:00.658749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b67b4-171a-4c65-bc18-b0ab69ef854d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:00.659200 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b67b4-171a-4c65-bc18-b0ab69ef854d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:00.768948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-723b67b4-171a-4c65-bc18-b0ab69ef854d None None] MFA Rules not processed for user `2db6c12c54a24dc6b67077de31a9e110`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:00.771010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-723b67b4-171a-4c65-bc18-b0ab69ef854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:00.912320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 877/1762] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:00.913859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93485dd7-cddc-4861-9be2-6b9dd401feae admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.049262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93485dd7-cddc-4861-9be2-6b9dd401feae admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.069526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2ca21-55a0-44c0-bd35-39514edf0c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.070182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ca21-55a0-44c0-bd35-39514edf0c12 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.070464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ca21-55a0-44c0-bd35-39514edf0c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.070735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ca21-55a0-44c0-bd35-39514edf0c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.071535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2ca21-55a0-44c0-bd35-39514edf0c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.073654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2ca21-55a0-44c0-bd35-39514edf0c12 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.128872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 886/1763] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:00 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:01.129258 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b67b4-171a-4c65-bc18-b0ab69ef854d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.143956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b67b4-171a-4c65-bc18-b0ab69ef854d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.157150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2ca21-55a0-44c0-bd35-39514edf0c12 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.159009 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a1d2ca21-55a0-44c0-bd35-39514edf0c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:01.245781 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c51af-2485-4f8d-a985-74b0bc5ee55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.246523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c51af-2485-4f8d-a985-74b0bc5ee55c admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.246800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c51af-2485-4f8d-a985-74b0bc5ee55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.247079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c51af-2485-4f8d-a985-74b0bc5ee55c admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.247722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c51af-2485-4f8d-a985-74b0bc5ee55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.249828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c51af-2485-4f8d-a985-74b0bc5ee55c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.250430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2ca21-55a0-44c0-bd35-39514edf0c12 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.255755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf897c4-b801-4faf-ae3c-c00415b59500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.256493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf897c4-b801-4faf-ae3c-c00415b59500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.256882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf897c4-b801-4faf-ae3c-c00415b59500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.257218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf897c4-b801-4faf-ae3c-c00415b59500 admin admin] PATH_INFO: `/v3/projects/d1370231433643ff9a9fb4beac3bf2e9` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.258444 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf897c4-b801-4faf-ae3c-c00415b59500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1370231433643ff9a9fb4beac3bf2e9)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.259020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:01.260615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf897c4-b801-4faf-ae3c-c00415b59500 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.282635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 878/1764] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:01 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:01.283733 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c51af-2485-4f8d-a985-74b0bc5ee55c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.295032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c51af-2485-4f8d-a985-74b0bc5ee55c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.300907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02ed70-7e24-4be4-b462-e8db33b4930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.301582 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02ed70-7e24-4be4-b462-e8db33b4930f admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.301866 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02ed70-7e24-4be4-b462-e8db33b4930f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.302137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02ed70-7e24-4be4-b462-e8db33b4930f admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.302790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02ed70-7e24-4be4-b462-e8db33b4930f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.304384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02ed70-7e24-4be4-b462-e8db33b4930f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.314445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4bf897c4-b801-4faf-ae3c-c00415b59500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1370231433643ff9a9fb4beac3bf2e9', 'request_id': 'req-4bf897c4-b801-4faf-ae3c-c00415b59500'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:01.317781 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 879/1765] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:01.318192 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:01.319153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02ed70-7e24-4be4-b462-e8db33b4930f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.321106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4bf897c4-b801-4faf-ae3c-c00415b59500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1370231433643ff9a9fb4beac3bf2e9', 'request_id': 'req-4bf897c4-b801-4faf-ae3c-c00415b59500'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:01.328509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4bf897c4-b801-4faf-ae3c-c00415b59500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1370231433643ff9a9fb4beac3bf2e9', 'request_id': 'req-4bf897c4-b801-4faf-ae3c-c00415b59500'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:01.328941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02ed70-7e24-4be4-b462-e8db33b4930f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.343785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4bf897c4-b801-4faf-ae3c-c00415b59500 admin admin] The token cache is being invalidate because project d1370231433643ff9a9fb4beac3bf2e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:01.344225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4bf897c4-b801-4faf-ae3c-c00415b59500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:01.344927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4bf897c4-b801-4faf-ae3c-c00415b59500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:01.346685 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 887/1766] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:01 2022] DELETE /identity/v3/projects/d1370231433643ff9a9fb4beac3bf2e9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:01.353013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d43526-10ed-46f9-a6d7-463fe95cc863 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.354694 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d43526-10ed-46f9-a6d7-463fe95cc863 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.354694 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d43526-10ed-46f9-a6d7-463fe95cc863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.374663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-46d43526-10ed-46f9-a6d7-463fe95cc863 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:01.376315 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-46d43526-10ed-46f9-a6d7-463fe95cc863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:01.430372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591bf97-de67-4ac2-80aa-961b28fb5020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.431335 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591bf97-de67-4ac2-80aa-961b28fb5020 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.431843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591bf97-de67-4ac2-80aa-961b28fb5020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.432120 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591bf97-de67-4ac2-80aa-961b28fb5020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.433065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591bf97-de67-4ac2-80aa-961b28fb5020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.434683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591bf97-de67-4ac2-80aa-961b28fb5020 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.446323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 880/1767] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:01.450534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591bf97-de67-4ac2-80aa-961b28fb5020 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.452228 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5591bf97-de67-4ac2-80aa-961b28fb5020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:01.453817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 888/1768] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:01.461548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e905cc-137e-45e8-abc4-7dd1f0790926 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.461818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e905cc-137e-45e8-abc4-7dd1f0790926 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.462094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e905cc-137e-45e8-abc4-7dd1f0790926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.464984 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591bf97-de67-4ac2-80aa-961b28fb5020 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.469473 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53c2e9-44f4-4a04-bcf5-206c4decc3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.470329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53c2e9-44f4-4a04-bcf5-206c4decc3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.471460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53c2e9-44f4-4a04-bcf5-206c4decc3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.471743 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53c2e9-44f4-4a04-bcf5-206c4decc3f2 admin admin] PATH_INFO: `/v3/projects/23ef5ca997d0437a8a9f13829479aad7/users/15aaa21ff5c9489cab7074a2d7d92c28/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.482289 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-14e905cc-137e-45e8-abc4-7dd1f0790926 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:01.483787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-14e905cc-137e-45e8-abc4-7dd1f0790926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:01.487677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53c2e9-44f4-4a04-bcf5-206c4decc3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ef5ca997d0437a8a9f13829479aad7, user_id=15aaa21ff5c9489cab7074a2d7d92c28, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.490527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53c2e9-44f4-4a04-bcf5-206c4decc3f2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.492311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 889/1769] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:01.497160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e905cc-137e-45e8-abc4-7dd1f0790926 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.510552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e905cc-137e-45e8-abc4-7dd1f0790926 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.511339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 881/1770] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:01 2022] PUT /identity/v3/projects/23ef5ca997d0437a8a9f13829479aad7/users/15aaa21ff5c9489cab7074a2d7d92c28/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:01.521730 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2fcd0-4a5a-46f1-8964-d4e748b02d86 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.522094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2fcd0-4a5a-46f1-8964-d4e748b02d86 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.522271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2fcd0-4a5a-46f1-8964-d4e748b02d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.549660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8ef2fcd0-4a5a-46f1-8964-d4e748b02d86 None None] MFA Rules not processed for user `15aaa21ff5c9489cab7074a2d7d92c28`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:01.550908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8ef2fcd0-4a5a-46f1-8964-d4e748b02d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:01.568646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae309e2-3191-4205-9a12-017fe95555f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.569405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae309e2-3191-4205-9a12-017fe95555f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.569687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae309e2-3191-4205-9a12-017fe95555f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.569962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae309e2-3191-4205-9a12-017fe95555f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.570802 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae309e2-3191-4205-9a12-017fe95555f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:01.571105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae309e2-3191-4205-9a12-017fe95555f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.572767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae309e2-3191-4205-9a12-017fe95555f3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.588908 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 890/1771] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:24:01.590603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae309e2-3191-4205-9a12-017fe95555f3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.604981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae309e2-3191-4205-9a12-017fe95555f3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.610538 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53d213-6f1b-4dbb-8d9a-63b1cd529fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.611154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53d213-6f1b-4dbb-8d9a-63b1cd529fea admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.611422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53d213-6f1b-4dbb-8d9a-63b1cd529fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.611695 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53d213-6f1b-4dbb-8d9a-63b1cd529fea admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.612327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53d213-6f1b-4dbb-8d9a-63b1cd529fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.614319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53d213-6f1b-4dbb-8d9a-63b1cd529fea admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.622897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 882/1772] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:01.626917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2fcd0-4a5a-46f1-8964-d4e748b02d86 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.639395 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2fcd0-4a5a-46f1-8964-d4e748b02d86 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.644632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1480b1-22bb-490d-9a1c-61619e9ffcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.645281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1480b1-22bb-490d-9a1c-61619e9ffcf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.645561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1480b1-22bb-490d-9a1c-61619e9ffcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.645833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1480b1-22bb-490d-9a1c-61619e9ffcf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.646583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1480b1-22bb-490d-9a1c-61619e9ffcf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.648288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 891/1773] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:01 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:01.649009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1480b1-22bb-490d-9a1c-61619e9ffcf0 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.652343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53d213-6f1b-4dbb-8d9a-63b1cd529fea admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.685887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 883/1774] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:01 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:01.689969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1480b1-22bb-490d-9a1c-61619e9ffcf0 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.712886 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:01.720975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:01.739405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53d213-6f1b-4dbb-8d9a-63b1cd529fea admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.765158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1480b1-22bb-490d-9a1c-61619e9ffcf0 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.778074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de5be0-1301-430f-8b2d-ee2dcd340d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.779005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de5be0-1301-430f-8b2d-ee2dcd340d2d admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.779381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de5be0-1301-430f-8b2d-ee2dcd340d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.779752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de5be0-1301-430f-8b2d-ee2dcd340d2d admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.780519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de5be0-1301-430f-8b2d-ee2dcd340d2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.782836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de5be0-1301-430f-8b2d-ee2dcd340d2d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.806874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ecf03-1fdb-4ea6-b583-59e0c8a3ec2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.807554 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ecf03-1fdb-4ea6-b583-59e0c8a3ec2f admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.807967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ecf03-1fdb-4ea6-b583-59e0c8a3ec2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.808193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ecf03-1fdb-4ea6-b583-59e0c8a3ec2f admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.808918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ecf03-1fdb-4ea6-b583-59e0c8a3ec2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.811158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ecf03-1fdb-4ea6-b583-59e0c8a3ec2f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.812850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 884/1775] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:01 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:01.813822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de5be0-1301-430f-8b2d-ee2dcd340d2d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.825918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de5be0-1301-430f-8b2d-ee2dcd340d2d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.832599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00577b-a7d8-4328-b468-0136166f1af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.833391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00577b-a7d8-4328-b468-0136166f1af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.833673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00577b-a7d8-4328-b468-0136166f1af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.833998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00577b-a7d8-4328-b468-0136166f1af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.834929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00577b-a7d8-4328-b468-0136166f1af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.836738 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00577b-a7d8-4328-b468-0136166f1af5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.842332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 892/1776] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:01 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:01.844553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ecf03-1fdb-4ea6-b583-59e0c8a3ec2f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.848692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 885/1777] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:01.853032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00577b-a7d8-4328-b468-0136166f1af5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.858004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ecf03-1fdb-4ea6-b583-59e0c8a3ec2f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.863793 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6d354-6377-4d35-bdc6-f8eced846d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.864520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00577b-a7d8-4328-b468-0136166f1af5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.864766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6d354-6377-4d35-bdc6-f8eced846d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.865197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6d354-6377-4d35-bdc6-f8eced846d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.865812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6d354-6377-4d35-bdc6-f8eced846d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.866620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6d354-6377-4d35-bdc6-f8eced846d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.868384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6d354-6377-4d35-bdc6-f8eced846d42 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.869139 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e725ac-bf0a-46aa-9e91-592bfa83e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.869797 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e725ac-bf0a-46aa-9e91-592bfa83e58e admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.870075 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e725ac-bf0a-46aa-9e91-592bfa83e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.870554 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e725ac-bf0a-46aa-9e91-592bfa83e58e admin admin] PATH_INFO: `/v3/projects/7ad9d515893b4115acb47fb0a34da373/users/8a4289ebbc3e4a4593832e7ea425e265/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.880261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 893/1778] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:01.885712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6d354-6377-4d35-bdc6-f8eced846d42 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.889508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e725ac-bf0a-46aa-9e91-592bfa83e58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad9d515893b4115acb47fb0a34da373, user_id=8a4289ebbc3e4a4593832e7ea425e265, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.892269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e725ac-bf0a-46aa-9e91-592bfa83e58e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.901747 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6d354-6377-4d35-bdc6-f8eced846d42 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.906732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1c108-2e63-4015-9132-7872d9eb5d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.907337 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1c108-2e63-4015-9132-7872d9eb5d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.907613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1c108-2e63-4015-9132-7872d9eb5d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.907928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1c108-2e63-4015-9132-7872d9eb5d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.908565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1c108-2e63-4015-9132-7872d9eb5d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.910441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1c108-2e63-4015-9132-7872d9eb5d51 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.917040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 886/1779] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:01 2022] PUT /identity/v3/projects/7ad9d515893b4115acb47fb0a34da373/users/8a4289ebbc3e4a4593832e7ea425e265/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:01.920873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e725ac-bf0a-46aa-9e91-592bfa83e58e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.922907 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 894/1780] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:01.926543 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1c108-2e63-4015-9132-7872d9eb5d51 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:01.937772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1c108-2e63-4015-9132-7872d9eb5d51 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.983378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e725ac-bf0a-46aa-9e91-592bfa83e58e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:01.988244 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a1588-f67f-40e9-a217-bedcd4a2f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.988922 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a1588-f67f-40e9-a217-bedcd4a2f878 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.989199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a1588-f67f-40e9-a217-bedcd4a2f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.989468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a1588-f67f-40e9-a217-bedcd4a2f878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:01.990104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a1588-f67f-40e9-a217-bedcd4a2f878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:01.991685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a1588-f67f-40e9-a217-bedcd4a2f878 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:01.993496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832b8f6-29e9-4dd7-ae8a-046ee07cda3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:01.994188 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832b8f6-29e9-4dd7-ae8a-046ee07cda3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:01.994463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832b8f6-29e9-4dd7-ae8a-046ee07cda3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:01.994736 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832b8f6-29e9-4dd7-ae8a-046ee07cda3b admin admin] PATH_INFO: `/v3/projects/4f26881654f64984a6bce166f724b19a/users/5c65659b7f07465992050e655148e364/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.001470 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 887/1781] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:02.005585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a1588-f67f-40e9-a217-bedcd4a2f878 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:02.009779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832b8f6-29e9-4dd7-ae8a-046ee07cda3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f26881654f64984a6bce166f724b19a, user_id=5c65659b7f07465992050e655148e364, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:02.012898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832b8f6-29e9-4dd7-ae8a-046ee07cda3b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:02.015210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a1588-f67f-40e9-a217-bedcd4a2f878 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:02.020823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca551890-0f6d-4952-9392-208204bd1d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:02.021489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca551890-0f6d-4952-9392-208204bd1d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.021766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca551890-0f6d-4952-9392-208204bd1d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.022041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca551890-0f6d-4952-9392-208204bd1d6f admin admin] PATH_INFO: `/v3/projects/7ad9d515893b4115acb47fb0a34da373/users/8a4289ebbc3e4a4593832e7ea425e265/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.024227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca551890-0f6d-4952-9392-208204bd1d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad9d515893b4115acb47fb0a34da373, user_id=8a4289ebbc3e4a4593832e7ea425e265, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:02.026986 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca551890-0f6d-4952-9392-208204bd1d6f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:02.028177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 895/1782] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:01 2022] PUT /identity/v3/projects/4f26881654f64984a6bce166f724b19a/users/5c65659b7f07465992050e655148e364/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:02.038311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 888/1783] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:02 2022] PUT /identity/v3/projects/7ad9d515893b4115acb47fb0a34da373/users/8a4289ebbc3e4a4593832e7ea425e265/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:02.039818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb9258-514b-4f98-93cc-b831333d1279 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.040102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb9258-514b-4f98-93cc-b831333d1279 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.040372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb9258-514b-4f98-93cc-b831333d1279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.049415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c816d77-7689-4269-9ef0-7c44c47d5ae3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.049701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c816d77-7689-4269-9ef0-7c44c47d5ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.049971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c816d77-7689-4269-9ef0-7c44c47d5ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.067122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-06eb9258-514b-4f98-93cc-b831333d1279 None None] MFA Rules not processed for user `5c65659b7f07465992050e655148e364`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:02.068326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-06eb9258-514b-4f98-93cc-b831333d1279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:02.076386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1c816d77-7689-4269-9ef0-7c44c47d5ae3 None None] MFA Rules not processed for user `8a4289ebbc3e4a4593832e7ea425e265`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:02.077594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1c816d77-7689-4269-9ef0-7c44c47d5ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:02.100667 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:02.121063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:02.135289 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 896/1784] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:02.140126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb9258-514b-4f98-93cc-b831333d1279 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:02.147606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 889/1785] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:02.158565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c816d77-7689-4269-9ef0-7c44c47d5ae3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:02.159921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1c816d77-7689-4269-9ef0-7c44c47d5ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:02.202876 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb9258-514b-4f98-93cc-b831333d1279 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:02.209007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb2869-0b30-4251-921e-acdcc12790a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:02.209743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb2869-0b30-4251-921e-acdcc12790a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.210008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb2869-0b30-4251-921e-acdcc12790a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.210286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb2869-0b30-4251-921e-acdcc12790a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.210996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb2869-0b30-4251-921e-acdcc12790a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:02.213016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb2869-0b30-4251-921e-acdcc12790a2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:02.224602 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c816d77-7689-4269-9ef0-7c44c47d5ae3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:02.228290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21158d-73ac-46cd-a17c-5cd5f7455f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:02.228968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21158d-73ac-46cd-a17c-5cd5f7455f4c service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.229249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21158d-73ac-46cd-a17c-5cd5f7455f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.229519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21158d-73ac-46cd-a17c-5cd5f7455f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.239574 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21158d-73ac-46cd-a17c-5cd5f7455f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:02.241701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21158d-73ac-46cd-a17c-5cd5f7455f4c service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:02.248350 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 897/1786] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:02 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:02.252310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb2869-0b30-4251-921e-acdcc12790a2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:02.253722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 890/1787] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:24:02.305760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21158d-73ac-46cd-a17c-5cd5f7455f4c service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:02.307588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9e21158d-73ac-46cd-a17c-5cd5f7455f4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:02.321544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21158d-73ac-46cd-a17c-5cd5f7455f4c service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:02.323243 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb2869-0b30-4251-921e-acdcc12790a2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:02.327987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8d760-5913-49a5-9c0b-e39006a70627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:02.328598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8d760-5913-49a5-9c0b-e39006a70627 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.328904 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8d760-5913-49a5-9c0b-e39006a70627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.329169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8d760-5913-49a5-9c0b-e39006a70627 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.329799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8d760-5913-49a5-9c0b-e39006a70627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:02.331756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8d760-5913-49a5-9c0b-e39006a70627 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:02.365238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 898/1788] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:02 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:02.366366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8d760-5913-49a5-9c0b-e39006a70627 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:02.378962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8d760-5913-49a5-9c0b-e39006a70627 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:02.385251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d19d9-2913-4697-a318-778c5d93ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:02.385923 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d19d9-2913-4697-a318-778c5d93ce17 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.386062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328842b-85ad-4518-ab17-b1587b1dec69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:02.386267 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d19d9-2913-4697-a318-778c5d93ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.386497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d19d9-2913-4697-a318-778c5d93ce17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.387223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328842b-85ad-4518-ab17-b1587b1dec69 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.387447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d19d9-2913-4697-a318-778c5d93ce17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:02.387581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328842b-85ad-4518-ab17-b1587b1dec69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.387954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328842b-85ad-4518-ab17-b1587b1dec69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.389082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d19d9-2913-4697-a318-778c5d93ce17 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:02.390128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0328842b-85ad-4518-ab17-b1587b1dec69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:02.404460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 899/1789] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:02.408497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d19d9-2913-4697-a318-778c5d93ce17 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:02.417935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d19d9-2913-4697-a318-778c5d93ce17 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:02.422598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e023f-9241-4fee-8ded-94841aa6c850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:02.423258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e023f-9241-4fee-8ded-94841aa6c850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.423543 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e023f-9241-4fee-8ded-94841aa6c850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.423821 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e023f-9241-4fee-8ded-94841aa6c850 admin admin] PATH_INFO: `/v3/projects/d11067aca0d04840a3a78584c12fbd8c/users/472269a855d645e9a798af834c9388d2/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.441064 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e023f-9241-4fee-8ded-94841aa6c850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11067aca0d04840a3a78584c12fbd8c, user_id=472269a855d645e9a798af834c9388d2, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:02.443911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e023f-9241-4fee-8ded-94841aa6c850 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:02.462336 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 900/1790] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:02 2022] PUT /identity/v3/projects/d11067aca0d04840a3a78584c12fbd8c/users/472269a855d645e9a798af834c9388d2/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:02.465932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328842b-85ad-4518-ab17-b1587b1dec69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:02.466390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e023f-9241-4fee-8ded-94841aa6c850 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:02.467049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328842b-85ad-4518-ab17-b1587b1dec69 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:02.482609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:02.482730 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 891/1791] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:02.540295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e023f-9241-4fee-8ded-94841aa6c850 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:02.544329 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ed91c-fbb7-4fd4-9a79-c007b43288a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:02.545002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ed91c-fbb7-4fd4-9a79-c007b43288a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.545285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ed91c-fbb7-4fd4-9a79-c007b43288a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.545560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ed91c-fbb7-4fd4-9a79-c007b43288a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.546202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ed91c-fbb7-4fd4-9a79-c007b43288a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:02.547992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ed91c-fbb7-4fd4-9a79-c007b43288a8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:02.562351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 901/1792] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:02.563525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328842b-85ad-4518-ab17-b1587b1dec69 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:02.577086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328842b-85ad-4518-ab17-b1587b1dec69 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:02.581995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac90675-7139-485a-9c88-b93a4518cfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:02.582659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac90675-7139-485a-9c88-b93a4518cfea admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.582939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac90675-7139-485a-9c88-b93a4518cfea admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.583214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac90675-7139-485a-9c88-b93a4518cfea admin admin] PATH_INFO: `/v3/projects/d11067aca0d04840a3a78584c12fbd8c/users/472269a855d645e9a798af834c9388d2/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.585173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac90675-7139-485a-9c88-b93a4518cfea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11067aca0d04840a3a78584c12fbd8c, user_id=472269a855d645e9a798af834c9388d2, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:02.587824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac90675-7139-485a-9c88-b93a4518cfea admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:02.598610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 892/1793] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:02 2022] PUT /identity/v3/projects/d11067aca0d04840a3a78584c12fbd8c/users/472269a855d645e9a798af834c9388d2/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:02.608823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ad7f1-66ff-4d96-b90c-1912cb75138b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.609211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ad7f1-66ff-4d96-b90c-1912cb75138b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.609484 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ad7f1-66ff-4d96-b90c-1912cb75138b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.636769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4d0ad7f1-66ff-4d96-b90c-1912cb75138b None None] MFA Rules not processed for user `472269a855d645e9a798af834c9388d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:02.638536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4d0ad7f1-66ff-4d96-b90c-1912cb75138b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:02.712413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 902/1794] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:02.726439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac90675-7139-485a-9c88-b93a4518cfea admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:02.763054 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:02.801762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac90675-7139-485a-9c88-b93a4518cfea admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:02.811980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8e416-f910-47b8-9f01-2f4a1c5d2e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:02.813084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8e416-f910-47b8-9f01-2f4a1c5d2e17 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:02.813364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8e416-f910-47b8-9f01-2f4a1c5d2e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:02.813638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8e416-f910-47b8-9f01-2f4a1c5d2e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:02.861537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8e416-f910-47b8-9f01-2f4a1c5d2e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:02.863299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8e416-f910-47b8-9f01-2f4a1c5d2e17 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:02.906113 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 893/1795] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:03.043999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ad7f1-66ff-4d96-b90c-1912cb75138b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:03.114611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ad7f1-66ff-4d96-b90c-1912cb75138b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:03.119253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:03.119893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:03.120190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:03.120504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] PATH_INFO: `/v3/users/5c65659b7f07465992050e655148e364` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:03.121657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c65659b7f07465992050e655148e364)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:03.123571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:03.162774 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:03.172325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c65659b7f07465992050e655148e364'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.172986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c65659b7f07465992050e655148e364'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.181028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c65659b7f07465992050e655148e364'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.187777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c65659b7f07465992050e655148e364'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.188405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c65659b7f07465992050e655148e364'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.205559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 903/1796] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:03 2022] DELETE /identity/v3/users/5c65659b7f07465992050e655148e364 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:03.210449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b4dd8-fae8-4d7c-8162-d35098a5ca2d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:03.210737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b4dd8-fae8-4d7c-8162-d35098a5ca2d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:03.211008 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b4dd8-fae8-4d7c-8162-d35098a5ca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:03.233458 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2c4b4dd8-fae8-4d7c-8162-d35098a5ca2d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:03.234699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2c4b4dd8-fae8-4d7c-8162-d35098a5ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:03.304740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 894/1797] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:03.314745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:03.316424 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:03.378581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a27b9-ffba-4248-9f5e-368a856fb254 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:03.382773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c38a9-6cb3-4a56-87b4-6b14808834b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:03.383387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c38a9-6cb3-4a56-87b4-6b14808834b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:03.383671 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c38a9-6cb3-4a56-87b4-6b14808834b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:03.383939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c38a9-6cb3-4a56-87b4-6b14808834b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:03.396971 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c38a9-6cb3-4a56-87b4-6b14808834b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:03.398622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c38a9-6cb3-4a56-87b4-6b14808834b6 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:03.410112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 904/1798] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:03.692805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b4dd8-fae8-4d7c-8162-d35098a5ca2d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:03.694727 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2c4b4dd8-fae8-4d7c-8162-d35098a5ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:03.708459 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b4dd8-fae8-4d7c-8162-d35098a5ca2d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:03.713763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:03.714485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:03.714769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:03.715048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] PATH_INFO: `/v3/projects/4f26881654f64984a6bce166f724b19a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:03.716258 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f26881654f64984a6bce166f724b19a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:03.718358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:03.768433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f26881654f64984a6bce166f724b19a', 'request_id': 'req-d59cd774-8b6d-49f2-952c-6d9e189cef8d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.776892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f26881654f64984a6bce166f724b19a', 'request_id': 'req-d59cd774-8b6d-49f2-952c-6d9e189cef8d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.783317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f26881654f64984a6bce166f724b19a', 'request_id': 'req-d59cd774-8b6d-49f2-952c-6d9e189cef8d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.793859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] The token cache is being invalidate because project 4f26881654f64984a6bce166f724b19a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:03.794148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.794790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.796564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 895/1799] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:03 2022] DELETE /identity/v3/projects/4f26881654f64984a6bce166f724b19a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:03.800468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c38a9-6cb3-4a56-87b4-6b14808834b6 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:03.823570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c38a9-6cb3-4a56-87b4-6b14808834b6 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:03.905163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368d217-f110-4655-bf88-4b0256d44ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:03.905845 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368d217-f110-4655-bf88-4b0256d44ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:03.906096 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368d217-f110-4655-bf88-4b0256d44ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:03.906369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368d217-f110-4655-bf88-4b0256d44ace admin admin] PATH_INFO: `/v3/users/472269a855d645e9a798af834c9388d2` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:03.907511 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368d217-f110-4655-bf88-4b0256d44ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=472269a855d645e9a798af834c9388d2)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:03.909485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368d217-f110-4655-bf88-4b0256d44ace admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:03.956658 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1368d217-f110-4655-bf88-4b0256d44ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '472269a855d645e9a798af834c9388d2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.957397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1368d217-f110-4655-bf88-4b0256d44ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '472269a855d645e9a798af834c9388d2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.967639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1368d217-f110-4655-bf88-4b0256d44ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '472269a855d645e9a798af834c9388d2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.972954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:03.976427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1368d217-f110-4655-bf88-4b0256d44ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '472269a855d645e9a798af834c9388d2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.977316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1368d217-f110-4655-bf88-4b0256d44ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '472269a855d645e9a798af834c9388d2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:03.998951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 905/1800] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:03 2022] DELETE /identity/v3/users/472269a855d645e9a798af834c9388d2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:04.371218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:04.373614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:04.390679 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cd774-8b6d-49f2-952c-6d9e189cef8d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:04.438315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:04.449210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cfcd3-62ca-47e8-b19e-40f55753290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:04.449883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cfcd3-62ca-47e8-b19e-40f55753290e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:04.450157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cfcd3-62ca-47e8-b19e-40f55753290e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:04.450557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cfcd3-62ca-47e8-b19e-40f55753290e admin admin] PATH_INFO: `/v3/projects/d11067aca0d04840a3a78584c12fbd8c` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:04.451749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cfcd3-62ca-47e8-b19e-40f55753290e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11067aca0d04840a3a78584c12fbd8c)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:04.453832 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cfcd3-62ca-47e8-b19e-40f55753290e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:04.501463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ed9cfcd3-62ca-47e8-b19e-40f55753290e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11067aca0d04840a3a78584c12fbd8c', 'request_id': 'req-ed9cfcd3-62ca-47e8-b19e-40f55753290e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:04.510443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ed9cfcd3-62ca-47e8-b19e-40f55753290e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11067aca0d04840a3a78584c12fbd8c', 'request_id': 'req-ed9cfcd3-62ca-47e8-b19e-40f55753290e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:04.517989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ed9cfcd3-62ca-47e8-b19e-40f55753290e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11067aca0d04840a3a78584c12fbd8c', 'request_id': 'req-ed9cfcd3-62ca-47e8-b19e-40f55753290e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:04.529689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ed9cfcd3-62ca-47e8-b19e-40f55753290e admin admin] The token cache is being invalidate because project d11067aca0d04840a3a78584c12fbd8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:04.529981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ed9cfcd3-62ca-47e8-b19e-40f55753290e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:04.530714 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ed9cfcd3-62ca-47e8-b19e-40f55753290e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:04.532342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 896/1801] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:04 2022] DELETE /identity/v3/projects/d11067aca0d04840a3a78584c12fbd8c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:04.537426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1da96-60f5-4ae9-af51-2bb239eb347c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:04.537897 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1da96-60f5-4ae9-af51-2bb239eb347c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:04.537988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1da96-60f5-4ae9-af51-2bb239eb347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:04.557919 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ecd1da96-60f5-4ae9-af51-2bb239eb347c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:04.559141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ecd1da96-60f5-4ae9-af51-2bb239eb347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:04.629048 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 906/1802] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:04.637347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56308fbe-f3a7-469d-90af-ae4c85c65264 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:04.637638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56308fbe-f3a7-469d-90af-ae4c85c65264 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:04.637917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56308fbe-f3a7-469d-90af-ae4c85c65264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:04.658225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-56308fbe-f3a7-469d-90af-ae4c85c65264 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:04.659442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-56308fbe-f3a7-469d-90af-ae4c85c65264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:04.668101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 897/1803] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:04.672453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1da96-60f5-4ae9-af51-2bb239eb347c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:04.684395 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1da96-60f5-4ae9-af51-2bb239eb347c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:04.689322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bc57a-7215-4a2e-adc7-2a5f6ebe4843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:04.689935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc57a-7215-4a2e-adc7-2a5f6ebe4843 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:04.690211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc57a-7215-4a2e-adc7-2a5f6ebe4843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:04.690480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc57a-7215-4a2e-adc7-2a5f6ebe4843 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:04.691284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bc57a-7215-4a2e-adc7-2a5f6ebe4843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:04.691591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bc57a-7215-4a2e-adc7-2a5f6ebe4843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:04.693245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bc57a-7215-4a2e-adc7-2a5f6ebe4843 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:04.706573 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 907/1804] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:24:04.710806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56308fbe-f3a7-469d-90af-ae4c85c65264 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:04.720143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56308fbe-f3a7-469d-90af-ae4c85c65264 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:04.724868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b11e-4058-4fcf-b981-9bce20842ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:04.725520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b11e-4058-4fcf-b981-9bce20842ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:04.725904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b11e-4058-4fcf-b981-9bce20842ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:04.726180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b11e-4058-4fcf-b981-9bce20842ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:04.726832 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5b11e-4058-4fcf-b981-9bce20842ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:04.728837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5b11e-4058-4fcf-b981-9bce20842ca4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:04.764897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 898/1805] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:04 2022] POST /identity/v3/projects => generated 401 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:04.765038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bc57a-7215-4a2e-adc7-2a5f6ebe4843 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:04.775294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bc57a-7215-4a2e-adc7-2a5f6ebe4843 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:04.845921 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251f569-163d-420f-849b-3f21c1fa6996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:04.846579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251f569-163d-420f-849b-3f21c1fa6996 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:04.846856 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251f569-163d-420f-849b-3f21c1fa6996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:04.847115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251f569-163d-420f-849b-3f21c1fa6996 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:04.847809 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251f569-163d-420f-849b-3f21c1fa6996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:04.849796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251f569-163d-420f-849b-3f21c1fa6996 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:04.876093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 908/1806] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:04 2022] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:04.880789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b11e-4058-4fcf-b981-9bce20842ca4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:04.894205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b11e-4058-4fcf-b981-9bce20842ca4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:04.899455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225df2f9-6f0d-41b5-a9fd-d38d34406a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:04.900083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225df2f9-6f0d-41b5-a9fd-d38d34406a7c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:04.900361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225df2f9-6f0d-41b5-a9fd-d38d34406a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:04.900651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225df2f9-6f0d-41b5-a9fd-d38d34406a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:04.901337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225df2f9-6f0d-41b5-a9fd-d38d34406a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:04.903028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225df2f9-6f0d-41b5-a9fd-d38d34406a7c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:04.916482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 899/1807] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:04.917850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251f569-163d-420f-849b-3f21c1fa6996 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:04.928793 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251f569-163d-420f-849b-3f21c1fa6996 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:04.934260 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e2325-84cf-4bae-9692-6402ea5eb649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:04.934906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e2325-84cf-4bae-9692-6402ea5eb649 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:04.935180 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e2325-84cf-4bae-9692-6402ea5eb649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:04.935487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e2325-84cf-4bae-9692-6402ea5eb649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:04.936193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e2325-84cf-4bae-9692-6402ea5eb649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:04.937896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e2325-84cf-4bae-9692-6402ea5eb649 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:04.950248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 909/1808] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:04.954531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225df2f9-6f0d-41b5-a9fd-d38d34406a7c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:04.965367 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225df2f9-6f0d-41b5-a9fd-d38d34406a7c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:04.972062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae5ace-00b2-4c05-885d-5453cdcde537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:04.972782 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae5ace-00b2-4c05-885d-5453cdcde537 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:04.973068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae5ace-00b2-4c05-885d-5453cdcde537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:04.973370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae5ace-00b2-4c05-885d-5453cdcde537 admin admin] PATH_INFO: `/v3/projects/4672f782ac38449ca0ec882eabf38371/users/bae958c3828b4e988e3da44226712edc/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:04.989891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae5ace-00b2-4c05-885d-5453cdcde537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4672f782ac38449ca0ec882eabf38371, user_id=bae958c3828b4e988e3da44226712edc, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:04.992735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae5ace-00b2-4c05-885d-5453cdcde537 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:05.007747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 900/1809] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:04 2022] PUT /identity/v3/projects/4672f782ac38449ca0ec882eabf38371/users/bae958c3828b4e988e3da44226712edc/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:05.019430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e36cb-886a-4075-8b33-621e9c18b50b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:05.019658 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e36cb-886a-4075-8b33-621e9c18b50b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:05.019934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e36cb-886a-4075-8b33-621e9c18b50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:05.048049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-182e36cb-886a-4075-8b33-621e9c18b50b None None] MFA Rules not processed for user `bae958c3828b4e988e3da44226712edc`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:05.049368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-182e36cb-886a-4075-8b33-621e9c18b50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:05.080639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:05.114738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 910/1810] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:05 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:05.119362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae5ace-00b2-4c05-885d-5453cdcde537 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:05.186926 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae5ace-00b2-4c05-885d-5453cdcde537 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:05.192482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51058b-ff73-4a80-b4ef-2c69cd1b4f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:05.193125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51058b-ff73-4a80-b4ef-2c69cd1b4f42 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:05.193408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51058b-ff73-4a80-b4ef-2c69cd1b4f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:05.193678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51058b-ff73-4a80-b4ef-2c69cd1b4f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:05.194325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51058b-ff73-4a80-b4ef-2c69cd1b4f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:05.196531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51058b-ff73-4a80-b4ef-2c69cd1b4f42 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:05.229514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 901/1811] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:05 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:05.230633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e36cb-886a-4075-8b33-621e9c18b50b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:05.241994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e36cb-886a-4075-8b33-621e9c18b50b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:05.299957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6015-e452-487e-89fa-ccd0f0021703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:05.300573 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6015-e452-487e-89fa-ccd0f0021703 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:05.300998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6015-e452-487e-89fa-ccd0f0021703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:05.301276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6015-e452-487e-89fa-ccd0f0021703 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:05.301910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab6015-e452-487e-89fa-ccd0f0021703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:05.303841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab6015-e452-487e-89fa-ccd0f0021703 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:05.326427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 911/1812] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:05 2022] POST /identity/v3/users => generated 307 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:05.330543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51058b-ff73-4a80-b4ef-2c69cd1b4f42 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:05.337298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:05.341211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51058b-ff73-4a80-b4ef-2c69cd1b4f42 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:05.347264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44cbcd-ed96-45fe-be3a-be89821ff3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:05.347861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44cbcd-ed96-45fe-be3a-be89821ff3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:05.348193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44cbcd-ed96-45fe-be3a-be89821ff3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:05.348465 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44cbcd-ed96-45fe-be3a-be89821ff3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:05.349157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44cbcd-ed96-45fe-be3a-be89821ff3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:05.350841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44cbcd-ed96-45fe-be3a-be89821ff3a4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:05.361893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 902/1813] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:05.366099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6015-e452-487e-89fa-ccd0f0021703 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:05.376953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6015-e452-487e-89fa-ccd0f0021703 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:05.382519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd9b65-0713-4832-9006-9e2a7862ff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:05.383163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd9b65-0713-4832-9006-9e2a7862ff82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:05.383440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd9b65-0713-4832-9006-9e2a7862ff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:05.383710 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd9b65-0713-4832-9006-9e2a7862ff82 admin admin] PATH_INFO: `/v3/projects/64aaad76757b42959ecc62625683366b/users/414142576c2e42588e2175e7453076f8/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:05.400211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd9b65-0713-4832-9006-9e2a7862ff82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64aaad76757b42959ecc62625683366b, user_id=414142576c2e42588e2175e7453076f8, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:05.403037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd9b65-0713-4832-9006-9e2a7862ff82 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:05.417573 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 912/1814] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:05 2022] PUT /identity/v3/projects/64aaad76757b42959ecc62625683366b/users/414142576c2e42588e2175e7453076f8/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:05.421370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44cbcd-ed96-45fe-be3a-be89821ff3a4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:05.431256 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44cbcd-ed96-45fe-be3a-be89821ff3a4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:05.491641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e5d45-0c75-4911-9472-c92f80b4781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:05.492266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e5d45-0c75-4911-9472-c92f80b4781a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:05.492576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e5d45-0c75-4911-9472-c92f80b4781a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:05.493286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e5d45-0c75-4911-9472-c92f80b4781a admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:05.493980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e5d45-0c75-4911-9472-c92f80b4781a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:05.495579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e5d45-0c75-4911-9472-c92f80b4781a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:05.509643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 903/1815] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:05.513967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd9b65-0713-4832-9006-9e2a7862ff82 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:05.525677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd9b65-0713-4832-9006-9e2a7862ff82 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:05.530574 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fb017-db12-45e3-908d-c8f1e0522111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:05.531185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fb017-db12-45e3-908d-c8f1e0522111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:05.531468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fb017-db12-45e3-908d-c8f1e0522111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:05.531744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fb017-db12-45e3-908d-c8f1e0522111 admin admin] PATH_INFO: `/v3/projects/64aaad76757b42959ecc62625683366b/users/414142576c2e42588e2175e7453076f8/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:05.533752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fb017-db12-45e3-908d-c8f1e0522111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64aaad76757b42959ecc62625683366b, user_id=414142576c2e42588e2175e7453076f8, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:05.536521 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fb017-db12-45e3-908d-c8f1e0522111 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:05.547536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 913/1816] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:05 2022] PUT /identity/v3/projects/64aaad76757b42959ecc62625683366b/users/414142576c2e42588e2175e7453076f8/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:05.557614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10079201-7bb6-45a5-8317-1cf295cce047 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:05.557962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10079201-7bb6-45a5-8317-1cf295cce047 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:05.558239 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10079201-7bb6-45a5-8317-1cf295cce047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:05.587144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-10079201-7bb6-45a5-8317-1cf295cce047 None None] MFA Rules not processed for user `414142576c2e42588e2175e7453076f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:05.588414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-10079201-7bb6-45a5-8317-1cf295cce047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:05.658763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 904/1817] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:05 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:05.671838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fb017-db12-45e3-908d-c8f1e0522111 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:05.673848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e01fb017-db12-45e3-908d-c8f1e0522111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:05.731221 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fb017-db12-45e3-908d-c8f1e0522111 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:05.735361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca869a-c795-4344-9490-2b52ccfa5b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:05.735965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca869a-c795-4344-9490-2b52ccfa5b28 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:05.736246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca869a-c795-4344-9490-2b52ccfa5b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:05.736520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca869a-c795-4344-9490-2b52ccfa5b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:05.746175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca869a-c795-4344-9490-2b52ccfa5b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:05.747634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca869a-c795-4344-9490-2b52ccfa5b28 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:05.757413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 914/1818] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:05 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:05.841690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10079201-7bb6-45a5-8317-1cf295cce047 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:05.852302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10079201-7bb6-45a5-8317-1cf295cce047 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:05.856752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb5c48-e370-4751-b6e8-7632fe3bed27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:05.857377 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5c48-e370-4751-b6e8-7632fe3bed27 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:05.857657 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5c48-e370-4751-b6e8-7632fe3bed27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:05.857899 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb5c48-e370-4751-b6e8-7632fe3bed27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:05.921170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb5c48-e370-4751-b6e8-7632fe3bed27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:05.922488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb5c48-e370-4751-b6e8-7632fe3bed27 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:05.932201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 905/1819] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:05 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:10.087265 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca869a-c795-4344-9490-2b52ccfa5b28 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:10.089954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-94ca869a-c795-4344-9490-2b52ccfa5b28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:10.138737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:10.212616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca869a-c795-4344-9490-2b52ccfa5b28 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:10.220089 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb5c48-e370-4751-b6e8-7632fe3bed27 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:10.222419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0dbb5c48-e370-4751-b6e8-7632fe3bed27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:10.223561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c97abe-dc34-40e1-9aed-05dcaf1389ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:10.224288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c97abe-dc34-40e1-9aed-05dcaf1389ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:10.224804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c97abe-dc34-40e1-9aed-05dcaf1389ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:10.225953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c97abe-dc34-40e1-9aed-05dcaf1389ef admin admin] PATH_INFO: `/v3/users/2db6c12c54a24dc6b67077de31a9e110` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:10.227234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c97abe-dc34-40e1-9aed-05dcaf1389ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db6c12c54a24dc6b67077de31a9e110)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:10.229299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c97abe-dc34-40e1-9aed-05dcaf1389ef admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:10.252261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb5c48-e370-4751-b6e8-7632fe3bed27 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:10.267575 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a1db3-c4f6-48e1-b4f8-4f4fb7c4891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:10.268277 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a1db3-c4f6-48e1-b4f8-4f4fb7c4891d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:10.268609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a1db3-c4f6-48e1-b4f8-4f4fb7c4891d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:10.269023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a1db3-c4f6-48e1-b4f8-4f4fb7c4891d admin admin] PATH_INFO: `/v3/users/e9bd6d42b8fc45e5b57e861c90abab83` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:10.271970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a1db3-c4f6-48e1-b4f8-4f4fb7c4891d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9bd6d42b8fc45e5b57e861c90abab83)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:10.278389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a1db3-c4f6-48e1-b4f8-4f4fb7c4891d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:10.294171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:10.305998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d8c97abe-dc34-40e1-9aed-05dcaf1389ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db6c12c54a24dc6b67077de31a9e110'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:10.307778 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d8c97abe-dc34-40e1-9aed-05dcaf1389ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db6c12c54a24dc6b67077de31a9e110'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:10.321528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d8c97abe-dc34-40e1-9aed-05dcaf1389ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db6c12c54a24dc6b67077de31a9e110'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:10.334584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d8c97abe-dc34-40e1-9aed-05dcaf1389ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db6c12c54a24dc6b67077de31a9e110'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:10.342232 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d8c97abe-dc34-40e1-9aed-05dcaf1389ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db6c12c54a24dc6b67077de31a9e110'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:10.413136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 915/1820] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:10 2022] DELETE /identity/v3/users/2db6c12c54a24dc6b67077de31a9e110 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:10.416576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0d0a1db3-c4f6-48e1-b4f8-4f4fb7c4891d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9bd6d42b8fc45e5b57e861c90abab83'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:10.418721 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30384e0d-a795-4109-a6bd-c5e86e9d2b27 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:10.419638 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30384e0d-a795-4109-a6bd-c5e86e9d2b27 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:10.420944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30384e0d-a795-4109-a6bd-c5e86e9d2b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:10.449596 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0d0a1db3-c4f6-48e1-b4f8-4f4fb7c4891d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9bd6d42b8fc45e5b57e861c90abab83'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:10.452162 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0d0a1db3-c4f6-48e1-b4f8-4f4fb7c4891d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9bd6d42b8fc45e5b57e861c90abab83'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:10.467416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0d0a1db3-c4f6-48e1-b4f8-4f4fb7c4891d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9bd6d42b8fc45e5b57e861c90abab83'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:10.469932 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-30384e0d-a795-4109-a6bd-c5e86e9d2b27 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:10.472499 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-30384e0d-a795-4109-a6bd-c5e86e9d2b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:10.490628 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0d0a1db3-c4f6-48e1-b4f8-4f4fb7c4891d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9bd6d42b8fc45e5b57e861c90abab83'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:10.503560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 906/1821] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:10 2022] DELETE /identity/v3/users/e9bd6d42b8fc45e5b57e861c90abab83 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:10.509044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64447a8-6714-49e9-8ac1-5ffcd57a854b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:10.509706 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64447a8-6714-49e9-8ac1-5ffcd57a854b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:10.510725 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64447a8-6714-49e9-8ac1-5ffcd57a854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:10.536991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d64447a8-6714-49e9-8ac1-5ffcd57a854b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:10.538323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d64447a8-6714-49e9-8ac1-5ffcd57a854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:10.633526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 916/1822] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:10.656692 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30384e0d-a795-4109-a6bd-c5e86e9d2b27 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:10.658216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-30384e0d-a795-4109-a6bd-c5e86e9d2b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:10.676307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 907/1823] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:10.714399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64447a8-6714-49e9-8ac1-5ffcd57a854b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:10.715827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d64447a8-6714-49e9-8ac1-5ffcd57a854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:10.729692 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:10.738511 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30384e0d-a795-4109-a6bd-c5e86e9d2b27 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:10.806585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64447a8-6714-49e9-8ac1-5ffcd57a854b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:10.811503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95417ab0-eddf-4b11-bde9-aedcd06216e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:10.812288 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95417ab0-eddf-4b11-bde9-aedcd06216e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:10.812488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95417ab0-eddf-4b11-bde9-aedcd06216e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:10.812970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95417ab0-eddf-4b11-bde9-aedcd06216e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:10.830187 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95417ab0-eddf-4b11-bde9-aedcd06216e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:10.831873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95417ab0-eddf-4b11-bde9-aedcd06216e8 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:10.847016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 908/1824] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:10.868247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba26e11-2ba3-4e46-9ddf-5403ef49e1d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:10.868624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba26e11-2ba3-4e46-9ddf-5403ef49e1d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:10.869056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba26e11-2ba3-4e46-9ddf-5403ef49e1d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:10.870522 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba26e11-2ba3-4e46-9ddf-5403ef49e1d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:10.884562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba26e11-2ba3-4e46-9ddf-5403ef49e1d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:10.886951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba26e11-2ba3-4e46-9ddf-5403ef49e1d9 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:10.903075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 917/1825] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:11.692891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95417ab0-eddf-4b11-bde9-aedcd06216e8 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:11.695634 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-95417ab0-eddf-4b11-bde9-aedcd06216e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:11.719374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95417ab0-eddf-4b11-bde9-aedcd06216e8 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:11.737470 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:11.738147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:11.738432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:11.738710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] PATH_INFO: `/v3/projects/49d3ede1c95e4574929b8e90232b61d0` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:11.741741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d3ede1c95e4574929b8e90232b61d0)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:11.745323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:11.804557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:11.877915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d3ede1c95e4574929b8e90232b61d0', 'request_id': 'req-17b84167-21d4-4332-8239-f03cbc9198b8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:11.892641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d3ede1c95e4574929b8e90232b61d0', 'request_id': 'req-17b84167-21d4-4332-8239-f03cbc9198b8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:11.902135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d3ede1c95e4574929b8e90232b61d0', 'request_id': 'req-17b84167-21d4-4332-8239-f03cbc9198b8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:11.917495 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] The token cache is being invalidate because project 49d3ede1c95e4574929b8e90232b61d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:11.918077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:11.918871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:11.923581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 909/1826] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:11 2022] DELETE /identity/v3/projects/49d3ede1c95e4574929b8e90232b61d0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:11.924735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba26e11-2ba3-4e46-9ddf-5403ef49e1d9 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:11.947604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba26e11-2ba3-4e46-9ddf-5403ef49e1d9 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:12.105001 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:12.105907 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:12.106258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:12.106599 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] PATH_INFO: `/v3/users/67283fbc13ea4ba983e37ecd35bba346` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:12.107870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] RBAC: Authorizing `identity:delete_user(user_id=67283fbc13ea4ba983e37ecd35bba346)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:12.110024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:12.216236 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67283fbc13ea4ba983e37ecd35bba346'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.217098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67283fbc13ea4ba983e37ecd35bba346'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.234738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67283fbc13ea4ba983e37ecd35bba346'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.255635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67283fbc13ea4ba983e37ecd35bba346'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.256972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67283fbc13ea4ba983e37ecd35bba346'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.291219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 918/1827] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:11 2022] DELETE /identity/v3/users/67283fbc13ea4ba983e37ecd35bba346 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:12.622930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:12.624902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:12.642270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b84167-21d4-4332-8239-f03cbc9198b8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:12.684688 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:12.686863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:12.714444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1edf5a-634d-4f02-b380-ef1427b190b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:12.715850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1edf5a-634d-4f02-b380-ef1427b190b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:12.716140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1edf5a-634d-4f02-b380-ef1427b190b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:12.716416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1edf5a-634d-4f02-b380-ef1427b190b7 admin admin] PATH_INFO: `/v3/users/bae958c3828b4e988e3da44226712edc` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:12.717658 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1edf5a-634d-4f02-b380-ef1427b190b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bae958c3828b4e988e3da44226712edc)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:12.719608 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1edf5a-634d-4f02-b380-ef1427b190b7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:12.725096 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:12.776923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2c1edf5a-634d-4f02-b380-ef1427b190b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bae958c3828b4e988e3da44226712edc'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.792133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2c1edf5a-634d-4f02-b380-ef1427b190b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bae958c3828b4e988e3da44226712edc'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.793841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2c1edf5a-634d-4f02-b380-ef1427b190b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bae958c3828b4e988e3da44226712edc'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.800915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12ecf9-7f84-44ba-bcdd-bce017ff637f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:12.802951 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2c1edf5a-634d-4f02-b380-ef1427b190b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bae958c3828b4e988e3da44226712edc'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.813096 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:12.814387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2c1edf5a-634d-4f02-b380-ef1427b190b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bae958c3828b4e988e3da44226712edc'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.814563 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:12.815313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:12.816862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] PATH_INFO: `/v3/projects/868d04972ae14f6f982e772543317718` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:12.820407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868d04972ae14f6f982e772543317718)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:12.827015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:12.828116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 910/1828] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:12 2022] DELETE /identity/v3/users/bae958c3828b4e988e3da44226712edc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:12.829800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73838e-42da-4491-a027-3bf2656bc690 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:12.830285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73838e-42da-4491-a027-3bf2656bc690 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:12.830714 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73838e-42da-4491-a027-3bf2656bc690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:12.857646 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1a73838e-42da-4491-a027-3bf2656bc690 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:12.860123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1a73838e-42da-4491-a027-3bf2656bc690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:12.898293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:12.930183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868d04972ae14f6f982e772543317718', 'request_id': 'req-84736bbf-98e7-4bd0-b851-c674dd3c47d2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.939711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868d04972ae14f6f982e772543317718', 'request_id': 'req-84736bbf-98e7-4bd0-b851-c674dd3c47d2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.946314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868d04972ae14f6f982e772543317718', 'request_id': 'req-84736bbf-98e7-4bd0-b851-c674dd3c47d2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.966878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] The token cache is being invalidate because project 868d04972ae14f6f982e772543317718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:12.967251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.977676 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:12.982639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 919/1829] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:12 2022] DELETE /identity/v3/projects/868d04972ae14f6f982e772543317718 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:12.991453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:12.993067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 911/1830] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:12.993772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:13.011822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73838e-42da-4491-a027-3bf2656bc690 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:13.014542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1a73838e-42da-4491-a027-3bf2656bc690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:13.091380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84736bbf-98e7-4bd0-b851-c674dd3c47d2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:13.097465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdf76a-f96e-400b-a9b7-a229ad42ae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:13.098502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdf76a-f96e-400b-a9b7-a229ad42ae6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:13.099078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdf76a-f96e-400b-a9b7-a229ad42ae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:13.100741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73838e-42da-4491-a027-3bf2656bc690 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:13.100987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdf76a-f96e-400b-a9b7-a229ad42ae6e admin admin] PATH_INFO: `/v3/users/15aaa21ff5c9489cab7074a2d7d92c28` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:13.102823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdf76a-f96e-400b-a9b7-a229ad42ae6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=15aaa21ff5c9489cab7074a2d7d92c28)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:13.104873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdf76a-f96e-400b-a9b7-a229ad42ae6e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:13.174040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae678ad-e889-417c-8aee-5b3c1a12e0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:13.174677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae678ad-e889-417c-8aee-5b3c1a12e0ea service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:13.174958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae678ad-e889-417c-8aee-5b3c1a12e0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:13.175230 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae678ad-e889-417c-8aee-5b3c1a12e0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:13.178748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1ae678ad-e889-417c-8aee-5b3c1a12e0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:13.188595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b5fdf76a-f96e-400b-a9b7-a229ad42ae6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15aaa21ff5c9489cab7074a2d7d92c28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:13.189347 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b5fdf76a-f96e-400b-a9b7-a229ad42ae6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15aaa21ff5c9489cab7074a2d7d92c28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:13.198964 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b5fdf76a-f96e-400b-a9b7-a229ad42ae6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15aaa21ff5c9489cab7074a2d7d92c28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:13.201597 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:13.202902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae678ad-e889-417c-8aee-5b3c1a12e0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:13.204877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae678ad-e889-417c-8aee-5b3c1a12e0ea service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:13.208817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b5fdf76a-f96e-400b-a9b7-a229ad42ae6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15aaa21ff5c9489cab7074a2d7d92c28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:13.210147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b5fdf76a-f96e-400b-a9b7-a229ad42ae6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15aaa21ff5c9489cab7074a2d7d92c28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:13.224399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 912/1831] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:13.231015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 920/1832] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:12 2022] DELETE /identity/v3/users/15aaa21ff5c9489cab7074a2d7d92c28 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:13.955560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae678ad-e889-417c-8aee-5b3c1a12e0ea service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:13.958333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1ae678ad-e889-417c-8aee-5b3c1a12e0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:13.999564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae678ad-e889-417c-8aee-5b3c1a12e0ea service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:14.104374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43650ace-a9e5-4b47-ab92-6a9c512570b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:14.105667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43650ace-a9e5-4b47-ab92-6a9c512570b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:14.105942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43650ace-a9e5-4b47-ab92-6a9c512570b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:14.106289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43650ace-a9e5-4b47-ab92-6a9c512570b4 admin admin] PATH_INFO: `/v3/projects/5d999cbd937b48ce926709a4e53c442e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:14.108017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43650ace-a9e5-4b47-ab92-6a9c512570b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d999cbd937b48ce926709a4e53c442e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:14.111230 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43650ace-a9e5-4b47-ab92-6a9c512570b4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:14.163617 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:14.182549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-43650ace-a9e5-4b47-ab92-6a9c512570b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d999cbd937b48ce926709a4e53c442e', 'request_id': 'req-43650ace-a9e5-4b47-ab92-6a9c512570b4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.192841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-43650ace-a9e5-4b47-ab92-6a9c512570b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d999cbd937b48ce926709a4e53c442e', 'request_id': 'req-43650ace-a9e5-4b47-ab92-6a9c512570b4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.201848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-43650ace-a9e5-4b47-ab92-6a9c512570b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d999cbd937b48ce926709a4e53c442e', 'request_id': 'req-43650ace-a9e5-4b47-ab92-6a9c512570b4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.213586 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de054f6d-ced1-4f69-af5c-312627647226 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:14.214651 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de054f6d-ced1-4f69-af5c-312627647226 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:14.215295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de054f6d-ced1-4f69-af5c-312627647226 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:14.218008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 921/1833] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:24:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:24:14.222522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-43650ace-a9e5-4b47-ab92-6a9c512570b4 admin admin] The token cache is being invalidate because project 5d999cbd937b48ce926709a4e53c442e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:14.222910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-43650ace-a9e5-4b47-ab92-6a9c512570b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.224069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-43650ace-a9e5-4b47-ab92-6a9c512570b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.231592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15628f6f-4d4a-419c-89cf-498cc2cbe264 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:14.232270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15628f6f-4d4a-419c-89cf-498cc2cbe264 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:14.232744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15628f6f-4d4a-419c-89cf-498cc2cbe264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:14.236779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 913/1834] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:13 2022] DELETE /identity/v3/projects/5d999cbd937b48ce926709a4e53c442e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:14.246800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b43d92-9394-45b9-a70a-95ef9e41e524 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:14.247730 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b43d92-9394-45b9-a70a-95ef9e41e524 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:14.249248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b43d92-9394-45b9-a70a-95ef9e41e524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:14.277863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-15628f6f-4d4a-419c-89cf-498cc2cbe264 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:14.282217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-15628f6f-4d4a-419c-89cf-498cc2cbe264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:14.291386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-52b43d92-9394-45b9-a70a-95ef9e41e524 None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:14.293060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-52b43d92-9394-45b9-a70a-95ef9e41e524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:14.400448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 914/1835] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:24:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:14.421675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b43d92-9394-45b9-a70a-95ef9e41e524 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:14.423906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-52b43d92-9394-45b9-a70a-95ef9e41e524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:14.443833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b43d92-9394-45b9-a70a-95ef9e41e524 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:14.451287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 922/1836] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:14.461325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f46ef-4eac-4270-9203-76ebd4785cd9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:14.463367 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f46ef-4eac-4270-9203-76ebd4785cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:14.464925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f46ef-4eac-4270-9203-76ebd4785cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:14.473166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e5001-1f23-4af0-b7d4-44c9c02715a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:14.473914 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e5001-1f23-4af0-b7d4-44c9c02715a7 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:14.474546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e5001-1f23-4af0-b7d4-44c9c02715a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:14.475043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e5001-1f23-4af0-b7d4-44c9c02715a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:14.505275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e5001-1f23-4af0-b7d4-44c9c02715a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:14.506712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e5001-1f23-4af0-b7d4-44c9c02715a7 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:14.520742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0b2f46ef-4eac-4270-9203-76ebd4785cd9 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:14.521918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0b2f46ef-4eac-4270-9203-76ebd4785cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:14.537120 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 915/1837] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:24:14.542959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 923/1838] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:14.548065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e5001-1f23-4af0-b7d4-44c9c02715a7 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:14.564275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e5001-1f23-4af0-b7d4-44c9c02715a7 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:14.570928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c20a1-6cd5-4583-8fa9-acf97881e360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:14.572246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c20a1-6cd5-4583-8fa9-acf97881e360 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:14.572581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c20a1-6cd5-4583-8fa9-acf97881e360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:14.572937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c20a1-6cd5-4583-8fa9-acf97881e360 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:14.574547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c20a1-6cd5-4583-8fa9-acf97881e360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:14.574867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c20a1-6cd5-4583-8fa9-acf97881e360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:14.578311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c20a1-6cd5-4583-8fa9-acf97881e360 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:14.607896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f46ef-4eac-4270-9203-76ebd4785cd9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:14.610399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0b2f46ef-4eac-4270-9203-76ebd4785cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:14.619417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 916/1839] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:24:14.619417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c20a1-6cd5-4583-8fa9-acf97881e360 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:14.621003 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-de1c20a1-6cd5-4583-8fa9-acf97881e360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:14.636837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c20a1-6cd5-4583-8fa9-acf97881e360 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:14.643465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f46ef-4eac-4270-9203-76ebd4785cd9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:14.650307 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:14.651163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:14.651784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:14.652208 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] PATH_INFO: `/v3/projects/23ef5ca997d0437a8a9f13829479aad7` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:14.654126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:14.654283 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ef5ca997d0437a8a9f13829479aad7)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:14.656925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:14.657191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:14.657643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:14.659281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] PATH_INFO: `/v3/projects/4672f782ac38449ca0ec882eabf38371` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:14.661472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4672f782ac38449ca0ec882eabf38371)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:14.669988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:14.773216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ef5ca997d0437a8a9f13829479aad7', 'request_id': 'req-4ce2a0ee-e714-47db-b193-185b526512e2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.794024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ef5ca997d0437a8a9f13829479aad7', 'request_id': 'req-4ce2a0ee-e714-47db-b193-185b526512e2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.804327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ef5ca997d0437a8a9f13829479aad7', 'request_id': 'req-4ce2a0ee-e714-47db-b193-185b526512e2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.825579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4672f782ac38449ca0ec882eabf38371', 'request_id': 'req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.830594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] The token cache is being invalidate because project 23ef5ca997d0437a8a9f13829479aad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:14.831052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.832131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.834529 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 924/1840] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:14 2022] DELETE /identity/v3/projects/23ef5ca997d0437a8a9f13829479aad7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:14.837788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:14.837788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:14.842482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4672f782ac38449ca0ec882eabf38371', 'request_id': 'req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.852322 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4672f782ac38449ca0ec882eabf38371', 'request_id': 'req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.866614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] The token cache is being invalidate because project 4672f782ac38449ca0ec882eabf38371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:14.867039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.867901 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:14.872980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 917/1841] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:14 2022] DELETE /identity/v3/projects/4672f782ac38449ca0ec882eabf38371 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:14.874079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:14.876005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:14.889049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:14.943750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:14.982919 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2a0ee-e714-47db-b193-185b526512e2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:15.003297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d404a3-7e1c-4cfe-bd22-e0fa83d00f2b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:15.010880 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:15.011885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:15.012974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:15.013455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] PATH_INFO: `/v3/users/8a4289ebbc3e4a4593832e7ea425e265` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:15.014888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4289ebbc3e4a4593832e7ea425e265)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:15.020262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:15.101306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a27b98-5d51-4d6e-9013-ca4296c29fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:15.102501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a27b98-5d51-4d6e-9013-ca4296c29fda admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:15.103878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a27b98-5d51-4d6e-9013-ca4296c29fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:15.104161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a27b98-5d51-4d6e-9013-ca4296c29fda admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:15.104857 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a27b98-5d51-4d6e-9013-ca4296c29fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:15.108029 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a27b98-5d51-4d6e-9013-ca4296c29fda admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:15.112853 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4289ebbc3e4a4593832e7ea425e265'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.136469 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4289ebbc3e4a4593832e7ea425e265'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.137422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4289ebbc3e4a4593832e7ea425e265'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.153445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 925/1842] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:14 2022] POST /identity/v3/projects => generated 387 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:15.155124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4289ebbc3e4a4593832e7ea425e265'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.157734 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a27b98-5d51-4d6e-9013-ca4296c29fda admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:15.160460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a3a27b98-5d51-4d6e-9013-ca4296c29fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:15.181329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4289ebbc3e4a4593832e7ea425e265'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.188678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 918/1843] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:14 2022] DELETE /identity/v3/users/8a4289ebbc3e4a4593832e7ea425e265 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:15.189648 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:15.191093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:15.267735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a27b98-5d51-4d6e-9013-ca4296c29fda admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:15.299662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117f12e-efd9-4182-8e87-882da3ec0c24 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:15.308218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8cb3d-a391-4fc9-9ba1-d639588bb747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:15.308879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8cb3d-a391-4fc9-9ba1-d639588bb747 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:15.309288 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8cb3d-a391-4fc9-9ba1-d639588bb747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:15.309572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8cb3d-a391-4fc9-9ba1-d639588bb747 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:15.310218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8cb3d-a391-4fc9-9ba1-d639588bb747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:15.312167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8cb3d-a391-4fc9-9ba1-d639588bb747 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:15.347944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 919/1844] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:15 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:15.351722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8cb3d-a391-4fc9-9ba1-d639588bb747 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:15.369773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8cb3d-a391-4fc9-9ba1-d639588bb747 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:15.377384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba6df6-b721-4cfd-8e9d-0423bfe139b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:15.378111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba6df6-b721-4cfd-8e9d-0423bfe139b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:15.378370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba6df6-b721-4cfd-8e9d-0423bfe139b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:15.378656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba6df6-b721-4cfd-8e9d-0423bfe139b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:15.379688 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba6df6-b721-4cfd-8e9d-0423bfe139b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:15.381585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba6df6-b721-4cfd-8e9d-0423bfe139b4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:15.385212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08eb65e-3a71-4fb5-b8ac-1de3affdb7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:15.385885 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eb65e-3a71-4fb5-b8ac-1de3affdb7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:15.386379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eb65e-3a71-4fb5-b8ac-1de3affdb7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:15.386775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eb65e-3a71-4fb5-b8ac-1de3affdb7b5 admin admin] PATH_INFO: `/v3/users/414142576c2e42588e2175e7453076f8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:15.394644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08eb65e-3a71-4fb5-b8ac-1de3affdb7b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=414142576c2e42588e2175e7453076f8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:15.396623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08eb65e-3a71-4fb5-b8ac-1de3affdb7b5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:15.402128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 920/1845] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:15.404366 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba6df6-b721-4cfd-8e9d-0423bfe139b4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:15.419181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba6df6-b721-4cfd-8e9d-0423bfe139b4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:15.426975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d8bd3-e675-4aa7-917a-b1e2fc29ac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:15.428034 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d8bd3-e675-4aa7-917a-b1e2fc29ac17 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:15.428522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d8bd3-e675-4aa7-917a-b1e2fc29ac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:15.429022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d8bd3-e675-4aa7-917a-b1e2fc29ac17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:15.429879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d8bd3-e675-4aa7-917a-b1e2fc29ac17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:15.431735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d8bd3-e675-4aa7-917a-b1e2fc29ac17 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:15.434137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:15.456516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 921/1846] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:15.457718 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d8bd3-e675-4aa7-917a-b1e2fc29ac17 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:15.462782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:15.480230 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d8bd3-e675-4aa7-917a-b1e2fc29ac17 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:15.485031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e08eb65e-3a71-4fb5-b8ac-1de3affdb7b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414142576c2e42588e2175e7453076f8'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.486239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e08eb65e-3a71-4fb5-b8ac-1de3affdb7b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414142576c2e42588e2175e7453076f8'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.493545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fb4c1-ce5f-4cf2-8e2e-0373c726e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:15.494602 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fb4c1-ce5f-4cf2-8e2e-0373c726e1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:15.494985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fb4c1-ce5f-4cf2-8e2e-0373c726e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:15.495382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fb4c1-ce5f-4cf2-8e2e-0373c726e1c4 admin admin] PATH_INFO: `/v3/projects/92c1fc8e7f6743e28769179d4dfb6f85/users/c6bf5f81c2474920a2819fb33aa02b60/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:15.500214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e08eb65e-3a71-4fb5-b8ac-1de3affdb7b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414142576c2e42588e2175e7453076f8'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.509717 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e08eb65e-3a71-4fb5-b8ac-1de3affdb7b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414142576c2e42588e2175e7453076f8'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.510950 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e08eb65e-3a71-4fb5-b8ac-1de3affdb7b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414142576c2e42588e2175e7453076f8'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.525243 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fb4c1-ce5f-4cf2-8e2e-0373c726e1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c1fc8e7f6743e28769179d4dfb6f85, user_id=c6bf5f81c2474920a2819fb33aa02b60, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:15.530864 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fb4c1-ce5f-4cf2-8e2e-0373c726e1c4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:15.534709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 926/1847] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:15 2022] DELETE /identity/v3/users/414142576c2e42588e2175e7453076f8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:15.552253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 922/1848] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:15 2022] PUT /identity/v3/projects/92c1fc8e7f6743e28769179d4dfb6f85/users/c6bf5f81c2474920a2819fb33aa02b60/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:15.564699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32c930-e927-4100-a385-b33a752c0084 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:15.565013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32c930-e927-4100-a385-b33a752c0084 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:15.565335 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32c930-e927-4100-a385-b33a752c0084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:15.606775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7a32c930-e927-4100-a385-b33a752c0084 None None] MFA Rules not processed for user `c6bf5f81c2474920a2819fb33aa02b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:15.608443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7a32c930-e927-4100-a385-b33a752c0084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:15.693044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fb4c1-ce5f-4cf2-8e2e-0373c726e1c4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:15.696700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cc9fb4c1-ce5f-4cf2-8e2e-0373c726e1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:15.767699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 927/1849] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:15.771865 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32c930-e927-4100-a385-b33a752c0084 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:15.773633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7a32c930-e927-4100-a385-b33a752c0084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:15.798604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fb4c1-ce5f-4cf2-8e2e-0373c726e1c4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:15.818774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:15.820275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:15.821113 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:15.821386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6 admin admin] PATH_INFO: `/v3/projects/7ad9d515893b4115acb47fb0a34da373` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:15.823267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad9d515893b4115acb47fb0a34da373)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:15.825438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:15.881862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32c930-e927-4100-a385-b33a752c0084 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:15.902089 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad9d515893b4115acb47fb0a34da373', 'request_id': 'req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.916157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad9d515893b4115acb47fb0a34da373', 'request_id': 'req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.926620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad9d515893b4115acb47fb0a34da373', 'request_id': 'req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.947179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6 admin admin] The token cache is being invalidate because project 7ad9d515893b4115acb47fb0a34da373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:15.947476 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.948190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-318b4cca-b7c9-4edb-953e-6b6fad1a15a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:15.955267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 923/1850] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:15 2022] DELETE /identity/v3/projects/7ad9d515893b4115acb47fb0a34da373 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:15.960840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e897f3a-edea-4117-9541-738230091f40 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:15.961137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e897f3a-edea-4117-9541-738230091f40 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:15.961418 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e897f3a-edea-4117-9541-738230091f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:15.962864 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:15.984361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3d997-05b1-4583-8065-f3780dd639d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:15.985460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3d997-05b1-4583-8065-f3780dd639d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:15.985911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3d997-05b1-4583-8065-f3780dd639d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:15.986407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3d997-05b1-4583-8065-f3780dd639d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:15.987533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3d997-05b1-4583-8065-f3780dd639d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:15.989758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3d997-05b1-4583-8065-f3780dd639d9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:15.994076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2e897f3a-edea-4117-9541-738230091f40 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:15.995785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2e897f3a-edea-4117-9541-738230091f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:16.027158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 924/1851] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:16.035790 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2c590-c96c-4e43-b706-6d57c54292d7 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.036519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2c590-c96c-4e43-b706-6d57c54292d7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.037005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2c590-c96c-4e43-b706-6d57c54292d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.042426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 928/1852] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:15 2022] POST /identity/v3/projects => generated 387 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:16.043534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3d997-05b1-4583-8065-f3780dd639d9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.045420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-08c3d997-05b1-4583-8065-f3780dd639d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:16.076503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a8c2c590-c96c-4e43-b706-6d57c54292d7 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:16.078810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a8c2c590-c96c-4e43-b706-6d57c54292d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:16.142992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:16.161786 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 925/1853] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:16.167716 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2c590-c96c-4e43-b706-6d57c54292d7 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.174151 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3d997-05b1-4583-8065-f3780dd639d9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:16.179053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8626d8-7db3-476a-8ec0-73f668c9e57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:16.179615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8626d8-7db3-476a-8ec0-73f668c9e57f admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.179902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8626d8-7db3-476a-8ec0-73f668c9e57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.180586 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8626d8-7db3-476a-8ec0-73f668c9e57f admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.181453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8626d8-7db3-476a-8ec0-73f668c9e57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:16.184029 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8626d8-7db3-476a-8ec0-73f668c9e57f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:16.192467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2c590-c96c-4e43-b706-6d57c54292d7 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:16.207822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2ccb4-daea-436b-b012-a68374ff96f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:16.208562 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2ccb4-daea-436b-b012-a68374ff96f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.209045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2ccb4-daea-436b-b012-a68374ff96f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.209345 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2ccb4-daea-436b-b012-a68374ff96f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.210470 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2ccb4-daea-436b-b012-a68374ff96f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:16.212028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2ccb4-daea-436b-b012-a68374ff96f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:16.216693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2ccb4-daea-436b-b012-a68374ff96f3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:16.234420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 929/1854] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:16 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:16.238527 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8626d8-7db3-476a-8ec0-73f668c9e57f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.249238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 926/1855] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:24:16.256215 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2ccb4-daea-436b-b012-a68374ff96f3 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.256481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8626d8-7db3-476a-8ec0-73f668c9e57f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:16.265991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2b42c-90e4-4bee-9d85-e94957c83b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:16.267133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2b42c-90e4-4bee-9d85-e94957c83b93 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.267473 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2b42c-90e4-4bee-9d85-e94957c83b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.267752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2b42c-90e4-4bee-9d85-e94957c83b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.268562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2b42c-90e4-4bee-9d85-e94957c83b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:16.270959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2b42c-90e4-4bee-9d85-e94957c83b93 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:16.275194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2ccb4-daea-436b-b012-a68374ff96f3 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:16.286948 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 930/1856] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:16.292430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2b42c-90e4-4bee-9d85-e94957c83b93 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.292704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bae16-974f-4672-aec1-1cbf803dcbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:16.293593 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bae16-974f-4672-aec1-1cbf803dcbcf admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.293963 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bae16-974f-4672-aec1-1cbf803dcbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.294329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bae16-974f-4672-aec1-1cbf803dcbcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.295153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bae16-974f-4672-aec1-1cbf803dcbcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:16.297538 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bae16-974f-4672-aec1-1cbf803dcbcf admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:16.304389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2b42c-90e4-4bee-9d85-e94957c83b93 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:16.309958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24d2cc-78cb-4d16-81a0-60f60a28a5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:16.311069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24d2cc-78cb-4d16-81a0-60f60a28a5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.311501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24d2cc-78cb-4d16-81a0-60f60a28a5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.311925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24d2cc-78cb-4d16-81a0-60f60a28a5c6 admin admin] PATH_INFO: `/v3/projects/122b5c5927814e45b3f327d473a617d5/users/0a1c747b486f45b68d7541ea9476faff/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.352289 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24d2cc-78cb-4d16-81a0-60f60a28a5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=122b5c5927814e45b3f327d473a617d5, user_id=0a1c747b486f45b68d7541ea9476faff, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:16.356116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 927/1857] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:16 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:16.356932 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24d2cc-78cb-4d16-81a0-60f60a28a5c6 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:16.362069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bae16-974f-4672-aec1-1cbf803dcbcf admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.374600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 931/1858] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:16 2022] PUT /identity/v3/projects/122b5c5927814e45b3f327d473a617d5/users/0a1c747b486f45b68d7541ea9476faff/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:16.378588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24d2cc-78cb-4d16-81a0-60f60a28a5c6 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.488593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24d2cc-78cb-4d16-81a0-60f60a28a5c6 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:16.496526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca124c9-c821-45a8-acdf-3030504ea9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:16.497269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca124c9-c821-45a8-acdf-3030504ea9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.497572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca124c9-c821-45a8-acdf-3030504ea9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.497815 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca124c9-c821-45a8-acdf-3030504ea9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.498758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca124c9-c821-45a8-acdf-3030504ea9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:16.504869 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca124c9-c821-45a8-acdf-3030504ea9a9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:16.515009 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 932/1859] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:16.519056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca124c9-c821-45a8-acdf-3030504ea9a9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.548611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca124c9-c821-45a8-acdf-3030504ea9a9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:16.555527 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb25e7-66a6-4226-8b6d-e905e3ae8f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:16.556333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb25e7-66a6-4226-8b6d-e905e3ae8f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.556705 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb25e7-66a6-4226-8b6d-e905e3ae8f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.557387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb25e7-66a6-4226-8b6d-e905e3ae8f0d admin admin] PATH_INFO: `/v3/projects/122b5c5927814e45b3f327d473a617d5/users/0a1c747b486f45b68d7541ea9476faff/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.562416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bae16-974f-4672-aec1-1cbf803dcbcf admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:16.563933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb25e7-66a6-4226-8b6d-e905e3ae8f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=122b5c5927814e45b3f327d473a617d5, user_id=0a1c747b486f45b68d7541ea9476faff, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:16.570336 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb25e7-66a6-4226-8b6d-e905e3ae8f0d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:16.578539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a065f24-2485-4297-8380-5971a8cef859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:16.579889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a065f24-2485-4297-8380-5971a8cef859 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.580672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a065f24-2485-4297-8380-5971a8cef859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.581064 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a065f24-2485-4297-8380-5971a8cef859 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.583797 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a065f24-2485-4297-8380-5971a8cef859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:16.586566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a065f24-2485-4297-8380-5971a8cef859 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:16.592767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 933/1860] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:16 2022] PUT /identity/v3/projects/122b5c5927814e45b3f327d473a617d5/users/0a1c747b486f45b68d7541ea9476faff/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:16.601801 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e7ff5-8af7-421a-a70f-29750025007e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.602924 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e7ff5-8af7-421a-a70f-29750025007e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.605533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e7ff5-8af7-421a-a70f-29750025007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.638226 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 928/1861] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:16 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:16.639164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a065f24-2485-4297-8380-5971a8cef859 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.651437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a065f24-2485-4297-8380-5971a8cef859 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:16.652651 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:16.674575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2a0e7ff5-8af7-421a-a70f-29750025007e None None] MFA Rules not processed for user `0a1c747b486f45b68d7541ea9476faff`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:16.678760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2a0e7ff5-8af7-421a-a70f-29750025007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:16.745834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434f6c2-9b34-499a-9fba-685581ba5f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:16.746475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434f6c2-9b34-499a-9fba-685581ba5f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.746756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434f6c2-9b34-499a-9fba-685581ba5f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.748306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434f6c2-9b34-499a-9fba-685581ba5f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.748998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434f6c2-9b34-499a-9fba-685581ba5f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:16.753574 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434f6c2-9b34-499a-9fba-685581ba5f7c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:16.777527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 929/1862] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:16.778901 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434f6c2-9b34-499a-9fba-685581ba5f7c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.790795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434f6c2-9b34-499a-9fba-685581ba5f7c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:16.799103 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc0ded-9367-4073-b825-3b41d13a6b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:16.799956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc0ded-9367-4073-b825-3b41d13a6b8f admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.800386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc0ded-9367-4073-b825-3b41d13a6b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.800888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc0ded-9367-4073-b825-3b41d13a6b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.801616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc0ded-9367-4073-b825-3b41d13a6b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:16.803823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc0ded-9367-4073-b825-3b41d13a6b8f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:16.820665 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 930/1863] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:16.821925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc0ded-9367-4073-b825-3b41d13a6b8f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.829695 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 934/1864] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:16.849033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc0ded-9367-4073-b825-3b41d13a6b8f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:16.849945 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e7ff5-8af7-421a-a70f-29750025007e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.851407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2a0e7ff5-8af7-421a-a70f-29750025007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:16.862156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03b4f8-6652-4a5b-9974-5128a22ad564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:16.862749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03b4f8-6652-4a5b-9974-5128a22ad564 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:16.863244 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03b4f8-6652-4a5b-9974-5128a22ad564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:16.863424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03b4f8-6652-4a5b-9974-5128a22ad564 admin admin] PATH_INFO: `/v3/projects/6118c6b8c34f46b8bad432d1b517d941/users/8bb1e436a0694784ace52ad4057a0ea5/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:16.910242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03b4f8-6652-4a5b-9974-5128a22ad564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6118c6b8c34f46b8bad432d1b517d941, user_id=8bb1e436a0694784ace52ad4057a0ea5, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:16.917382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03b4f8-6652-4a5b-9974-5128a22ad564 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:16.945610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 931/1865] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:16 2022] PUT /identity/v3/projects/6118c6b8c34f46b8bad432d1b517d941/users/8bb1e436a0694784ace52ad4057a0ea5/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:16.946778 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03b4f8-6652-4a5b-9974-5128a22ad564 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:16.950312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6d03b4f8-6652-4a5b-9974-5128a22ad564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:16.958141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e7ff5-8af7-421a-a70f-29750025007e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:16.970960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:17.015942 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91666a6-447a-4ef0-b1d8-e8f11b786f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:17.016595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91666a6-447a-4ef0-b1d8-e8f11b786f55 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.017040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91666a6-447a-4ef0-b1d8-e8f11b786f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.017313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91666a6-447a-4ef0-b1d8-e8f11b786f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.025694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03b4f8-6652-4a5b-9974-5128a22ad564 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:17.031217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:17.031911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.032194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.032486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f admin admin] PATH_INFO: `/v3/projects/64aaad76757b42959ecc62625683366b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.033731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64aaad76757b42959ecc62625683366b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:17.035702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:17.077434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91666a6-447a-4ef0-b1d8-e8f11b786f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:17.078904 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91666a6-447a-4ef0-b1d8-e8f11b786f55 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:17.082473 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64aaad76757b42959ecc62625683366b', 'request_id': 'req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:17.084516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:17.090529 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 935/1866] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:17.091171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64aaad76757b42959ecc62625683366b', 'request_id': 'req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:17.091922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bda8e-64a7-4320-9e72-f489d219dd12 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.092559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bda8e-64a7-4320-9e72-f489d219dd12 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.092931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bda8e-64a7-4320-9e72-f489d219dd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.098834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64aaad76757b42959ecc62625683366b', 'request_id': 'req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:17.111629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f admin admin] The token cache is being invalidate because project 64aaad76757b42959ecc62625683366b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:17.111921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:17.112699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e162fd7c-ae6e-4cbb-98d8-9599f5a7153f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:17.114344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 932/1867] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:16 2022] DELETE /identity/v3/projects/64aaad76757b42959ecc62625683366b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:17.119434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c3794-00ec-4d54-ab40-10e2b2449c4d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.119785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c3794-00ec-4d54-ab40-10e2b2449c4d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.120129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c3794-00ec-4d54-ab40-10e2b2449c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.126770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ae8bda8e-64a7-4320-9e72-f489d219dd12 None None] MFA Rules not processed for user `8bb1e436a0694784ace52ad4057a0ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:17.128204 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ae8bda8e-64a7-4320-9e72-f489d219dd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:17.140478 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fe8c3794-00ec-4d54-ab40-10e2b2449c4d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:17.142203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fe8c3794-00ec-4d54-ab40-10e2b2449c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:17.195257 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 936/1868] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:17.196153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bda8e-64a7-4320-9e72-f489d219dd12 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:17.197501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ae8bda8e-64a7-4320-9e72-f489d219dd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:17.204800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 933/1869] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:17.212500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c3794-00ec-4d54-ab40-10e2b2449c4d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:17.213327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bda8e-64a7-4320-9e72-f489d219dd12 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:17.213875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fe8c3794-00ec-4d54-ab40-10e2b2449c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:17.218172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22737ac2-a66e-4053-9497-dea16a1ec1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:17.218831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22737ac2-a66e-4053-9497-dea16a1ec1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.219100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22737ac2-a66e-4053-9497-dea16a1ec1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.219389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22737ac2-a66e-4053-9497-dea16a1ec1c7 admin admin] PATH_INFO: `/v3/users/c6bf5f81c2474920a2819fb33aa02b60` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.220591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22737ac2-a66e-4053-9497-dea16a1ec1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bf5f81c2474920a2819fb33aa02b60)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:17.222568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22737ac2-a66e-4053-9497-dea16a1ec1c7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:17.260173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:17.271930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-22737ac2-a66e-4053-9497-dea16a1ec1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bf5f81c2474920a2819fb33aa02b60'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:17.272657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-22737ac2-a66e-4053-9497-dea16a1ec1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bf5f81c2474920a2819fb33aa02b60'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:17.272930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c3794-00ec-4d54-ab40-10e2b2449c4d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:17.277922 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44658786-33b3-46a4-9b5c-45bd30c9ff78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:17.278622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44658786-33b3-46a4-9b5c-45bd30c9ff78 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.278991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44658786-33b3-46a4-9b5c-45bd30c9ff78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.279331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44658786-33b3-46a4-9b5c-45bd30c9ff78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.282316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-22737ac2-a66e-4053-9497-dea16a1ec1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bf5f81c2474920a2819fb33aa02b60'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:17.288216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44658786-33b3-46a4-9b5c-45bd30c9ff78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:17.289589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-22737ac2-a66e-4053-9497-dea16a1ec1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bf5f81c2474920a2819fb33aa02b60'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:17.289841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44658786-33b3-46a4-9b5c-45bd30c9ff78 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:17.290284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-22737ac2-a66e-4053-9497-dea16a1ec1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bf5f81c2474920a2819fb33aa02b60'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:17.298833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 934/1870] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:17.300061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecbbc3-bde1-4252-b41b-71be0ec99a73 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.300293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecbbc3-bde1-4252-b41b-71be0ec99a73 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.300593 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecbbc3-bde1-4252-b41b-71be0ec99a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.308972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 937/1871] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:17 2022] DELETE /identity/v3/users/c6bf5f81c2474920a2819fb33aa02b60 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:17.313710 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8dc1a-9119-49f9-8bfc-3af83ac63842 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.314142 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8dc1a-9119-49f9-8bfc-3af83ac63842 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.314428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8dc1a-9119-49f9-8bfc-3af83ac63842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.319596 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-feecbbc3-bde1-4252-b41b-71be0ec99a73 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:17.320828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-feecbbc3-bde1-4252-b41b-71be0ec99a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:17.333787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-31a8dc1a-9119-49f9-8bfc-3af83ac63842 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:17.335529 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-31a8dc1a-9119-49f9-8bfc-3af83ac63842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:17.389856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 935/1872] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:17.394409 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecbbc3-bde1-4252-b41b-71be0ec99a73 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:17.400164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 938/1873] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:17.403644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecbbc3-bde1-4252-b41b-71be0ec99a73 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:17.408638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958a0da-52ff-4dc6-8e89-e3f951d1829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:17.409374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958a0da-52ff-4dc6-8e89-e3f951d1829e admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.409692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958a0da-52ff-4dc6-8e89-e3f951d1829e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.409981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958a0da-52ff-4dc6-8e89-e3f951d1829e admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.410657 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958a0da-52ff-4dc6-8e89-e3f951d1829e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:17.410987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958a0da-52ff-4dc6-8e89-e3f951d1829e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:17.411080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8dc1a-9119-49f9-8bfc-3af83ac63842 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:17.412589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958a0da-52ff-4dc6-8e89-e3f951d1829e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:17.413621 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-31a8dc1a-9119-49f9-8bfc-3af83ac63842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:17.421240 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:17.425111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 936/1874] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:24:17.429992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958a0da-52ff-4dc6-8e89-e3f951d1829e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:17.443531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958a0da-52ff-4dc6-8e89-e3f951d1829e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:17.449718 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486ae79-1451-4359-8b65-cf9dc00b707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:17.450272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486ae79-1451-4359-8b65-cf9dc00b707f admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.450551 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486ae79-1451-4359-8b65-cf9dc00b707f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.450821 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486ae79-1451-4359-8b65-cf9dc00b707f admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.451924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486ae79-1451-4359-8b65-cf9dc00b707f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:17.454296 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486ae79-1451-4359-8b65-cf9dc00b707f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:17.492362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 937/1875] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:17 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:17.492581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8dc1a-9119-49f9-8bfc-3af83ac63842 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:17.494344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486ae79-1451-4359-8b65-cf9dc00b707f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:17.563799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180183fc-89f3-47be-930c-889ecacc5faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:17.564606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180183fc-89f3-47be-930c-889ecacc5faa service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.564999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180183fc-89f3-47be-930c-889ecacc5faa service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.565396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180183fc-89f3-47be-930c-889ecacc5faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.622542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486ae79-1451-4359-8b65-cf9dc00b707f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:17.637478 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fdd36-a597-4487-8131-944f6f9428e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:17.638581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fdd36-a597-4487-8131-944f6f9428e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.638955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fdd36-a597-4487-8131-944f6f9428e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.639292 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fdd36-a597-4487-8131-944f6f9428e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.641850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fdd36-a597-4487-8131-944f6f9428e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:17.646904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fdd36-a597-4487-8131-944f6f9428e8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:17.685175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180183fc-89f3-47be-930c-889ecacc5faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:17.687298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180183fc-89f3-47be-930c-889ecacc5faa service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:17.693483 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 938/1876] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:17 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:17.697035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fdd36-a597-4487-8131-944f6f9428e8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:17.704701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 939/1877] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:17.714934 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fdd36-a597-4487-8131-944f6f9428e8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:17.730565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4079e3-789f-4d06-a6d3-8590442b69aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:17.731285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4079e3-789f-4d06-a6d3-8590442b69aa admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.741093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4079e3-789f-4d06-a6d3-8590442b69aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.741704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4079e3-789f-4d06-a6d3-8590442b69aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.742618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4079e3-789f-4d06-a6d3-8590442b69aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:17.744901 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4079e3-789f-4d06-a6d3-8590442b69aa admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:17.757760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 939/1878] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:17.762127 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180183fc-89f3-47be-930c-889ecacc5faa service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:17.772971 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180183fc-89f3-47be-930c-889ecacc5faa service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:17.779026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0dafd-4ef7-4b42-9e66-dabf9644d82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:17.779675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0dafd-4ef7-4b42-9e66-dabf9644d82e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.779954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0dafd-4ef7-4b42-9e66-dabf9644d82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.780226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0dafd-4ef7-4b42-9e66-dabf9644d82e admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.780911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0dafd-4ef7-4b42-9e66-dabf9644d82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:17.782577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0dafd-4ef7-4b42-9e66-dabf9644d82e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:17.797244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 940/1879] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:17.798869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4079e3-789f-4d06-a6d3-8590442b69aa admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:17.823456 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4079e3-789f-4d06-a6d3-8590442b69aa admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:17.829921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebf275-d370-4ffa-ac7f-46b69df2249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:17.830869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebf275-d370-4ffa-ac7f-46b69df2249d admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.831213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebf275-d370-4ffa-ac7f-46b69df2249d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.831613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebf275-d370-4ffa-ac7f-46b69df2249d admin admin] PATH_INFO: `/v3/projects/070a4434f35a4712b5a40e6e048f388a/users/27796a2ca3ed412f90434ff3474cda56/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.848522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebf275-d370-4ffa-ac7f-46b69df2249d admin admin] RBAC: Authorizing `identity:create_grant(project_id=070a4434f35a4712b5a40e6e048f388a, user_id=27796a2ca3ed412f90434ff3474cda56, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:17.851178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebf275-d370-4ffa-ac7f-46b69df2249d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:17.879520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 940/1880] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:17 2022] PUT /identity/v3/projects/070a4434f35a4712b5a40e6e048f388a/users/27796a2ca3ed412f90434ff3474cda56/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:17.882397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65746b33-b564-462d-be3d-9165155b88e1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:17.882834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65746b33-b564-462d-be3d-9165155b88e1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:17.883177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65746b33-b564-462d-be3d-9165155b88e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:17.916285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-65746b33-b564-462d-be3d-9165155b88e1 None None] MFA Rules not processed for user `27796a2ca3ed412f90434ff3474cda56`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:17.917741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-65746b33-b564-462d-be3d-9165155b88e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:17.966423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:18.007512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 941/1881] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:18.014481 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebf275-d370-4ffa-ac7f-46b69df2249d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:18.023189 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:18.106969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebf275-d370-4ffa-ac7f-46b69df2249d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:18.111830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327677e3-74dd-4f6a-a6fa-e8c8087a6b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:18.112484 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327677e3-74dd-4f6a-a6fa-e8c8087a6b1c admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:18.112801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327677e3-74dd-4f6a-a6fa-e8c8087a6b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:18.113078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327677e3-74dd-4f6a-a6fa-e8c8087a6b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:18.113720 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327677e3-74dd-4f6a-a6fa-e8c8087a6b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:18.115629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327677e3-74dd-4f6a-a6fa-e8c8087a6b1c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:18.126010 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65746b33-b564-462d-be3d-9165155b88e1 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:18.127577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-65746b33-b564-462d-be3d-9165155b88e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:18.145126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65746b33-b564-462d-be3d-9165155b88e1 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:18.150935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:18.151582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:18.151911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:18.152150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] PATH_INFO: `/v3/projects/92c1fc8e7f6743e28769179d4dfb6f85` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:18.153474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c1fc8e7f6743e28769179d4dfb6f85)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:18.155426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:18.165287 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 941/1882] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:18 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:18.166161 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327677e3-74dd-4f6a-a6fa-e8c8087a6b1c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:18.208597 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c1fc8e7f6743e28769179d4dfb6f85', 'request_id': 'req-3b685755-e406-4e02-b144-fd45e294d37a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.214197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c1fc8e7f6743e28769179d4dfb6f85', 'request_id': 'req-3b685755-e406-4e02-b144-fd45e294d37a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.220437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c1fc8e7f6743e28769179d4dfb6f85', 'request_id': 'req-3b685755-e406-4e02-b144-fd45e294d37a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.230351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327677e3-74dd-4f6a-a6fa-e8c8087a6b1c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:18.233477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] The token cache is being invalidate because project 92c1fc8e7f6743e28769179d4dfb6f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:18.233770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.234458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.236010 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 942/1883] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:18 2022] DELETE /identity/v3/projects/92c1fc8e7f6743e28769179d4dfb6f85 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:18.240031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:18.241378 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:18.291426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33306af5-f21a-4c7b-a912-e9f9e8128628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:18.292052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33306af5-f21a-4c7b-a912-e9f9e8128628 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:18.292355 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33306af5-f21a-4c7b-a912-e9f9e8128628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:18.292739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33306af5-f21a-4c7b-a912-e9f9e8128628 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:18.293418 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33306af5-f21a-4c7b-a912-e9f9e8128628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:18.295382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33306af5-f21a-4c7b-a912-e9f9e8128628 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:18.306249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b685755-e406-4e02-b144-fd45e294d37a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:18.311361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:18.312014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:18.312338 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:18.312616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] PATH_INFO: `/v3/users/0a1c747b486f45b68d7541ea9476faff` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:18.313817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1c747b486f45b68d7541ea9476faff)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:18.315839 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:18.321058 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 942/1884] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:18 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:18.322029 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33306af5-f21a-4c7b-a912-e9f9e8128628 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:18.323635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-33306af5-f21a-4c7b-a912-e9f9e8128628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:18.335229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33306af5-f21a-4c7b-a912-e9f9e8128628 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:18.340466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efb099-0a1c-421e-a978-61bb673aa293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:18.341097 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efb099-0a1c-421e-a978-61bb673aa293 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:18.341375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efb099-0a1c-421e-a978-61bb673aa293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:18.341680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efb099-0a1c-421e-a978-61bb673aa293 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:18.342339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efb099-0a1c-421e-a978-61bb673aa293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:18.343932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efb099-0a1c-421e-a978-61bb673aa293 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:18.354211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 943/1885] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:18.358461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efb099-0a1c-421e-a978-61bb673aa293 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:18.363552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1c747b486f45b68d7541ea9476faff'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.364249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1c747b486f45b68d7541ea9476faff'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.368477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efb099-0a1c-421e-a978-61bb673aa293 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:18.371924 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1c747b486f45b68d7541ea9476faff'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.373670 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364fb9f-ef4d-4c2a-9f7d-764265e86e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:18.374442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364fb9f-ef4d-4c2a-9f7d-764265e86e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:18.374853 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364fb9f-ef4d-4c2a-9f7d-764265e86e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:18.375195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364fb9f-ef4d-4c2a-9f7d-764265e86e17 admin admin] PATH_INFO: `/v3/projects/aea03637833c466a97382fc24fa68223/users/08d19266c964476a8e5524a3e4ae41db/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:18.379585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1c747b486f45b68d7541ea9476faff'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.380277 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1c747b486f45b68d7541ea9476faff'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.387516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:18.388064 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:18.391297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364fb9f-ef4d-4c2a-9f7d-764265e86e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea03637833c466a97382fc24fa68223, user_id=08d19266c964476a8e5524a3e4ae41db, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:18.395456 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364fb9f-ef4d-4c2a-9f7d-764265e86e17 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:18.402827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 943/1886] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:18 2022] DELETE /identity/v3/users/0a1c747b486f45b68d7541ea9476faff => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:18.410288 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 944/1887] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:18 2022] PUT /identity/v3/projects/aea03637833c466a97382fc24fa68223/users/08d19266c964476a8e5524a3e4ae41db/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:18.414170 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:18.415628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:18.486172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad7db0-3472-43df-98ed-3377e99a641e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:18.552402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082e750-b096-42d4-b897-bff891711900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:18.553061 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082e750-b096-42d4-b897-bff891711900 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:18.553338 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082e750-b096-42d4-b897-bff891711900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:18.553616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082e750-b096-42d4-b897-bff891711900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:18.554268 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082e750-b096-42d4-b897-bff891711900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:18.558780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082e750-b096-42d4-b897-bff891711900 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:18.571163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 944/1888] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:18.575053 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364fb9f-ef4d-4c2a-9f7d-764265e86e17 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:18.585726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364fb9f-ef4d-4c2a-9f7d-764265e86e17 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:18.590590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d0457-f9bc-4649-94e6-d9e545e3a96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:18.591239 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d0457-f9bc-4649-94e6-d9e545e3a96f admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:18.591523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d0457-f9bc-4649-94e6-d9e545e3a96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:18.591801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d0457-f9bc-4649-94e6-d9e545e3a96f admin admin] PATH_INFO: `/v3/projects/aea03637833c466a97382fc24fa68223/users/08d19266c964476a8e5524a3e4ae41db/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:18.593765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d0457-f9bc-4649-94e6-d9e545e3a96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea03637833c466a97382fc24fa68223, user_id=08d19266c964476a8e5524a3e4ae41db, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:18.596420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d0457-f9bc-4649-94e6-d9e545e3a96f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:18.607064 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 945/1889] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:18 2022] PUT /identity/v3/projects/aea03637833c466a97382fc24fa68223/users/08d19266c964476a8e5524a3e4ae41db/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:18.617971 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53462f9-8d38-47c4-847a-83535e5de5d9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:18.618257 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53462f9-8d38-47c4-847a-83535e5de5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:18.618549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53462f9-8d38-47c4-847a-83535e5de5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:18.648992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f53462f9-8d38-47c4-847a-83535e5de5d9 None None] MFA Rules not processed for user `08d19266c964476a8e5524a3e4ae41db`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:18.650258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f53462f9-8d38-47c4-847a-83535e5de5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:18.698102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d0457-f9bc-4649-94e6-d9e545e3a96f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:18.700488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c81d0457-f9bc-4649-94e6-d9e545e3a96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:18.747086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 945/1890] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:18.757775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53462f9-8d38-47c4-847a-83535e5de5d9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:18.759106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f53462f9-8d38-47c4-847a-83535e5de5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:18.781664 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:18.788598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d0457-f9bc-4649-94e6-d9e545e3a96f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:18.794505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:18.795238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:18.795533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:18.795885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] PATH_INFO: `/v3/projects/122b5c5927814e45b3f327d473a617d5` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:18.797135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=122b5c5927814e45b3f327d473a617d5)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:18.799105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:18.827039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53462f9-8d38-47c4-847a-83535e5de5d9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:18.830701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240bb82-94e2-44a4-b2f2-b34002348f29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:18.831314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240bb82-94e2-44a4-b2f2-b34002348f29 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:18.831679 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240bb82-94e2-44a4-b2f2-b34002348f29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:18.831877 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240bb82-94e2-44a4-b2f2-b34002348f29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:18.842955 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240bb82-94e2-44a4-b2f2-b34002348f29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:18.844475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240bb82-94e2-44a4-b2f2-b34002348f29 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:18.856801 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 946/1891] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:24:18.861263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122b5c5927814e45b3f327d473a617d5', 'request_id': 'req-a4f6c1f8-055e-47c4-9683-17d559a8eab8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.877742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122b5c5927814e45b3f327d473a617d5', 'request_id': 'req-a4f6c1f8-055e-47c4-9683-17d559a8eab8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.915620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122b5c5927814e45b3f327d473a617d5', 'request_id': 'req-a4f6c1f8-055e-47c4-9683-17d559a8eab8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.933163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] The token cache is being invalidate because project 122b5c5927814e45b3f327d473a617d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:18.933462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.934150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:18.936125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 946/1892] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:18 2022] DELETE /identity/v3/projects/122b5c5927814e45b3f327d473a617d5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:18.945620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa481d-fe2a-4025-895d-67d7cc8e6f04 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:18.946251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa481d-fe2a-4025-895d-67d7cc8e6f04 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:18.946542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa481d-fe2a-4025-895d-67d7cc8e6f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:18.993242 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7daa481d-fe2a-4025-895d-67d7cc8e6f04 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:19.003049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7daa481d-fe2a-4025-895d-67d7cc8e6f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:19.028397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:19.030222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:19.091448 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 947/1893] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:19.099159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e03c8-6994-4b5f-b57c-f1a6620bfbff None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.099456 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e03c8-6994-4b5f-b57c-f1a6620bfbff None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.099739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e03c8-6994-4b5f-b57c-f1a6620bfbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.112974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c1f8-055e-47c4-9683-17d559a8eab8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:19.119557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a6c3b-468b-40f1-b630-4e26663d069e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:19.120190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6c3b-468b-40f1-b630-4e26663d069e service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.120467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6c3b-468b-40f1-b630-4e26663d069e service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.120799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6c3b-468b-40f1-b630-4e26663d069e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.121358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8a8e03c8-6994-4b5f-b57c-f1a6620bfbff None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:19.122558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8a8e03c8-6994-4b5f-b57c-f1a6620bfbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:19.122666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4f9a6c3b-468b-40f1-b630-4e26663d069e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:19.130798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 948/1894] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:19.135090 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e03c8-6994-4b5f-b57c-f1a6620bfbff None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:19.150655 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:19.164453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e03c8-6994-4b5f-b57c-f1a6620bfbff None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:19.191188 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35fc61-d8dc-465f-901c-c0004c229e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:19.193117 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35fc61-d8dc-465f-901c-c0004c229e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.193925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35fc61-d8dc-465f-901c-c0004c229e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.194696 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35fc61-d8dc-465f-901c-c0004c229e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.196200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35fc61-d8dc-465f-901c-c0004c229e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:19.200680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35fc61-d8dc-465f-901c-c0004c229e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:19.203037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a6c3b-468b-40f1-b630-4e26663d069e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:19.203330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35fc61-d8dc-465f-901c-c0004c229e41 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:19.204498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a6c3b-468b-40f1-b630-4e26663d069e service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:19.215124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 947/1895] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:19.246983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 949/1896] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:24:19.251720 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a6c3b-468b-40f1-b630-4e26663d069e service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:19.270227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a6c3b-468b-40f1-b630-4e26663d069e service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:19.279535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75c917-5a6a-4e98-af9a-6d4c4a13b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:19.280212 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75c917-5a6a-4e98-af9a-6d4c4a13b2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.281198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75c917-5a6a-4e98-af9a-6d4c4a13b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.283461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75c917-5a6a-4e98-af9a-6d4c4a13b2b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.284702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75c917-5a6a-4e98-af9a-6d4c4a13b2b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:19.286701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75c917-5a6a-4e98-af9a-6d4c4a13b2b9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:19.339249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 948/1897] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:19 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:19.343625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35fc61-d8dc-465f-901c-c0004c229e41 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:19.355234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35fc61-d8dc-465f-901c-c0004c229e41 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:19.419103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0a280-a81d-4a69-a62b-b5924d899c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:19.419808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0a280-a81d-4a69-a62b-b5924d899c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.420059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0a280-a81d-4a69-a62b-b5924d899c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.420351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0a280-a81d-4a69-a62b-b5924d899c59 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.421032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0a280-a81d-4a69-a62b-b5924d899c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:19.423005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0a280-a81d-4a69-a62b-b5924d899c59 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:19.444432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 950/1898] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:19 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:19.448507 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75c917-5a6a-4e98-af9a-6d4c4a13b2b9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:19.458891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75c917-5a6a-4e98-af9a-6d4c4a13b2b9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:19.463730 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e4fa5-9138-470a-9b59-309b16a8ad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:19.464344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e4fa5-9138-470a-9b59-309b16a8ad2a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.464696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e4fa5-9138-470a-9b59-309b16a8ad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.465004 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e4fa5-9138-470a-9b59-309b16a8ad2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.465689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e4fa5-9138-470a-9b59-309b16a8ad2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:19.467302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e4fa5-9138-470a-9b59-309b16a8ad2a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:19.478744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 949/1899] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:19.483030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0a280-a81d-4a69-a62b-b5924d899c59 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:19.494917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0a280-a81d-4a69-a62b-b5924d899c59 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:19.513857 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c33b8e-6505-4d6d-a6b1-7a38c77f90f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:19.514530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33b8e-6505-4d6d-a6b1-7a38c77f90f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.514822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33b8e-6505-4d6d-a6b1-7a38c77f90f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.515117 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33b8e-6505-4d6d-a6b1-7a38c77f90f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.521880 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c33b8e-6505-4d6d-a6b1-7a38c77f90f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:19.523843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c33b8e-6505-4d6d-a6b1-7a38c77f90f0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:19.535673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 951/1900] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:19.540237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e4fa5-9138-470a-9b59-309b16a8ad2a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:19.551637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e4fa5-9138-470a-9b59-309b16a8ad2a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:19.556514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676020ad-0b7a-48eb-9111-16a922eabbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:19.557179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676020ad-0b7a-48eb-9111-16a922eabbbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.557475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676020ad-0b7a-48eb-9111-16a922eabbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.557859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676020ad-0b7a-48eb-9111-16a922eabbbc admin admin] PATH_INFO: `/v3/projects/4778793e82eb4d6aab304a738ca4bc78/users/dfd4317449c24f2ea0b04f248f0b8746/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.573745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676020ad-0b7a-48eb-9111-16a922eabbbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4778793e82eb4d6aab304a738ca4bc78, user_id=dfd4317449c24f2ea0b04f248f0b8746, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:19.576479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676020ad-0b7a-48eb-9111-16a922eabbbc admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:19.592736 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 950/1901] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:19 2022] PUT /identity/v3/projects/4778793e82eb4d6aab304a738ca4bc78/users/dfd4317449c24f2ea0b04f248f0b8746/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:19.604151 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af35f-48a6-4279-8345-d4820df922f2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.604450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af35f-48a6-4279-8345-d4820df922f2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.604747 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af35f-48a6-4279-8345-d4820df922f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.631636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-119af35f-48a6-4279-8345-d4820df922f2 None None] MFA Rules not processed for user `dfd4317449c24f2ea0b04f248f0b8746`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:19.632921 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-119af35f-48a6-4279-8345-d4820df922f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:19.641262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:19.703859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 952/1902] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:19.708660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676020ad-0b7a-48eb-9111-16a922eabbbc admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:19.778727 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676020ad-0b7a-48eb-9111-16a922eabbbc admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:19.784505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9d2ba-1d0f-4cab-8721-3f6f46b76995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:19.785204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9d2ba-1d0f-4cab-8721-3f6f46b76995 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.785484 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9d2ba-1d0f-4cab-8721-3f6f46b76995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.785931 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9d2ba-1d0f-4cab-8721-3f6f46b76995 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.786597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9d2ba-1d0f-4cab-8721-3f6f46b76995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:19.788588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9d2ba-1d0f-4cab-8721-3f6f46b76995 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:19.819943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 951/1903] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:19 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:19.821735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af35f-48a6-4279-8345-d4820df922f2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:19.833015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af35f-48a6-4279-8345-d4820df922f2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:19.896079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71ef19-953f-42b4-96fd-c6bd5a5993e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:19.896534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71ef19-953f-42b4-96fd-c6bd5a5993e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.896993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71ef19-953f-42b4-96fd-c6bd5a5993e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.897120 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71ef19-953f-42b4-96fd-c6bd5a5993e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.897730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71ef19-953f-42b4-96fd-c6bd5a5993e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:19.899733 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71ef19-953f-42b4-96fd-c6bd5a5993e6 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:19.924625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 953/1904] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:19 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:19.927882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9d2ba-1d0f-4cab-8721-3f6f46b76995 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:19.938906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9d2ba-1d0f-4cab-8721-3f6f46b76995 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:19.944185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cfbaf-e10e-4440-922d-2c7b2d5f5fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:19.944974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cfbaf-e10e-4440-922d-2c7b2d5f5fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.945442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cfbaf-e10e-4440-922d-2c7b2d5f5fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.945668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cfbaf-e10e-4440-922d-2c7b2d5f5fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.946405 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cfbaf-e10e-4440-922d-2c7b2d5f5fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:19.948016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cfbaf-e10e-4440-922d-2c7b2d5f5fe6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:19.959535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 952/1905] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:19.964120 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71ef19-953f-42b4-96fd-c6bd5a5993e6 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:19.974452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71ef19-953f-42b4-96fd-c6bd5a5993e6 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:19.979081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86b863-8b70-4274-9df7-0259a986b555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:19.979690 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86b863-8b70-4274-9df7-0259a986b555 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:19.979974 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86b863-8b70-4274-9df7-0259a986b555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:19.980297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86b863-8b70-4274-9df7-0259a986b555 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:19.980988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86b863-8b70-4274-9df7-0259a986b555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:19.982600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86b863-8b70-4274-9df7-0259a986b555 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:19.993053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 954/1906] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:19.997532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cfbaf-e10e-4440-922d-2c7b2d5f5fe6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:20.008378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cfbaf-e10e-4440-922d-2c7b2d5f5fe6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:20.017942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5441f-08c1-4e23-ad56-3ce1b9700e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:20.019174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5441f-08c1-4e23-ad56-3ce1b9700e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:20.019377 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5441f-08c1-4e23-ad56-3ce1b9700e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:20.019709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5441f-08c1-4e23-ad56-3ce1b9700e42 admin admin] PATH_INFO: `/v3/projects/e789b4eb17944ed7aad1891a5fa58140/users/a0e4f18b5cd44cfb9bff92db3162f0ed/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:20.038494 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5441f-08c1-4e23-ad56-3ce1b9700e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e789b4eb17944ed7aad1891a5fa58140, user_id=a0e4f18b5cd44cfb9bff92db3162f0ed, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:20.041293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5441f-08c1-4e23-ad56-3ce1b9700e42 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:20.060397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 953/1907] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:19 2022] PUT /identity/v3/projects/e789b4eb17944ed7aad1891a5fa58140/users/a0e4f18b5cd44cfb9bff92db3162f0ed/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:20.072170 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344820fb-c8ea-4c4c-9336-0eb725e8c45f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:20.072461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344820fb-c8ea-4c4c-9336-0eb725e8c45f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:20.072770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344820fb-c8ea-4c4c-9336-0eb725e8c45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:20.118199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-344820fb-c8ea-4c4c-9336-0eb725e8c45f None None] MFA Rules not processed for user `a0e4f18b5cd44cfb9bff92db3162f0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:20.119998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-344820fb-c8ea-4c4c-9336-0eb725e8c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:20.264325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 955/1908] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:20.274214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5441f-08c1-4e23-ad56-3ce1b9700e42 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:20.304634 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:20.365143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5441f-08c1-4e23-ad56-3ce1b9700e42 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:20.371250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d7982-f697-4bac-ae0e-561f4cef7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:20.371921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d7982-f697-4bac-ae0e-561f4cef7372 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:20.372202 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d7982-f697-4bac-ae0e-561f4cef7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:20.372487 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d7982-f697-4bac-ae0e-561f4cef7372 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:20.373160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d7982-f697-4bac-ae0e-561f4cef7372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:20.375199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d7982-f697-4bac-ae0e-561f4cef7372 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:20.407609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 954/1909] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:20 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:20.411284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344820fb-c8ea-4c4c-9336-0eb725e8c45f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:20.427284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344820fb-c8ea-4c4c-9336-0eb725e8c45f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:20.451097 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:20.565103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f962461-ab70-450b-a27f-cbcf2d114b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:20.565103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f962461-ab70-450b-a27f-cbcf2d114b3c admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:20.566024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f962461-ab70-450b-a27f-cbcf2d114b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:20.567123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f962461-ab70-450b-a27f-cbcf2d114b3c admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:20.568433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f962461-ab70-450b-a27f-cbcf2d114b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:20.572398 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f962461-ab70-450b-a27f-cbcf2d114b3c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:20.622166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 956/1910] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:20 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:20.628033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d7982-f697-4bac-ae0e-561f4cef7372 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:20.639112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d7982-f697-4bac-ae0e-561f4cef7372 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:20.644135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54087a0c-650d-4494-a395-5b4dea5f30eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:20.644487 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54087a0c-650d-4494-a395-5b4dea5f30eb admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:20.644816 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54087a0c-650d-4494-a395-5b4dea5f30eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:20.645086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54087a0c-650d-4494-a395-5b4dea5f30eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:20.645748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54087a0c-650d-4494-a395-5b4dea5f30eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:20.647367 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54087a0c-650d-4494-a395-5b4dea5f30eb admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:20.663312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f962461-ab70-450b-a27f-cbcf2d114b3c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:20.668806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 955/1911] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:20.673850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f962461-ab70-450b-a27f-cbcf2d114b3c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:20.679362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0909dd-4678-4cf5-94c0-c5386c44d7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:20.680037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0909dd-4678-4cf5-94c0-c5386c44d7be admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:20.680319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0909dd-4678-4cf5-94c0-c5386c44d7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:20.680601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0909dd-4678-4cf5-94c0-c5386c44d7be admin admin] PATH_INFO: `/v3/projects/8bcf33e7142c4340b21b928c68c8cb32/users/7f7d363b5fcf4ccbbb96d08ac2d1fd0f/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:20.699000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0909dd-4678-4cf5-94c0-c5386c44d7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcf33e7142c4340b21b928c68c8cb32, user_id=7f7d363b5fcf4ccbbb96d08ac2d1fd0f, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:20.701936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0909dd-4678-4cf5-94c0-c5386c44d7be admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:20.729635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 957/1912] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:20 2022] PUT /identity/v3/projects/8bcf33e7142c4340b21b928c68c8cb32/users/7f7d363b5fcf4ccbbb96d08ac2d1fd0f/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:20.734081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54087a0c-650d-4494-a395-5b4dea5f30eb admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:20.744211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54087a0c-650d-4494-a395-5b4dea5f30eb admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:20.815031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888887-5098-4962-8588-5521485f177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:20.815894 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888887-5098-4962-8588-5521485f177d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:20.816139 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888887-5098-4962-8588-5521485f177d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:20.816487 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888887-5098-4962-8588-5521485f177d admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:20.817241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888887-5098-4962-8588-5521485f177d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:20.819185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888887-5098-4962-8588-5521485f177d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:20.832008 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 956/1913] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:20.836289 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0909dd-4678-4cf5-94c0-c5386c44d7be admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:20.854099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0909dd-4678-4cf5-94c0-c5386c44d7be admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:20.855258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66638f-140c-4f56-aa16-5fb9e4dcbc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:20.855993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66638f-140c-4f56-aa16-5fb9e4dcbc4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:20.856485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66638f-140c-4f56-aa16-5fb9e4dcbc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:20.856698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66638f-140c-4f56-aa16-5fb9e4dcbc4a admin admin] PATH_INFO: `/v3/projects/8bcf33e7142c4340b21b928c68c8cb32/users/7f7d363b5fcf4ccbbb96d08ac2d1fd0f/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:20.859569 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66638f-140c-4f56-aa16-5fb9e4dcbc4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcf33e7142c4340b21b928c68c8cb32, user_id=7f7d363b5fcf4ccbbb96d08ac2d1fd0f, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:20.862518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66638f-140c-4f56-aa16-5fb9e4dcbc4a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:20.876807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 958/1914] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:20 2022] PUT /identity/v3/projects/8bcf33e7142c4340b21b928c68c8cb32/users/7f7d363b5fcf4ccbbb96d08ac2d1fd0f/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:20.885898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f3acb-2554-457c-b079-25ba93429680 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:20.886104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f3acb-2554-457c-b079-25ba93429680 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:20.886413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f3acb-2554-457c-b079-25ba93429680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:20.915710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-dd0f3acb-2554-457c-b079-25ba93429680 None None] MFA Rules not processed for user `7f7d363b5fcf4ccbbb96d08ac2d1fd0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:20.917039 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dd0f3acb-2554-457c-b079-25ba93429680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:20.989991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 957/1915] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:21.002013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66638f-140c-4f56-aa16-5fb9e4dcbc4a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:21.065247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66638f-140c-4f56-aa16-5fb9e4dcbc4a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:21.068886 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa83dbb-c94a-4a76-b8cf-b89efe613f22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:21.069498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83dbb-c94a-4a76-b8cf-b89efe613f22 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:21.069770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83dbb-c94a-4a76-b8cf-b89efe613f22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:21.070033 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83dbb-c94a-4a76-b8cf-b89efe613f22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:21.079185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa83dbb-c94a-4a76-b8cf-b89efe613f22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:21.081068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa83dbb-c94a-4a76-b8cf-b89efe613f22 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:21.091146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 959/1916] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:21.688103 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f3acb-2554-457c-b079-25ba93429680 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:21.689662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dd0f3acb-2554-457c-b079-25ba93429680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:21.702911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f3acb-2554-457c-b079-25ba93429680 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:21.707191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502ded5-a20a-457e-ad7d-b4b8185bb33f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:21.707840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502ded5-a20a-457e-ad7d-b4b8185bb33f service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:21.708131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502ded5-a20a-457e-ad7d-b4b8185bb33f service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:21.708406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502ded5-a20a-457e-ad7d-b4b8185bb33f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:21.717383 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:21.773837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502ded5-a20a-457e-ad7d-b4b8185bb33f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:21.775888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502ded5-a20a-457e-ad7d-b4b8185bb33f service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:21.787806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 958/1917] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:21.982032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa83dbb-c94a-4a76-b8cf-b89efe613f22 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:21.983551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-efa83dbb-c94a-4a76-b8cf-b89efe613f22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:22.052406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa83dbb-c94a-4a76-b8cf-b89efe613f22 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:22.058791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:22.059482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:22.059880 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:22.060254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] PATH_INFO: `/v3/users/27796a2ca3ed412f90434ff3474cda56` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:22.061744 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=27796a2ca3ed412f90434ff3474cda56)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:22.064152 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:22.085656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:22.152947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27796a2ca3ed412f90434ff3474cda56'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:22.153684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27796a2ca3ed412f90434ff3474cda56'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:22.163889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27796a2ca3ed412f90434ff3474cda56'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:22.173157 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27796a2ca3ed412f90434ff3474cda56'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:22.173859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27796a2ca3ed412f90434ff3474cda56'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:22.193103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 960/1918] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:21 2022] DELETE /identity/v3/users/27796a2ca3ed412f90434ff3474cda56 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:22.197834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44bfc7-38aa-4ecc-b250-c7dd159668ff None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:22.198125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44bfc7-38aa-4ecc-b250-c7dd159668ff None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:22.198403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44bfc7-38aa-4ecc-b250-c7dd159668ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:22.217232 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-7e44bfc7-38aa-4ecc-b250-c7dd159668ff None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:22.218457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7e44bfc7-38aa-4ecc-b250-c7dd159668ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:22.278672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 959/1919] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:22.288842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:22.290495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:22.351163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6d712-5e87-48b3-a27d-d660573dc4bf admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:22.355079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41c952-1b38-4f7e-bd4f-8dd64b437b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:22.355917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41c952-1b38-4f7e-bd4f-8dd64b437b65 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:22.356196 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41c952-1b38-4f7e-bd4f-8dd64b437b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:22.356465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41c952-1b38-4f7e-bd4f-8dd64b437b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:22.366395 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41c952-1b38-4f7e-bd4f-8dd64b437b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:22.368010 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41c952-1b38-4f7e-bd4f-8dd64b437b65 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:22.378583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 961/1920] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:22.737281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44bfc7-38aa-4ecc-b250-c7dd159668ff None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:22.738841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7e44bfc7-38aa-4ecc-b250-c7dd159668ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:22.750850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44bfc7-38aa-4ecc-b250-c7dd159668ff None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:22.762691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:22.764123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:22.764409 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:22.764682 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] PATH_INFO: `/v3/projects/070a4434f35a4712b5a40e6e048f388a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:22.766822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070a4434f35a4712b5a40e6e048f388a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:22.769938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:22.822819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070a4434f35a4712b5a40e6e048f388a', 'request_id': 'req-e9ebb34f-7816-4326-8a1f-294484440226'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:22.831579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070a4434f35a4712b5a40e6e048f388a', 'request_id': 'req-e9ebb34f-7816-4326-8a1f-294484440226'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:22.838101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070a4434f35a4712b5a40e6e048f388a', 'request_id': 'req-e9ebb34f-7816-4326-8a1f-294484440226'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:22.849719 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] The token cache is being invalidate because project 070a4434f35a4712b5a40e6e048f388a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:22.850011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:22.850672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:22.852187 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 960/1921] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:22 2022] DELETE /identity/v3/projects/070a4434f35a4712b5a40e6e048f388a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:22.856421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41c952-1b38-4f7e-bd4f-8dd64b437b65 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:22.866941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41c952-1b38-4f7e-bd4f-8dd64b437b65 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:22.927478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31269a07-0b84-4822-a812-bf611ec3cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:22.928416 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31269a07-0b84-4822-a812-bf611ec3cc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:22.928880 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31269a07-0b84-4822-a812-bf611ec3cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:22.929150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31269a07-0b84-4822-a812-bf611ec3cc40 admin admin] PATH_INFO: `/v3/users/08d19266c964476a8e5524a3e4ae41db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:22.930374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31269a07-0b84-4822-a812-bf611ec3cc40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d19266c964476a8e5524a3e4ae41db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:22.932421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31269a07-0b84-4822-a812-bf611ec3cc40 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:22.988885 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:23.001145 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-31269a07-0b84-4822-a812-bf611ec3cc40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d19266c964476a8e5524a3e4ae41db'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:23.001808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-31269a07-0b84-4822-a812-bf611ec3cc40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d19266c964476a8e5524a3e4ae41db'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:23.015469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-31269a07-0b84-4822-a812-bf611ec3cc40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d19266c964476a8e5524a3e4ae41db'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:23.024401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-31269a07-0b84-4822-a812-bf611ec3cc40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d19266c964476a8e5524a3e4ae41db'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:23.025259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-31269a07-0b84-4822-a812-bf611ec3cc40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d19266c964476a8e5524a3e4ae41db'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:23.044512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 962/1922] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:22 2022] DELETE /identity/v3/users/08d19266c964476a8e5524a3e4ae41db => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:23.323281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:23.324832 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:23.338656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebb34f-7816-4326-8a1f-294484440226 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:23.370171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:23.400892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bacf11-3fa9-408e-a78c-b3722b4dd879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:23.401541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bacf11-3fa9-408e-a78c-b3722b4dd879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:23.401857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bacf11-3fa9-408e-a78c-b3722b4dd879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:23.402148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bacf11-3fa9-408e-a78c-b3722b4dd879 admin admin] PATH_INFO: `/v3/projects/aea03637833c466a97382fc24fa68223` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:23.403267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bacf11-3fa9-408e-a78c-b3722b4dd879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea03637833c466a97382fc24fa68223)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:23.405330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bacf11-3fa9-408e-a78c-b3722b4dd879 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:23.454198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-62bacf11-3fa9-408e-a78c-b3722b4dd879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea03637833c466a97382fc24fa68223', 'request_id': 'req-62bacf11-3fa9-408e-a78c-b3722b4dd879'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:23.462285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-62bacf11-3fa9-408e-a78c-b3722b4dd879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea03637833c466a97382fc24fa68223', 'request_id': 'req-62bacf11-3fa9-408e-a78c-b3722b4dd879'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:23.468392 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-62bacf11-3fa9-408e-a78c-b3722b4dd879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea03637833c466a97382fc24fa68223', 'request_id': 'req-62bacf11-3fa9-408e-a78c-b3722b4dd879'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:23.478717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-62bacf11-3fa9-408e-a78c-b3722b4dd879 admin admin] The token cache is being invalidate because project aea03637833c466a97382fc24fa68223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:23.479007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-62bacf11-3fa9-408e-a78c-b3722b4dd879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:23.479650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-62bacf11-3fa9-408e-a78c-b3722b4dd879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:23.481229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 961/1923] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:23 2022] DELETE /identity/v3/projects/aea03637833c466a97382fc24fa68223 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:23.486298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f83f1c-585f-4a05-a30a-ba3e2520132b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:23.486634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f83f1c-585f-4a05-a30a-ba3e2520132b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:23.486950 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f83f1c-585f-4a05-a30a-ba3e2520132b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:23.506683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-17f83f1c-585f-4a05-a30a-ba3e2520132b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:23.507900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-17f83f1c-585f-4a05-a30a-ba3e2520132b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:23.567589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 963/1924] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:23.575598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7065d-9c5d-4114-a427-1784237e473a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:23.575892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7065d-9c5d-4114-a427-1784237e473a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:23.576162 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7065d-9c5d-4114-a427-1784237e473a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:23.595822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-46a7065d-9c5d-4114-a427-1784237e473a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:23.597061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-46a7065d-9c5d-4114-a427-1784237e473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:23.605381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 962/1925] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:23.609532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f83f1c-585f-4a05-a30a-ba3e2520132b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:23.619214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f83f1c-585f-4a05-a30a-ba3e2520132b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:23.624171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7eadf-a7b8-4063-bdbd-0520bdae3428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:23.624794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7eadf-a7b8-4063-bdbd-0520bdae3428 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:23.625077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7eadf-a7b8-4063-bdbd-0520bdae3428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:23.625352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7eadf-a7b8-4063-bdbd-0520bdae3428 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:23.626008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7eadf-a7b8-4063-bdbd-0520bdae3428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:23.626310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7eadf-a7b8-4063-bdbd-0520bdae3428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:23.627924 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7eadf-a7b8-4063-bdbd-0520bdae3428 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:23.639656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 964/1926] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:24:23.643861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7065d-9c5d-4114-a427-1784237e473a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:23.653214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7065d-9c5d-4114-a427-1784237e473a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:23.658384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1cd1e-8129-4098-b36a-ffcbc17e596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:23.658976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1cd1e-8129-4098-b36a-ffcbc17e596c admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:23.659272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1cd1e-8129-4098-b36a-ffcbc17e596c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:23.659569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1cd1e-8129-4098-b36a-ffcbc17e596c admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:23.660218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1cd1e-8129-4098-b36a-ffcbc17e596c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:23.662218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1cd1e-8129-4098-b36a-ffcbc17e596c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:23.695751 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 963/1927] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:23 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:23.697164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7eadf-a7b8-4063-bdbd-0520bdae3428 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:23.707658 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7eadf-a7b8-4063-bdbd-0520bdae3428 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:23.764590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecde12a-0f0d-4fd9-826b-312a5767d2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:23.765244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecde12a-0f0d-4fd9-826b-312a5767d2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:23.765534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecde12a-0f0d-4fd9-826b-312a5767d2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:23.765809 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecde12a-0f0d-4fd9-826b-312a5767d2b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:23.766916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecde12a-0f0d-4fd9-826b-312a5767d2b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:23.768362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecde12a-0f0d-4fd9-826b-312a5767d2b4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:23.793997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 965/1928] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:23 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:23.795156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1cd1e-8129-4098-b36a-ffcbc17e596c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:23.807077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1cd1e-8129-4098-b36a-ffcbc17e596c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:23.811779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90677c-e673-4b00-a899-c1bfae42fc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:23.812407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90677c-e673-4b00-a899-c1bfae42fc7a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:23.812781 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90677c-e673-4b00-a899-c1bfae42fc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:23.813044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90677c-e673-4b00-a899-c1bfae42fc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:23.813718 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90677c-e673-4b00-a899-c1bfae42fc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:23.815538 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90677c-e673-4b00-a899-c1bfae42fc7a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:23.826477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 964/1929] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:23.830726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecde12a-0f0d-4fd9-826b-312a5767d2b4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:23.845678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecde12a-0f0d-4fd9-826b-312a5767d2b4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:23.851166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82bcd2-4d2f-45b5-a728-aef92b2c1e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:23.851866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82bcd2-4d2f-45b5-a728-aef92b2c1e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:23.852151 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82bcd2-4d2f-45b5-a728-aef92b2c1e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:23.852402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82bcd2-4d2f-45b5-a728-aef92b2c1e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:23.853108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82bcd2-4d2f-45b5-a728-aef92b2c1e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:23.854716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82bcd2-4d2f-45b5-a728-aef92b2c1e6d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:23.866130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 966/1930] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:23.870513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90677c-e673-4b00-a899-c1bfae42fc7a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:23.880925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90677c-e673-4b00-a899-c1bfae42fc7a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:23.885569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfcdf7-2ee6-4ab3-8579-c1755d61f7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:23.886231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfcdf7-2ee6-4ab3-8579-c1755d61f7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:23.886567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfcdf7-2ee6-4ab3-8579-c1755d61f7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:23.886844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfcdf7-2ee6-4ab3-8579-c1755d61f7f8 admin admin] PATH_INFO: `/v3/projects/d75212b13bb84f8d9405945038de0e0f/users/b4f5f26577544225b636f713f6ee3c39/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:23.902377 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfcdf7-2ee6-4ab3-8579-c1755d61f7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75212b13bb84f8d9405945038de0e0f, user_id=b4f5f26577544225b636f713f6ee3c39, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:23.905190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfcdf7-2ee6-4ab3-8579-c1755d61f7f8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:23.918992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 965/1931] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:23 2022] PUT /identity/v3/projects/d75212b13bb84f8d9405945038de0e0f/users/b4f5f26577544225b636f713f6ee3c39/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:23.929511 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bbd13-23d8-434c-b5a4-9231ef6457f8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:23.929801 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bbd13-23d8-434c-b5a4-9231ef6457f8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:23.930125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bbd13-23d8-434c-b5a4-9231ef6457f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:23.961476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8c7bbd13-23d8-434c-b5a4-9231ef6457f8 None None] MFA Rules not processed for user `b4f5f26577544225b636f713f6ee3c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:23.962725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8c7bbd13-23d8-434c-b5a4-9231ef6457f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:23.981154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:24.041582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 967/1932] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:24.053316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfcdf7-2ee6-4ab3-8579-c1755d61f7f8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:24.055038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-45dfcdf7-2ee6-4ab3-8579-c1755d61f7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:24.155791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:24.172606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfcdf7-2ee6-4ab3-8579-c1755d61f7f8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:24.176888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f9fa0-40ee-40c9-8f37-e4967c2d6a98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ee7b50c34742ce896a734f3ef34a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:24.177498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f9fa0-40ee-40c9-8f37-e4967c2d6a98 service glance] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:24.177770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f9fa0-40ee-40c9-8f37-e4967c2d6a98 service glance] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:24.178172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f9fa0-40ee-40c9-8f37-e4967c2d6a98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:24.209156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f9fa0-40ee-40c9-8f37-e4967c2d6a98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:24.210779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f9fa0-40ee-40c9-8f37-e4967c2d6a98 service glance] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:24.223184 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 966/1933] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:25.823012 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bbd13-23d8-434c-b5a4-9231ef6457f8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:25.824653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8c7bbd13-23d8-434c-b5a4-9231ef6457f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:25.891375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bbd13-23d8-434c-b5a4-9231ef6457f8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:25.897746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:25.898436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:25.898712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:25.898976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] PATH_INFO: `/v3/users/1004e825774c48b59a8c238e1ce4c5d7` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:25.900247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1004e825774c48b59a8c238e1ce4c5d7)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:25.902291 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:25.952562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1004e825774c48b59a8c238e1ce4c5d7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:25.953266 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1004e825774c48b59a8c238e1ce4c5d7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:25.961561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1004e825774c48b59a8c238e1ce4c5d7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:25.968624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1004e825774c48b59a8c238e1ce4c5d7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:25.969442 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1004e825774c48b59a8c238e1ce4c5d7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:25.987371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 968/1934] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:25 2022] DELETE /identity/v3/users/1004e825774c48b59a8c238e1ce4c5d7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:25.991818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88358-ee5b-411e-b20b-174554eb79fe None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:25.992476 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88358-ee5b-411e-b20b-174554eb79fe None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:25.992476 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88358-ee5b-411e-b20b-174554eb79fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:26.011129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-37e88358-ee5b-411e-b20b-174554eb79fe None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:26.012247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-37e88358-ee5b-411e-b20b-174554eb79fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:26.071775 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 967/1935] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:26.082600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:26.084119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:26.115856 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:26.146708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f12a43-e52e-4545-96b3-83773e32a4fa admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:26.150511 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d249a-5e82-480f-b89f-c052d11e83db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:26.151104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d249a-5e82-480f-b89f-c052d11e83db service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:26.151384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d249a-5e82-480f-b89f-c052d11e83db service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:26.151722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d249a-5e82-480f-b89f-c052d11e83db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:26.161445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d249a-5e82-480f-b89f-c052d11e83db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:26.162804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d249a-5e82-480f-b89f-c052d11e83db service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:26.176842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 969/1936] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:26.516060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88358-ee5b-411e-b20b-174554eb79fe None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:26.520410 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-37e88358-ee5b-411e-b20b-174554eb79fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:26.534737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88358-ee5b-411e-b20b-174554eb79fe None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:26.539549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:26.540384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:26.540658 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:26.541145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] PATH_INFO: `/v3/projects/e08fd105aec0470083ba4e31980144ca` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:26.542354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08fd105aec0470083ba4e31980144ca)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:26.544339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:26.604706 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08fd105aec0470083ba4e31980144ca', 'request_id': 'req-a2377962-1fda-490f-a63b-c7760025ec6e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:26.616933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08fd105aec0470083ba4e31980144ca', 'request_id': 'req-a2377962-1fda-490f-a63b-c7760025ec6e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:26.624346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08fd105aec0470083ba4e31980144ca', 'request_id': 'req-a2377962-1fda-490f-a63b-c7760025ec6e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:26.640556 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] The token cache is being invalidate because project e08fd105aec0470083ba4e31980144ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:26.641009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:26.641799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:26.643748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 968/1937] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:26 2022] DELETE /identity/v3/projects/e08fd105aec0470083ba4e31980144ca => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:26.648672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d249a-5e82-480f-b89f-c052d11e83db service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:26.659556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d249a-5e82-480f-b89f-c052d11e83db service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:26.716285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370dd9-6e6e-4c6b-becf-b1a02b6b07b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:26.717108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370dd9-6e6e-4c6b-becf-b1a02b6b07b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:26.717385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370dd9-6e6e-4c6b-becf-b1a02b6b07b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:26.717687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370dd9-6e6e-4c6b-becf-b1a02b6b07b7 admin admin] PATH_INFO: `/v3/users/289ac45029634f61875bf21d67efa8fd` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:26.718816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c370dd9-6e6e-4c6b-becf-b1a02b6b07b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=289ac45029634f61875bf21d67efa8fd)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:26.720761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c370dd9-6e6e-4c6b-becf-b1a02b6b07b7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:26.768699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7c370dd9-6e6e-4c6b-becf-b1a02b6b07b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289ac45029634f61875bf21d67efa8fd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:26.769372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7c370dd9-6e6e-4c6b-becf-b1a02b6b07b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289ac45029634f61875bf21d67efa8fd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:26.777405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7c370dd9-6e6e-4c6b-becf-b1a02b6b07b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289ac45029634f61875bf21d67efa8fd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:26.784640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7c370dd9-6e6e-4c6b-becf-b1a02b6b07b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289ac45029634f61875bf21d67efa8fd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:26.785565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7c370dd9-6e6e-4c6b-becf-b1a02b6b07b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289ac45029634f61875bf21d67efa8fd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:26.805852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 970/1938] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:26 2022] DELETE /identity/v3/users/289ac45029634f61875bf21d67efa8fd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:27.077658 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:27.079315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:27.094225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2377962-1fda-490f-a63b-c7760025ec6e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:27.151894 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:27.153179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:27.153483 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:27.153752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9 admin admin] PATH_INFO: `/v3/projects/b8a289b8eab74c849b4fe2e85f4e95de` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:27.154861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a289b8eab74c849b4fe2e85f4e95de)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:27.156880 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:27.164679 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:27.205820 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a289b8eab74c849b4fe2e85f4e95de', 'request_id': 'req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:27.213897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a289b8eab74c849b4fe2e85f4e95de', 'request_id': 'req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:27.220416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a289b8eab74c849b4fe2e85f4e95de', 'request_id': 'req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:27.231915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9 admin admin] The token cache is being invalidate because project b8a289b8eab74c849b4fe2e85f4e95de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:27.232204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:27.232950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-24885cd4-fb2d-4cb5-8004-6fdb0f9c5de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:27.234641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 969/1939] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:27 2022] DELETE /identity/v3/projects/b8a289b8eab74c849b4fe2e85f4e95de => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:27.239295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a9a0-4fda-4d2b-9ca5-a9165dbc6d39 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:27.239749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a9a0-4fda-4d2b-9ca5-a9165dbc6d39 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:27.239835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a9a0-4fda-4d2b-9ca5-a9165dbc6d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:27.260595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6ea0a9a0-4fda-4d2b-9ca5-a9165dbc6d39 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:27.261872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6ea0a9a0-4fda-4d2b-9ca5-a9165dbc6d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:27.308149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:27.323731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 971/1940] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:27.331792 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1deb-fe44-4c5d-836a-5d627900b75a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:27.332075 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1deb-fe44-4c5d-836a-5d627900b75a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:27.332350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1deb-fe44-4c5d-836a-5d627900b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:27.352146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-618f1deb-fe44-4c5d-836a-5d627900b75a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:27.353352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-618f1deb-fe44-4c5d-836a-5d627900b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:27.362003 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 970/1941] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:27.366422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a9a0-4fda-4d2b-9ca5-a9165dbc6d39 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:27.376813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a9a0-4fda-4d2b-9ca5-a9165dbc6d39 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:27.382092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc651da6-35b2-4f4b-a156-7849bdd9f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:27.382712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc651da6-35b2-4f4b-a156-7849bdd9f62d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:27.382976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc651da6-35b2-4f4b-a156-7849bdd9f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:27.383309 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc651da6-35b2-4f4b-a156-7849bdd9f62d admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:27.383975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc651da6-35b2-4f4b-a156-7849bdd9f62d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:27.384282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc651da6-35b2-4f4b-a156-7849bdd9f62d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:27.385939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc651da6-35b2-4f4b-a156-7849bdd9f62d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:27.398258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 972/1942] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:24:27.402619 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1deb-fe44-4c5d-836a-5d627900b75a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:27.413213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1deb-fe44-4c5d-836a-5d627900b75a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:27.418789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceccec-ec1b-40a5-8966-ec25033c56b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:27.419380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceccec-ec1b-40a5-8966-ec25033c56b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:27.419749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceccec-ec1b-40a5-8966-ec25033c56b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:27.419904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceccec-ec1b-40a5-8966-ec25033c56b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:27.420604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ceccec-ec1b-40a5-8966-ec25033c56b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:27.423451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ceccec-ec1b-40a5-8966-ec25033c56b4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:27.452540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 971/1943] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:27 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:27.456739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc651da6-35b2-4f4b-a156-7849bdd9f62d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:27.467356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc651da6-35b2-4f4b-a156-7849bdd9f62d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:27.540118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cbbb8-4b0b-4a42-8973-e3cab838794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:27.541195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cbbb8-4b0b-4a42-8973-e3cab838794e admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:27.541195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cbbb8-4b0b-4a42-8973-e3cab838794e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:27.541467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cbbb8-4b0b-4a42-8973-e3cab838794e admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:27.542308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cbbb8-4b0b-4a42-8973-e3cab838794e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:27.544321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cbbb8-4b0b-4a42-8973-e3cab838794e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:27.572110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 973/1944] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:27 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:27.575104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceccec-ec1b-40a5-8966-ec25033c56b4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:27.594921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceccec-ec1b-40a5-8966-ec25033c56b4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:27.600944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49f133-a627-4abb-96cb-2b8a1c0cfea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:27.601571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49f133-a627-4abb-96cb-2b8a1c0cfea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:27.601879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49f133-a627-4abb-96cb-2b8a1c0cfea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:27.602158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49f133-a627-4abb-96cb-2b8a1c0cfea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:27.602812 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49f133-a627-4abb-96cb-2b8a1c0cfea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:27.604415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49f133-a627-4abb-96cb-2b8a1c0cfea6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:27.615310 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 972/1945] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:27.619416 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cbbb8-4b0b-4a42-8973-e3cab838794e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:27.630651 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cbbb8-4b0b-4a42-8973-e3cab838794e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:27.635411 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ae80b-2507-4a86-b8f3-3b0142ef52ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:27.636107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ae80b-2507-4a86-b8f3-3b0142ef52ae admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:27.636531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ae80b-2507-4a86-b8f3-3b0142ef52ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:27.637037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ae80b-2507-4a86-b8f3-3b0142ef52ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:27.637716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ae80b-2507-4a86-b8f3-3b0142ef52ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:27.639668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ae80b-2507-4a86-b8f3-3b0142ef52ae admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:27.656276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 974/1946] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:27.656915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49f133-a627-4abb-96cb-2b8a1c0cfea6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:27.680373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49f133-a627-4abb-96cb-2b8a1c0cfea6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:27.696035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b86820-04f0-4ccf-ae91-becb8592c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:27.696754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b86820-04f0-4ccf-ae91-becb8592c6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:27.697031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b86820-04f0-4ccf-ae91-becb8592c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:27.697310 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b86820-04f0-4ccf-ae91-becb8592c6c9 admin admin] PATH_INFO: `/v3/projects/86e6f96f1b9147299912d00c04917d1c/users/560b9e5090144ee1acb90cb1b41b5e00/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:27.713576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b86820-04f0-4ccf-ae91-becb8592c6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e6f96f1b9147299912d00c04917d1c, user_id=560b9e5090144ee1acb90cb1b41b5e00, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:27.716587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b86820-04f0-4ccf-ae91-becb8592c6c9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:27.731942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 973/1947] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:27 2022] PUT /identity/v3/projects/86e6f96f1b9147299912d00c04917d1c/users/560b9e5090144ee1acb90cb1b41b5e00/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:27.742963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e0927-f4be-46c6-8aa2-15d866bca919 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:27.743253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e0927-f4be-46c6-8aa2-15d866bca919 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:27.743526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e0927-f4be-46c6-8aa2-15d866bca919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:27.778822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-be0e0927-f4be-46c6-8aa2-15d866bca919 None None] MFA Rules not processed for user `560b9e5090144ee1acb90cb1b41b5e00`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:27.780059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-be0e0927-f4be-46c6-8aa2-15d866bca919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:27.857055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 975/1948] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:27.857553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b86820-04f0-4ccf-ae91-becb8592c6c9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:27.942929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b86820-04f0-4ccf-ae91-becb8592c6c9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:27.948073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba2379-d4bb-4ea7-a1a8-071d819b6b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:27.948752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba2379-d4bb-4ea7-a1a8-071d819b6b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:27.949082 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba2379-d4bb-4ea7-a1a8-071d819b6b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:27.949382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba2379-d4bb-4ea7-a1a8-071d819b6b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:27.950075 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba2379-d4bb-4ea7-a1a8-071d819b6b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:27.952055 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba2379-d4bb-4ea7-a1a8-071d819b6b90 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:27.983081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 974/1949] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:27 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:27.987434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e0927-f4be-46c6-8aa2-15d866bca919 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:28.004894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e0927-f4be-46c6-8aa2-15d866bca919 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:28.057190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:28.070767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932ddb9-1415-42cc-9e50-a486a49deed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:28.071420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932ddb9-1415-42cc-9e50-a486a49deed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:28.071718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932ddb9-1415-42cc-9e50-a486a49deed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:28.071972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932ddb9-1415-42cc-9e50-a486a49deed5 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:28.072600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932ddb9-1415-42cc-9e50-a486a49deed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:28.074742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932ddb9-1415-42cc-9e50-a486a49deed5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:28.098691 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 976/1950] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:27 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:28.102928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba2379-d4bb-4ea7-a1a8-071d819b6b90 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:28.113471 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba2379-d4bb-4ea7-a1a8-071d819b6b90 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:28.117995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696451c5-0f0e-4b45-a004-76ddcb71367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:28.118592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696451c5-0f0e-4b45-a004-76ddcb71367a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:28.118869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696451c5-0f0e-4b45-a004-76ddcb71367a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:28.119141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696451c5-0f0e-4b45-a004-76ddcb71367a admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:28.119776 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696451c5-0f0e-4b45-a004-76ddcb71367a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:28.121422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696451c5-0f0e-4b45-a004-76ddcb71367a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:28.132846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 975/1951] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:28.137207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932ddb9-1415-42cc-9e50-a486a49deed5 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:28.147836 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932ddb9-1415-42cc-9e50-a486a49deed5 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:28.153245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321531d-3597-491b-bc96-0ce43119fd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:28.153903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321531d-3597-491b-bc96-0ce43119fd35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:28.154191 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321531d-3597-491b-bc96-0ce43119fd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:28.154474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321531d-3597-491b-bc96-0ce43119fd35 admin admin] PATH_INFO: `/v3/projects/ea60f0e3e626467691763e2b56ab3825/users/4c324e0b727c43028dba060755d930c7/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:28.171112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321531d-3597-491b-bc96-0ce43119fd35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea60f0e3e626467691763e2b56ab3825, user_id=4c324e0b727c43028dba060755d930c7, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:28.173832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321531d-3597-491b-bc96-0ce43119fd35 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:28.189013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 977/1952] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:28 2022] PUT /identity/v3/projects/ea60f0e3e626467691763e2b56ab3825/users/4c324e0b727c43028dba060755d930c7/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:28.193118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696451c5-0f0e-4b45-a004-76ddcb71367a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:28.203713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696451c5-0f0e-4b45-a004-76ddcb71367a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:28.207791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:28.265792 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e99441-ead9-4c7a-951f-c83b7a2dc872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:28.266419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e99441-ead9-4c7a-951f-c83b7a2dc872 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:28.266696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e99441-ead9-4c7a-951f-c83b7a2dc872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:28.266965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e99441-ead9-4c7a-951f-c83b7a2dc872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:28.267610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e99441-ead9-4c7a-951f-c83b7a2dc872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:28.269233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e99441-ead9-4c7a-951f-c83b7a2dc872 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:28.279639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 976/1953] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:28.284048 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321531d-3597-491b-bc96-0ce43119fd35 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:28.294715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321531d-3597-491b-bc96-0ce43119fd35 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:28.299591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4ab7-fe1f-4294-83b1-eeb00c236540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:28.300234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4ab7-fe1f-4294-83b1-eeb00c236540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:28.300513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4ab7-fe1f-4294-83b1-eeb00c236540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:28.300846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4ab7-fe1f-4294-83b1-eeb00c236540 admin admin] PATH_INFO: `/v3/projects/ea60f0e3e626467691763e2b56ab3825/users/4c324e0b727c43028dba060755d930c7/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:28.302777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c4ab7-fe1f-4294-83b1-eeb00c236540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea60f0e3e626467691763e2b56ab3825, user_id=4c324e0b727c43028dba060755d930c7, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:28.305477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c4ab7-fe1f-4294-83b1-eeb00c236540 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:28.315425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 978/1954] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:28 2022] PUT /identity/v3/projects/ea60f0e3e626467691763e2b56ab3825/users/4c324e0b727c43028dba060755d930c7/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:28.326702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4ac9a-e44d-44be-b1c5-24cbb33a2c0f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:28.326991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4ac9a-e44d-44be-b1c5-24cbb33a2c0f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:28.327267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4ac9a-e44d-44be-b1c5-24cbb33a2c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:28.355759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0fc4ac9a-e44d-44be-b1c5-24cbb33a2c0f None None] MFA Rules not processed for user `4c324e0b727c43028dba060755d930c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:28.356959 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0fc4ac9a-e44d-44be-b1c5-24cbb33a2c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:28.432692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 977/1955] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:28.444139 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4ab7-fe1f-4294-83b1-eeb00c236540 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:28.445898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a84c4ab7-fe1f-4294-83b1-eeb00c236540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:28.510790 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4ab7-fe1f-4294-83b1-eeb00c236540 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:28.515791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc4f59-0979-4e19-990b-5f7102ca3736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:28.516427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc4f59-0979-4e19-990b-5f7102ca3736 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:28.516707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc4f59-0979-4e19-990b-5f7102ca3736 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:28.517661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc4f59-0979-4e19-990b-5f7102ca3736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:28.528315 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc4f59-0979-4e19-990b-5f7102ca3736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:28.529927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc4f59-0979-4e19-990b-5f7102ca3736 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:28.540016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 979/1956] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:30.098045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4ac9a-e44d-44be-b1c5-24cbb33a2c0f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:30.108921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4ac9a-e44d-44be-b1c5-24cbb33a2c0f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:30.112579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776051b-363e-4cfe-b8f9-676b85b1900f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:30.113380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776051b-363e-4cfe-b8f9-676b85b1900f service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:30.113664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776051b-363e-4cfe-b8f9-676b85b1900f service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:30.113946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776051b-363e-4cfe-b8f9-676b85b1900f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:30.115731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1776051b-363e-4cfe-b8f9-676b85b1900f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:30.209258 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776051b-363e-4cfe-b8f9-676b85b1900f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:30.212221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776051b-363e-4cfe-b8f9-676b85b1900f service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:30.224286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 978/1957] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:30.930405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc4f59-0979-4e19-990b-5f7102ca3736 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:31.009092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc4f59-0979-4e19-990b-5f7102ca3736 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:31.014404 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841026e3-62a9-40de-b648-43151361676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:31.015149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841026e3-62a9-40de-b648-43151361676c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:31.015518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841026e3-62a9-40de-b648-43151361676c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:31.015902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841026e3-62a9-40de-b648-43151361676c admin admin] PATH_INFO: `/v3/users/560b9e5090144ee1acb90cb1b41b5e00` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:31.017370 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841026e3-62a9-40de-b648-43151361676c admin admin] RBAC: Authorizing `identity:delete_user(user_id=560b9e5090144ee1acb90cb1b41b5e00)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:31.019653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841026e3-62a9-40de-b648-43151361676c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:31.089608 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:31.094119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-841026e3-62a9-40de-b648-43151361676c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560b9e5090144ee1acb90cb1b41b5e00'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:31.095099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-841026e3-62a9-40de-b648-43151361676c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560b9e5090144ee1acb90cb1b41b5e00'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:31.108752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-841026e3-62a9-40de-b648-43151361676c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560b9e5090144ee1acb90cb1b41b5e00'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:31.121210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-841026e3-62a9-40de-b648-43151361676c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560b9e5090144ee1acb90cb1b41b5e00'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:31.122286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-841026e3-62a9-40de-b648-43151361676c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560b9e5090144ee1acb90cb1b41b5e00'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:31.148316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 980/1958] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:30 2022] DELETE /identity/v3/users/560b9e5090144ee1acb90cb1b41b5e00 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:31.152979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc4ce4-1321-4859-b628-28b0e205121c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:31.154013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc4ce4-1321-4859-b628-28b0e205121c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:31.154774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc4ce4-1321-4859-b628-28b0e205121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:31.197084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e2fc4ce4-1321-4859-b628-28b0e205121c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:31.198416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e2fc4ce4-1321-4859-b628-28b0e205121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:31.259171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:31.307362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 979/1959] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:31.317129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841026e3-62a9-40de-b648-43151361676c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:31.318727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-841026e3-62a9-40de-b648-43151361676c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:31.387609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841026e3-62a9-40de-b648-43151361676c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:31.396542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051ce87-acbb-44ea-b0d7-8115f17070db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:31.397601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051ce87-acbb-44ea-b0d7-8115f17070db service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:31.398021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051ce87-acbb-44ea-b0d7-8115f17070db service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:31.398492 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051ce87-acbb-44ea-b0d7-8115f17070db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:31.410109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051ce87-acbb-44ea-b0d7-8115f17070db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:31.411738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051ce87-acbb-44ea-b0d7-8115f17070db service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:31.422911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 981/1960] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:31.920399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc4ce4-1321-4859-b628-28b0e205121c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:31.922422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e2fc4ce4-1321-4859-b628-28b0e205121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:31.943171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc4ce4-1321-4859-b628-28b0e205121c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:31.958725 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:31.959384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:31.959815 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:31.960092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] PATH_INFO: `/v3/projects/86e6f96f1b9147299912d00c04917d1c` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:31.961371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e6f96f1b9147299912d00c04917d1c)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:31.963495 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:32.019721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e6f96f1b9147299912d00c04917d1c', 'request_id': 'req-727b72fb-ad07-475f-8071-96338fcd2413'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:32.030143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e6f96f1b9147299912d00c04917d1c', 'request_id': 'req-727b72fb-ad07-475f-8071-96338fcd2413'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:32.037566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e6f96f1b9147299912d00c04917d1c', 'request_id': 'req-727b72fb-ad07-475f-8071-96338fcd2413'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:32.048943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] The token cache is being invalidate because project 86e6f96f1b9147299912d00c04917d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:32.049221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:32.049944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:32.051725 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 980/1961] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:31 2022] DELETE /identity/v3/projects/86e6f96f1b9147299912d00c04917d1c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:32.055896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051ce87-acbb-44ea-b0d7-8115f17070db service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:32.066195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051ce87-acbb-44ea-b0d7-8115f17070db service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:32.124387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:32.125086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:32.125363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:32.125631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] PATH_INFO: `/v3/users/4c324e0b727c43028dba060755d930c7` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:32.126775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c324e0b727c43028dba060755d930c7)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:32.128707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:32.176436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c324e0b727c43028dba060755d930c7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:32.177107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c324e0b727c43028dba060755d930c7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:32.191026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c324e0b727c43028dba060755d930c7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:32.200202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c324e0b727c43028dba060755d930c7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:32.201622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c324e0b727c43028dba060755d930c7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:32.205390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:32.231066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 982/1962] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:32 2022] DELETE /identity/v3/users/4c324e0b727c43028dba060755d930c7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:32.694303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:32.696016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:32.775282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b72fb-ad07-475f-8071-96338fcd2413 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:32.883013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a575f-a868-4eb4-8288-db023234071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:32.883910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a575f-a868-4eb4-8288-db023234071d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:32.884389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a575f-a868-4eb4-8288-db023234071d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:32.885615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a575f-a868-4eb4-8288-db023234071d admin admin] PATH_INFO: `/v3/projects/ea60f0e3e626467691763e2b56ab3825` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:32.887092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a575f-a868-4eb4-8288-db023234071d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea60f0e3e626467691763e2b56ab3825)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:32.890493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a575f-a868-4eb4-8288-db023234071d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:32.967612 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9f1a575f-a868-4eb4-8288-db023234071d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea60f0e3e626467691763e2b56ab3825', 'request_id': 'req-9f1a575f-a868-4eb4-8288-db023234071d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:32.984076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:32.992582 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9f1a575f-a868-4eb4-8288-db023234071d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea60f0e3e626467691763e2b56ab3825', 'request_id': 'req-9f1a575f-a868-4eb4-8288-db023234071d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:33.001902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9f1a575f-a868-4eb4-8288-db023234071d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea60f0e3e626467691763e2b56ab3825', 'request_id': 'req-9f1a575f-a868-4eb4-8288-db023234071d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:33.022234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9f1a575f-a868-4eb4-8288-db023234071d admin admin] The token cache is being invalidate because project ea60f0e3e626467691763e2b56ab3825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:33.022881 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9f1a575f-a868-4eb4-8288-db023234071d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:33.023936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9f1a575f-a868-4eb4-8288-db023234071d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:33.026127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 981/1963] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:32 2022] DELETE /identity/v3/projects/ea60f0e3e626467691763e2b56ab3825 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:33.030438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:33.030705 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febded31-b804-4e6d-b6bc-5e91b3562337 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:33.031000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febded31-b804-4e6d-b6bc-5e91b3562337 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:33.031283 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febded31-b804-4e6d-b6bc-5e91b3562337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:33.032265 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:33.057855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-febded31-b804-4e6d-b6bc-5e91b3562337 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:33.059163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782efad8-605b-4949-8a98-7ddd8671aa40 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:33.061460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-febded31-b804-4e6d-b6bc-5e91b3562337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:33.129368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0ee87-91bd-4210-bafa-d64b64bafd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:33.130255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0ee87-91bd-4210-bafa-d64b64bafd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:33.130866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0ee87-91bd-4210-bafa-d64b64bafd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:33.131146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0ee87-91bd-4210-bafa-d64b64bafd02 admin admin] PATH_INFO: `/v3/users/dfd4317449c24f2ea0b04f248f0b8746` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:33.132770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0ee87-91bd-4210-bafa-d64b64bafd02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd4317449c24f2ea0b04f248f0b8746)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:33.135028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0ee87-91bd-4210-bafa-d64b64bafd02 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:33.142365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 982/1964] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:33.154431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c341f-242d-4869-8dc6-4bb8930da64a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:33.154724 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c341f-242d-4869-8dc6-4bb8930da64a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:33.155005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c341f-242d-4869-8dc6-4bb8930da64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:33.177731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d08c341f-242d-4869-8dc6-4bb8930da64a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:33.179040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d08c341f-242d-4869-8dc6-4bb8930da64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:33.186967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21f0ee87-91bd-4210-bafa-d64b64bafd02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd4317449c24f2ea0b04f248f0b8746'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:33.187606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21f0ee87-91bd-4210-bafa-d64b64bafd02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd4317449c24f2ea0b04f248f0b8746'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:33.187740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 983/1965] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:33.191830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c341f-242d-4869-8dc6-4bb8930da64a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:33.198874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21f0ee87-91bd-4210-bafa-d64b64bafd02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd4317449c24f2ea0b04f248f0b8746'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:33.202271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c341f-242d-4869-8dc6-4bb8930da64a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:33.207864 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21f0ee87-91bd-4210-bafa-d64b64bafd02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd4317449c24f2ea0b04f248f0b8746'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:33.208818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21f0ee87-91bd-4210-bafa-d64b64bafd02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd4317449c24f2ea0b04f248f0b8746'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:33.219923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918c975-e438-4e28-8e03-c0bcf018061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:33.221070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918c975-e438-4e28-8e03-c0bcf018061c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:33.223179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918c975-e438-4e28-8e03-c0bcf018061c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:33.223480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918c975-e438-4e28-8e03-c0bcf018061c admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:33.224145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918c975-e438-4e28-8e03-c0bcf018061c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:33.224448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918c975-e438-4e28-8e03-c0bcf018061c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:33.230035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918c975-e438-4e28-8e03-c0bcf018061c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:33.251582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 983/1966] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:33 2022] DELETE /identity/v3/users/dfd4317449c24f2ea0b04f248f0b8746 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:33.256399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750d26c-6b31-4361-9ea2-8e15e8f65027 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:33.256682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750d26c-6b31-4361-9ea2-8e15e8f65027 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:33.257072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750d26c-6b31-4361-9ea2-8e15e8f65027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:33.259054 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 984/1967] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:24:33.263293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918c975-e438-4e28-8e03-c0bcf018061c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:33.268489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2918c975-e438-4e28-8e03-c0bcf018061c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:33.285227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918c975-e438-4e28-8e03-c0bcf018061c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:33.295609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2750d26c-6b31-4361-9ea2-8e15e8f65027 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:33.297172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2750d26c-6b31-4361-9ea2-8e15e8f65027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:33.359266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76b8de-dd7b-4c58-930f-6982a2c24662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:33.360429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76b8de-dd7b-4c58-930f-6982a2c24662 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:33.360815 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76b8de-dd7b-4c58-930f-6982a2c24662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:33.361130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76b8de-dd7b-4c58-930f-6982a2c24662 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:33.362440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76b8de-dd7b-4c58-930f-6982a2c24662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:33.365038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76b8de-dd7b-4c58-930f-6982a2c24662 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:33.390460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 984/1968] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:33.404436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750d26c-6b31-4361-9ea2-8e15e8f65027 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:33.406486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2750d26c-6b31-4361-9ea2-8e15e8f65027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:33.409203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 985/1969] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:33 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:33.410281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76b8de-dd7b-4c58-930f-6982a2c24662 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:33.413202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:33.481955 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750d26c-6b31-4361-9ea2-8e15e8f65027 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:33.489056 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:33.539250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76b8de-dd7b-4c58-930f-6982a2c24662 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:33.550875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e8016-8aba-4dd8-b36b-f4792373ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:33.552479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e8016-8aba-4dd8-b36b-f4792373ff83 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:33.553126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e8016-8aba-4dd8-b36b-f4792373ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:33.553594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e8016-8aba-4dd8-b36b-f4792373ff83 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:33.555072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e8016-8aba-4dd8-b36b-f4792373ff83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:33.559108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e8016-8aba-4dd8-b36b-f4792373ff83 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:33.566044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d74925-c8a4-4736-b813-94da81d2eff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:33.568756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d74925-c8a4-4736-b813-94da81d2eff4 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:33.568756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d74925-c8a4-4736-b813-94da81d2eff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:33.568756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d74925-c8a4-4736-b813-94da81d2eff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:33.579118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d74925-c8a4-4736-b813-94da81d2eff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:33.580653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d74925-c8a4-4736-b813-94da81d2eff4 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:33.593129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 985/1970] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:33.599231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 986/1971] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:33 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:33.603702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d74925-c8a4-4736-b813-94da81d2eff4 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:33.614475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d74925-c8a4-4736-b813-94da81d2eff4 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:33.619934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f99d0-36e9-4ff7-a924-a12cf39f5085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:33.620097 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f99d0-36e9-4ff7-a924-a12cf39f5085 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:33.621055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f99d0-36e9-4ff7-a924-a12cf39f5085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:33.621055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f99d0-36e9-4ff7-a924-a12cf39f5085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:33.621440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f99d0-36e9-4ff7-a924-a12cf39f5085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:33.623073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f99d0-36e9-4ff7-a924-a12cf39f5085 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:33.636909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 986/1972] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:33.639043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e8016-8aba-4dd8-b36b-f4792373ff83 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:33.651570 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e8016-8aba-4dd8-b36b-f4792373ff83 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:33.656592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937a1cb-bc0e-46c1-bad6-cd8e9c8aa013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:33.657257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a1cb-bc0e-46c1-bad6-cd8e9c8aa013 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:33.657539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a1cb-bc0e-46c1-bad6-cd8e9c8aa013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:33.657962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a1cb-bc0e-46c1-bad6-cd8e9c8aa013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:33.658638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937a1cb-bc0e-46c1-bad6-cd8e9c8aa013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:33.660251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937a1cb-bc0e-46c1-bad6-cd8e9c8aa013 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:33.672754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 987/1973] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:33.676843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f99d0-36e9-4ff7-a924-a12cf39f5085 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:33.688861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f99d0-36e9-4ff7-a924-a12cf39f5085 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:33.694597 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff0d7-ca05-4802-be9d-edf2d22b0f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:33.695627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff0d7-ca05-4802-be9d-edf2d22b0f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:33.696656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff0d7-ca05-4802-be9d-edf2d22b0f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:33.697017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff0d7-ca05-4802-be9d-edf2d22b0f96 admin admin] PATH_INFO: `/v3/projects/44983f25853a4d1d812da4886826959e/users/032a86954bff4a67b0ad12d8d42b87b3/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:33.715554 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ff0d7-ca05-4802-be9d-edf2d22b0f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44983f25853a4d1d812da4886826959e, user_id=032a86954bff4a67b0ad12d8d42b87b3, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:33.718539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ff0d7-ca05-4802-be9d-edf2d22b0f96 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:33.734210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 987/1974] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:33 2022] PUT /identity/v3/projects/44983f25853a4d1d812da4886826959e/users/032a86954bff4a67b0ad12d8d42b87b3/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:33.746188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97c8b7-c674-4e0a-aaca-e1f28479ae90 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:33.746678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97c8b7-c674-4e0a-aaca-e1f28479ae90 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:33.746932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97c8b7-c674-4e0a-aaca-e1f28479ae90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:33.789818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4e97c8b7-c674-4e0a-aaca-e1f28479ae90 None None] MFA Rules not processed for user `032a86954bff4a67b0ad12d8d42b87b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:33.790568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4e97c8b7-c674-4e0a-aaca-e1f28479ae90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:33.919651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 988/1975] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:33.924213 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff0d7-ca05-4802-be9d-edf2d22b0f96 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:34.012110 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97c8b7-c674-4e0a-aaca-e1f28479ae90 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:34.014153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4e97c8b7-c674-4e0a-aaca-e1f28479ae90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:34.057488 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff0d7-ca05-4802-be9d-edf2d22b0f96 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:34.063295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd2751-f805-455b-b4b5-f20993fbb7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:34.066080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd2751-f805-455b-b4b5-f20993fbb7ea admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:34.066552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd2751-f805-455b-b4b5-f20993fbb7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:34.067056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd2751-f805-455b-b4b5-f20993fbb7ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:34.079992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd2751-f805-455b-b4b5-f20993fbb7ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:34.082878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd2751-f805-455b-b4b5-f20993fbb7ea admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:34.132774 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 988/1976] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:33 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:34.132774 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd2751-f805-455b-b4b5-f20993fbb7ea admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:34.143500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97c8b7-c674-4e0a-aaca-e1f28479ae90 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:34.153805 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:34.221977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd2751-f805-455b-b4b5-f20993fbb7ea admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:34.227969 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cf2c2-14dd-4166-94c2-d0f7bb9bbf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:34.228660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cf2c2-14dd-4166-94c2-d0f7bb9bbf04 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:34.229040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cf2c2-14dd-4166-94c2-d0f7bb9bbf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:34.229748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cf2c2-14dd-4166-94c2-d0f7bb9bbf04 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:34.230094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cf2c2-14dd-4166-94c2-d0f7bb9bbf04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:34.232305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cf2c2-14dd-4166-94c2-d0f7bb9bbf04 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:34.235113 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:34.236012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:34.236477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:34.237030 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] PATH_INFO: `/v3/projects/4778793e82eb4d6aab304a738ca4bc78` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:34.238377 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4778793e82eb4d6aab304a738ca4bc78)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:34.240655 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:34.245318 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:34.262952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 989/1977] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:34 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:34.266739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cf2c2-14dd-4166-94c2-d0f7bb9bbf04 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:34.280769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cf2c2-14dd-4166-94c2-d0f7bb9bbf04 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:34.289321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94d3d0-4e60-4ad5-934d-b3cf38a88046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:34.289321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94d3d0-4e60-4ad5-934d-b3cf38a88046 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:34.304888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94d3d0-4e60-4ad5-934d-b3cf38a88046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:34.304888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94d3d0-4e60-4ad5-934d-b3cf38a88046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:34.304888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94d3d0-4e60-4ad5-934d-b3cf38a88046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:34.304888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94d3d0-4e60-4ad5-934d-b3cf38a88046 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:34.315196 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 990/1978] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:34.316526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94d3d0-4e60-4ad5-934d-b3cf38a88046 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:34.332112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94d3d0-4e60-4ad5-934d-b3cf38a88046 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:34.344245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4778793e82eb4d6aab304a738ca4bc78', 'request_id': 'req-6c2a3a21-8c95-40a4-8d42-076d95deec2d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:34.355677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4778793e82eb4d6aab304a738ca4bc78', 'request_id': 'req-6c2a3a21-8c95-40a4-8d42-076d95deec2d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:34.366344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4778793e82eb4d6aab304a738ca4bc78', 'request_id': 'req-6c2a3a21-8c95-40a4-8d42-076d95deec2d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:34.381997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] The token cache is being invalidate because project 4778793e82eb4d6aab304a738ca4bc78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:34.382291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:34.382946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:34.384847 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 989/1979] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:34 2022] DELETE /identity/v3/projects/4778793e82eb4d6aab304a738ca4bc78 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:34.393699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:34.397208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:34.417248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941be15b-21ad-4201-afb6-547cbe588237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:34.418001 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941be15b-21ad-4201-afb6-547cbe588237 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:34.418311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941be15b-21ad-4201-afb6-547cbe588237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:34.418988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941be15b-21ad-4201-afb6-547cbe588237 admin admin] PATH_INFO: `/v3/projects/f95a042d351d4b769b86c6178cd20024/users/9fb0650fd682496fb94b8e9ecf5c94a4/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:34.439205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941be15b-21ad-4201-afb6-547cbe588237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95a042d351d4b769b86c6178cd20024, user_id=9fb0650fd682496fb94b8e9ecf5c94a4, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:34.446908 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941be15b-21ad-4201-afb6-547cbe588237 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:34.466859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 991/1980] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:34 2022] PUT /identity/v3/projects/f95a042d351d4b769b86c6178cd20024/users/9fb0650fd682496fb94b8e9ecf5c94a4/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:34.470591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941be15b-21ad-4201-afb6-547cbe588237 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:34.476599 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-941be15b-21ad-4201-afb6-547cbe588237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:34.487676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a3a21-8c95-40a4-8d42-076d95deec2d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:34.582639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:34.583573 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:34.584070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:34.584444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] PATH_INFO: `/v3/users/a0e4f18b5cd44cfb9bff92db3162f0ed` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:34.585902 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e4f18b5cd44cfb9bff92db3162f0ed)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:34.588442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:34.588596 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941be15b-21ad-4201-afb6-547cbe588237 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:34.594362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d4a9e-b074-4ada-92cd-4e23f4b6da33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:34.595008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d4a9e-b074-4ada-92cd-4e23f4b6da33 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:34.595298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d4a9e-b074-4ada-92cd-4e23f4b6da33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:34.619057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d4a9e-b074-4ada-92cd-4e23f4b6da33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:34.619817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d4a9e-b074-4ada-92cd-4e23f4b6da33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:34.621779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d4a9e-b074-4ada-92cd-4e23f4b6da33 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:34.637373 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 992/1981] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:34.641539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d4a9e-b074-4ada-92cd-4e23f4b6da33 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:34.651591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:34.654458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d4a9e-b074-4ada-92cd-4e23f4b6da33 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:34.658173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e4f18b5cd44cfb9bff92db3162f0ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:34.662824 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfdb88-f3bf-449e-9f40-563120ee6272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:34.664015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfdb88-f3bf-449e-9f40-563120ee6272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:34.664306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfdb88-f3bf-449e-9f40-563120ee6272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:34.665297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfdb88-f3bf-449e-9f40-563120ee6272 admin admin] PATH_INFO: `/v3/projects/f95a042d351d4b769b86c6178cd20024/users/9fb0650fd682496fb94b8e9ecf5c94a4/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:34.674504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfdb88-f3bf-449e-9f40-563120ee6272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95a042d351d4b769b86c6178cd20024, user_id=9fb0650fd682496fb94b8e9ecf5c94a4, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:34.677340 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfdb88-f3bf-449e-9f40-563120ee6272 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:34.678406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e4f18b5cd44cfb9bff92db3162f0ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:34.679184 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e4f18b5cd44cfb9bff92db3162f0ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:34.680888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:34.690624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e4f18b5cd44cfb9bff92db3162f0ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:34.699076 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 993/1982] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:34 2022] PUT /identity/v3/projects/f95a042d351d4b769b86c6178cd20024/users/9fb0650fd682496fb94b8e9ecf5c94a4/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:34.700949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e4f18b5cd44cfb9bff92db3162f0ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:34.710048 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d16dd-515d-4c41-ae9e-89b135cdb605 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:34.710385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d16dd-515d-4c41-ae9e-89b135cdb605 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:34.710662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d16dd-515d-4c41-ae9e-89b135cdb605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:34.715324 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 990/1983] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:34 2022] DELETE /identity/v3/users/a0e4f18b5cd44cfb9bff92db3162f0ed => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:34.789023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7d9d16dd-515d-4c41-ae9e-89b135cdb605 None None] MFA Rules not processed for user `9fb0650fd682496fb94b8e9ecf5c94a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:34.793591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7d9d16dd-515d-4c41-ae9e-89b135cdb605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:34.917233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 994/1984] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:34.930340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:34.933702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:35.017721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819b259-7811-454a-b107-829aed5569cb admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:35.024894 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b542adb-5d05-442f-b906-f972445cce9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:35.024894 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b542adb-5d05-442f-b906-f972445cce9f service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:35.024894 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b542adb-5d05-442f-b906-f972445cce9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:35.024894 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b542adb-5d05-442f-b906-f972445cce9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:35.036452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b542adb-5d05-442f-b906-f972445cce9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:35.037985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b542adb-5d05-442f-b906-f972445cce9f service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:35.050291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 991/1985] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:35.422430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d16dd-515d-4c41-ae9e-89b135cdb605 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:35.423958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7d9d16dd-515d-4c41-ae9e-89b135cdb605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:35.456503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b542adb-5d05-442f-b906-f972445cce9f service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:35.467383 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b542adb-5d05-442f-b906-f972445cce9f service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:35.472767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705497a-f6b3-4fa2-8937-70e9653949b8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fb0650fd682496fb94b8e9ecf5c94a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f95a042d351d4b769b86c6178cd20024', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:35.473720 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705497a-f6b3-4fa2-8937-70e9653949b8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:35.474095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705497a-f6b3-4fa2-8937-70e9653949b8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:35.474446 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705497a-f6b3-4fa2-8937-70e9653949b8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:35.475188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705497a-f6b3-4fa2-8937-70e9653949b8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:35.475564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705497a-f6b3-4fa2-8937-70e9653949b8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:35.478502 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705497a-f6b3-4fa2-8937-70e9653949b8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:35.492766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 992/1986] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:24:35.496294 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705497a-f6b3-4fa2-8937-70e9653949b8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:35.506575 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705497a-f6b3-4fa2-8937-70e9653949b8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:35.511259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acde11-6887-43b0-8c05-11bb3aa3a28a tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fb0650fd682496fb94b8e9ecf5c94a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f95a042d351d4b769b86c6178cd20024', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:35.511945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acde11-6887-43b0-8c05-11bb3aa3a28a tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:35.512234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acde11-6887-43b0-8c05-11bb3aa3a28a tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:35.512524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acde11-6887-43b0-8c05-11bb3aa3a28a tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:35.513229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acde11-6887-43b0-8c05-11bb3aa3a28a tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:35.516175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acde11-6887-43b0-8c05-11bb3aa3a28a tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:35.535157 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d16dd-515d-4c41-ae9e-89b135cdb605 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:35.540658 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:35.541330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:35.541606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:35.541876 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] PATH_INFO: `/v3/projects/e789b4eb17944ed7aad1891a5fa58140` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:35.543059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e789b4eb17944ed7aad1891a5fa58140)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:35.545028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:35.549779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 993/1987] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:35 2022] POST /identity/v3/projects => generated 355 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:35.550899 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acde11-6887-43b0-8c05-11bb3aa3a28a tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:35.605051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e789b4eb17944ed7aad1891a5fa58140', 'request_id': 'req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.615423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e789b4eb17944ed7aad1891a5fa58140', 'request_id': 'req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.624766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e789b4eb17944ed7aad1891a5fa58140', 'request_id': 'req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.631961 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acde11-6887-43b0-8c05-11bb3aa3a28a tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:35.641935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] The token cache is being invalidate because project e789b4eb17944ed7aad1891a5fa58140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:35.642239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.643191 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.645056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 995/1988] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:35 2022] DELETE /identity/v3/projects/e789b4eb17944ed7aad1891a5fa58140 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:35.653181 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:35.654648 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:35.674531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:35.678962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:35.723467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c317-470f-4495-9a5f-5f05dd994ee8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fb0650fd682496fb94b8e9ecf5c94a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f95a042d351d4b769b86c6178cd20024', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:35.724118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c317-470f-4495-9a5f-5f05dd994ee8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:35.724478 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c317-470f-4495-9a5f-5f05dd994ee8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:35.724675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c317-470f-4495-9a5f-5f05dd994ee8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:35.725379 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5c317-470f-4495-9a5f-5f05dd994ee8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:35.725689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5c317-470f-4495-9a5f-5f05dd994ee8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:35.727301 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5c317-470f-4495-9a5f-5f05dd994ee8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:35.739690 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a37f48-a4f0-49fe-a50c-9d709557e9d4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:35.744846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 994/1989] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:24:35.749328 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:35.750004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:35.750279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:35.750556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] PATH_INFO: `/v3/users/7f7d363b5fcf4ccbbb96d08ac2d1fd0f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:35.751801 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7d363b5fcf4ccbbb96d08ac2d1fd0f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:35.753957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:35.788528 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c317-470f-4495-9a5f-5f05dd994ee8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:35.790840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-72d5c317-470f-4495-9a5f-5f05dd994ee8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:35.803747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c317-470f-4495-9a5f-5f05dd994ee8 tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:35.810186 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fb0650fd682496fb94b8e9ecf5c94a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f95a042d351d4b769b86c6178cd20024', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:35.810968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:35.811256 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:35.811535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] PATH_INFO: `/v3/projects/8f11a2c487a746fea3874e83a44e1ae4` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:35.812177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7d363b5fcf4ccbbb96d08ac2d1fd0f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.812805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8f11a2c487a746fea3874e83a44e1ae4)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:35.812913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7d363b5fcf4ccbbb96d08ac2d1fd0f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.815062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:35.821619 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7d363b5fcf4ccbbb96d08ac2d1fd0f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.829975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7d363b5fcf4ccbbb96d08ac2d1fd0f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.830668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7d363b5fcf4ccbbb96d08ac2d1fd0f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.850635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 996/1990] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:35 2022] DELETE /identity/v3/users/7f7d363b5fcf4ccbbb96d08ac2d1fd0f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:35.893361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f11a2c487a746fea3874e83a44e1ae4', 'request_id': 'req-9024ee06-be6b-4c39-b45e-668c40c9d1af'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.907389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f11a2c487a746fea3874e83a44e1ae4', 'request_id': 'req-9024ee06-be6b-4c39-b45e-668c40c9d1af'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.929821 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f11a2c487a746fea3874e83a44e1ae4', 'request_id': 'req-9024ee06-be6b-4c39-b45e-668c40c9d1af'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.946092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] The token cache is being invalidate because project 8f11a2c487a746fea3874e83a44e1ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:35.946892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.947519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:35.950464 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 995/1991] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:35 2022] DELETE /identity/v3/projects/8f11a2c487a746fea3874e83a44e1ae4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:36.229491 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:36.231457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:36.231820 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:36.233672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:36.338251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024ee06-be6b-4c39-b45e-668c40c9d1af tempest-VolumeQuotaClassesTest-1069337742 tempest-VolumeQuotaClassesTest-1069337742-project-admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:36.343664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50424a8-4c58-4be7-94fe-87a49da54008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:36.344356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23058794-f2a2-472e-b13e-3c19dbf75025 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:36.344492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50424a8-4c58-4be7-94fe-87a49da54008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.344857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50424a8-4c58-4be7-94fe-87a49da54008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.345425 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50424a8-4c58-4be7-94fe-87a49da54008 admin admin] PATH_INFO: `/v3/projects/8bcf33e7142c4340b21b928c68c8cb32` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:36.346587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50424a8-4c58-4be7-94fe-87a49da54008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bcf33e7142c4340b21b928c68c8cb32)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:36.349000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50424a8-4c58-4be7-94fe-87a49da54008 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:36.349473 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045894a-2a73-447e-bf76-7595f0c49224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:36.350122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045894a-2a73-447e-bf76-7595f0c49224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.350404 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045894a-2a73-447e-bf76-7595f0c49224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.350679 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045894a-2a73-447e-bf76-7595f0c49224 admin admin] PATH_INFO: `/v3/users/032a86954bff4a67b0ad12d8d42b87b3` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:36.351946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045894a-2a73-447e-bf76-7595f0c49224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=032a86954bff4a67b0ad12d8d42b87b3)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:36.353919 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045894a-2a73-447e-bf76-7595f0c49224 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:36.394737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:36.403324 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d50424a8-4c58-4be7-94fe-87a49da54008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bcf33e7142c4340b21b928c68c8cb32', 'request_id': 'req-d50424a8-4c58-4be7-94fe-87a49da54008'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:36.406376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:36.413209 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8045894a-2a73-447e-bf76-7595f0c49224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032a86954bff4a67b0ad12d8d42b87b3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:36.417319 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d50424a8-4c58-4be7-94fe-87a49da54008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bcf33e7142c4340b21b928c68c8cb32', 'request_id': 'req-d50424a8-4c58-4be7-94fe-87a49da54008'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:36.417566 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8045894a-2a73-447e-bf76-7595f0c49224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032a86954bff4a67b0ad12d8d42b87b3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:36.423515 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8045894a-2a73-447e-bf76-7595f0c49224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032a86954bff4a67b0ad12d8d42b87b3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:36.425821 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d50424a8-4c58-4be7-94fe-87a49da54008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bcf33e7142c4340b21b928c68c8cb32', 'request_id': 'req-d50424a8-4c58-4be7-94fe-87a49da54008'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:36.431772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8045894a-2a73-447e-bf76-7595f0c49224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032a86954bff4a67b0ad12d8d42b87b3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:36.432536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8045894a-2a73-447e-bf76-7595f0c49224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032a86954bff4a67b0ad12d8d42b87b3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:36.438028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d50424a8-4c58-4be7-94fe-87a49da54008 admin admin] The token cache is being invalidate because project 8bcf33e7142c4340b21b928c68c8cb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:36.438471 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d50424a8-4c58-4be7-94fe-87a49da54008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:36.439141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d50424a8-4c58-4be7-94fe-87a49da54008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:36.440690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 996/1992] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:36 2022] DELETE /identity/v3/projects/8bcf33e7142c4340b21b928c68c8cb32 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:36.447231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1d6df-924b-4409-9919-0d3cb31f850e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.447647 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1d6df-924b-4409-9919-0d3cb31f850e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.447996 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1d6df-924b-4409-9919-0d3cb31f850e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:36.457323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 997/1993] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:36 2022] DELETE /identity/v3/users/032a86954bff4a67b0ad12d8d42b87b3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:36.461530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a979ba-bab3-4ead-b690-64e46fe9133b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.461830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a979ba-bab3-4ead-b690-64e46fe9133b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.462092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a979ba-bab3-4ead-b690-64e46fe9133b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:36.472149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0dd1d6df-924b-4409-9919-0d3cb31f850e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:36.472609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0dd1d6df-924b-4409-9919-0d3cb31f850e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:36.481841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e9a979ba-bab3-4ead-b690-64e46fe9133b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:36.483492 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e9a979ba-bab3-4ead-b690-64e46fe9133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:36.556903 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 997/1994] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:36.562571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f5148-096f-4067-9ddb-5749f4488e0e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.562863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f5148-096f-4067-9ddb-5749f4488e0e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.563143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f5148-096f-4067-9ddb-5749f4488e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:36.564848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 998/1995] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:36.572326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a979ba-bab3-4ead-b690-64e46fe9133b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:36.573682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e9a979ba-bab3-4ead-b690-64e46fe9133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:36.585312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-be0f5148-096f-4067-9ddb-5749f4488e0e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:36.586551 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-be0f5148-096f-4067-9ddb-5749f4488e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:36.594845 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 998/1996] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:36.598974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f5148-096f-4067-9ddb-5749f4488e0e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:36.609606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f5148-096f-4067-9ddb-5749f4488e0e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:36.615538 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f290c39-79c6-4501-91f8-e11f3920eb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:36.616298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f290c39-79c6-4501-91f8-e11f3920eb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.616581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f290c39-79c6-4501-91f8-e11f3920eb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.616890 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f290c39-79c6-4501-91f8-e11f3920eb75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:36.617561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f290c39-79c6-4501-91f8-e11f3920eb75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:36.618009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f290c39-79c6-4501-91f8-e11f3920eb75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:36.619837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f290c39-79c6-4501-91f8-e11f3920eb75 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:36.635527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 999/1997] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:24:36.637709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f290c39-79c6-4501-91f8-e11f3920eb75 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:36.649709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a979ba-bab3-4ead-b690-64e46fe9133b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:36.650786 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f290c39-79c6-4501-91f8-e11f3920eb75 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:36.654763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a500c9-4d63-42e5-a383-1fdb7dc61ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:36.655445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a500c9-4d63-42e5-a383-1fdb7dc61ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.655679 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a500c9-4d63-42e5-a383-1fdb7dc61ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.655949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a500c9-4d63-42e5-a383-1fdb7dc61ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:36.657406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8b3a1-e7cd-4dcb-be4c-2bbc4522c179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:36.658019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8b3a1-e7cd-4dcb-be4c-2bbc4522c179 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.658308 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8b3a1-e7cd-4dcb-be4c-2bbc4522c179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.658758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8b3a1-e7cd-4dcb-be4c-2bbc4522c179 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:36.659410 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8b3a1-e7cd-4dcb-be4c-2bbc4522c179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:36.661382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8b3a1-e7cd-4dcb-be4c-2bbc4522c179 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:36.666226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a500c9-4d63-42e5-a383-1fdb7dc61ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:36.668780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a500c9-4d63-42e5-a383-1fdb7dc61ec4 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:36.680983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 999/1998] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:24:36.694641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1000/1999] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:36 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:36.698980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a500c9-4d63-42e5-a383-1fdb7dc61ec4 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:36.709520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a500c9-4d63-42e5-a383-1fdb7dc61ec4 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:36.776693 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:36.794443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc147589-152c-4641-84f9-f35d348bfcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:36.795037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc147589-152c-4641-84f9-f35d348bfcea admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.795320 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc147589-152c-4641-84f9-f35d348bfcea admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.795595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc147589-152c-4641-84f9-f35d348bfcea admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:36.796294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc147589-152c-4641-84f9-f35d348bfcea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:36.798249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc147589-152c-4641-84f9-f35d348bfcea admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:36.823632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1000/2000] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:36 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:36.827963 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8b3a1-e7cd-4dcb-be4c-2bbc4522c179 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:36.838746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8b3a1-e7cd-4dcb-be4c-2bbc4522c179 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:36.843655 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7c93b-9f6f-44cf-b441-9f7013f9eb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:36.844293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7c93b-9f6f-44cf-b441-9f7013f9eb14 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.844548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7c93b-9f6f-44cf-b441-9f7013f9eb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.844867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7c93b-9f6f-44cf-b441-9f7013f9eb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:36.845529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7c93b-9f6f-44cf-b441-9f7013f9eb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:36.847220 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7c93b-9f6f-44cf-b441-9f7013f9eb14 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:36.873354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1001/2001] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:36.878020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc147589-152c-4641-84f9-f35d348bfcea admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:36.888138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc147589-152c-4641-84f9-f35d348bfcea admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:36.893640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42466e9-e806-46d1-b2e2-630efec8a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:36.894504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42466e9-e806-46d1-b2e2-630efec8a014 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.894766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42466e9-e806-46d1-b2e2-630efec8a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.895044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42466e9-e806-46d1-b2e2-630efec8a014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:36.895776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42466e9-e806-46d1-b2e2-630efec8a014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:36.897613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42466e9-e806-46d1-b2e2-630efec8a014 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:36.911994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1001/2002] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:36.913257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7c93b-9f6f-44cf-b441-9f7013f9eb14 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:36.924210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7c93b-9f6f-44cf-b441-9f7013f9eb14 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:36.929138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadded8-5474-47f6-8d51-759d784bcd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:36.929852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadded8-5474-47f6-8d51-759d784bcd8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.930125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadded8-5474-47f6-8d51-759d784bcd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.930528 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadded8-5474-47f6-8d51-759d784bcd8f admin admin] PATH_INFO: `/v3/projects/bb941c2af4de42f195ef9a9337a520c4/users/d2bf0ac23ce049608412dc53cba9e1d2/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:36.949828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadded8-5474-47f6-8d51-759d784bcd8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb941c2af4de42f195ef9a9337a520c4, user_id=d2bf0ac23ce049608412dc53cba9e1d2, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:36.952607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadded8-5474-47f6-8d51-759d784bcd8f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:36.971836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1002/2003] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:36 2022] PUT /identity/v3/projects/bb941c2af4de42f195ef9a9337a520c4/users/d2bf0ac23ce049608412dc53cba9e1d2/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:36.977613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ab925-08ee-41a6-b2db-03c530f62860 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:36.977967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ab925-08ee-41a6-b2db-03c530f62860 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:36.978247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ab925-08ee-41a6-b2db-03c530f62860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:37.005478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-229ab925-08ee-41a6-b2db-03c530f62860 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:37.006686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-229ab925-08ee-41a6-b2db-03c530f62860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:37.015676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadded8-5474-47f6-8d51-759d784bcd8f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:37.017865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dfadded8-5474-47f6-8d51-759d784bcd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:37.118411 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1002/2004] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:37.131497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ab925-08ee-41a6-b2db-03c530f62860 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:37.135251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadded8-5474-47f6-8d51-759d784bcd8f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:37.161687 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:37.163312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:37.163605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:37.163888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] PATH_INFO: `/v3/projects/44983f25853a4d1d812da4886826959e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:37.165114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=44983f25853a4d1d812da4886826959e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:37.167340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:37.174694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:37.230605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ab925-08ee-41a6-b2db-03c530f62860 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:37.274046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44983f25853a4d1d812da4886826959e', 'request_id': 'req-9188c58c-bd34-434f-999d-a79006a425cd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:37.289598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44983f25853a4d1d812da4886826959e', 'request_id': 'req-9188c58c-bd34-434f-999d-a79006a425cd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:37.297655 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44983f25853a4d1d812da4886826959e', 'request_id': 'req-9188c58c-bd34-434f-999d-a79006a425cd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:37.306525 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce0cdd-3f60-4f5d-b180-13ff1e73d8d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:37.307264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce0cdd-3f60-4f5d-b180-13ff1e73d8d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:37.307544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce0cdd-3f60-4f5d-b180-13ff1e73d8d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:37.307810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce0cdd-3f60-4f5d-b180-13ff1e73d8d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:37.310915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] The token cache is being invalidate because project 44983f25853a4d1d812da4886826959e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:37.311355 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:37.312159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:37.313780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f4ce0cdd-3f60-4f5d-b180-13ff1e73d8d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:37.314233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1003/2005] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:37 2022] DELETE /identity/v3/projects/44983f25853a4d1d812da4886826959e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:37.318809 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:37.320508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:37.399530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:37.456527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188c58c-bd34-434f-999d-a79006a425cd admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:37.462482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2f60-8eff-4f6e-a4f5-77ede0f8564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:37.463947 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2f60-8eff-4f6e-a4f5-77ede0f8564a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:37.463947 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2f60-8eff-4f6e-a4f5-77ede0f8564a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:37.464260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2f60-8eff-4f6e-a4f5-77ede0f8564a admin admin] PATH_INFO: `/v3/users/9fb0650fd682496fb94b8e9ecf5c94a4` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:37.465929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2f60-8eff-4f6e-a4f5-77ede0f8564a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb0650fd682496fb94b8e9ecf5c94a4)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:37.467351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce0cdd-3f60-4f5d-b180-13ff1e73d8d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:37.468112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2f60-8eff-4f6e-a4f5-77ede0f8564a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:37.469816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce0cdd-3f60-4f5d-b180-13ff1e73d8d4 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:37.482153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1003/2006] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:37.559094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dbeb2f60-8eff-4f6e-a4f5-77ede0f8564a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb0650fd682496fb94b8e9ecf5c94a4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:37.586376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dbeb2f60-8eff-4f6e-a4f5-77ede0f8564a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb0650fd682496fb94b8e9ecf5c94a4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:37.587238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dbeb2f60-8eff-4f6e-a4f5-77ede0f8564a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb0650fd682496fb94b8e9ecf5c94a4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:37.598869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dbeb2f60-8eff-4f6e-a4f5-77ede0f8564a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb0650fd682496fb94b8e9ecf5c94a4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:37.609622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dbeb2f60-8eff-4f6e-a4f5-77ede0f8564a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb0650fd682496fb94b8e9ecf5c94a4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:37.622878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1004/2007] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:37 2022] DELETE /identity/v3/users/9fb0650fd682496fb94b8e9ecf5c94a4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:38.067246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce0cdd-3f60-4f5d-b180-13ff1e73d8d4 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.080678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce0cdd-3f60-4f5d-b180-13ff1e73d8d4 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.145661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bcdbe-17dd-4222-b459-abf89e1281b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.146305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bcdbe-17dd-4222-b459-abf89e1281b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.146588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bcdbe-17dd-4222-b459-abf89e1281b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.146863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bcdbe-17dd-4222-b459-abf89e1281b7 admin admin] PATH_INFO: `/v3/projects/f95a042d351d4b769b86c6178cd20024` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.147989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79bcdbe-17dd-4222-b459-abf89e1281b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95a042d351d4b769b86c6178cd20024)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.149965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79bcdbe-17dd-4222-b459-abf89e1281b7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.197908 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b79bcdbe-17dd-4222-b459-abf89e1281b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95a042d351d4b769b86c6178cd20024', 'request_id': 'req-b79bcdbe-17dd-4222-b459-abf89e1281b7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:38.203630 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b79bcdbe-17dd-4222-b459-abf89e1281b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95a042d351d4b769b86c6178cd20024', 'request_id': 'req-b79bcdbe-17dd-4222-b459-abf89e1281b7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:38.211998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b79bcdbe-17dd-4222-b459-abf89e1281b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95a042d351d4b769b86c6178cd20024', 'request_id': 'req-b79bcdbe-17dd-4222-b459-abf89e1281b7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:38.225598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b79bcdbe-17dd-4222-b459-abf89e1281b7 admin admin] The token cache is being invalidate because project f95a042d351d4b769b86c6178cd20024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:38.225893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b79bcdbe-17dd-4222-b459-abf89e1281b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:38.227498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b79bcdbe-17dd-4222-b459-abf89e1281b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:38.229079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1004/2008] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:38 2022] DELETE /identity/v3/projects/f95a042d351d4b769b86c6178cd20024 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:38.233999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8656e-bca6-4c32-b94c-2e819cf756fe None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.234526 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8656e-bca6-4c32-b94c-2e819cf756fe None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.234674 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8656e-bca6-4c32-b94c-2e819cf756fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.257048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-87e8656e-bca6-4c32-b94c-2e819cf756fe None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:38.258373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-87e8656e-bca6-4c32-b94c-2e819cf756fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:38.268358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:38.340290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35c0b6-4ec9-425a-a0bc-483db575024f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.340700 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35c0b6-4ec9-425a-a0bc-483db575024f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.341007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35c0b6-4ec9-425a-a0bc-483db575024f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.347068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1005/2009] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:38.354613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df846c-c4d2-45aa-83b3-7791423a5161 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.354992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df846c-c4d2-45aa-83b3-7791423a5161 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.355273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df846c-c4d2-45aa-83b3-7791423a5161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.372371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-df35c0b6-4ec9-425a-a0bc-483db575024f None None] MFA Rules not processed for user `d2bf0ac23ce049608412dc53cba9e1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:38.373672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-df35c0b6-4ec9-425a-a0bc-483db575024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:38.376838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-98df846c-c4d2-45aa-83b3-7791423a5161 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:38.378056 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-98df846c-c4d2-45aa-83b3-7791423a5161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:38.388451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1006/2010] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:38.391722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df846c-c4d2-45aa-83b3-7791423a5161 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.403948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df846c-c4d2-45aa-83b3-7791423a5161 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.409138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f3e60-11f7-4de7-978b-11edc22e283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.410667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f3e60-11f7-4de7-978b-11edc22e283c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.410969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f3e60-11f7-4de7-978b-11edc22e283c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.411249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f3e60-11f7-4de7-978b-11edc22e283c admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.411917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f3e60-11f7-4de7-978b-11edc22e283c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:38.413123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f3e60-11f7-4de7-978b-11edc22e283c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.415109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f3e60-11f7-4de7-978b-11edc22e283c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.449033 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:38.454415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1007/2011] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:24:38.455800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f3e60-11f7-4de7-978b-11edc22e283c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.467218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1005/2012] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:38.467776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35c0b6-4ec9-425a-a0bc-483db575024f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.470337 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-df35c0b6-4ec9-425a-a0bc-483db575024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:38.475393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f3e60-11f7-4de7-978b-11edc22e283c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.480724 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471efdff-9c07-418f-b315-cc24f92980ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.481356 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471efdff-9c07-418f-b315-cc24f92980ed admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.481711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471efdff-9c07-418f-b315-cc24f92980ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.481907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471efdff-9c07-418f-b315-cc24f92980ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.482676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471efdff-9c07-418f-b315-cc24f92980ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.484577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471efdff-9c07-418f-b315-cc24f92980ed admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.504367 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35c0b6-4ec9-425a-a0bc-483db575024f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.509280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc52a84-7dc2-43ed-81bf-044b5b14551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.509975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc52a84-7dc2-43ed-81bf-044b5b14551c admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.510317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc52a84-7dc2-43ed-81bf-044b5b14551c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.510649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc52a84-7dc2-43ed-81bf-044b5b14551c admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.511563 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc52a84-7dc2-43ed-81bf-044b5b14551c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.514600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc52a84-7dc2-43ed-81bf-044b5b14551c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.538726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1008/2013] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:38 2022] POST /identity/v3/projects => generated 365 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:38.542763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471efdff-9c07-418f-b315-cc24f92980ed admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.557836 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1006/2014] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:38 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:38.559187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc52a84-7dc2-43ed-81bf-044b5b14551c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.621478 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471efdff-9c07-418f-b315-cc24f92980ed admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.641851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc52a84-7dc2-43ed-81bf-044b5b14551c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.646874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d727ed-bb4b-4ea2-8c16-2fcf68a4ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.647526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d727ed-bb4b-4ea2-8c16-2fcf68a4ddcb admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.647874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d727ed-bb4b-4ea2-8c16-2fcf68a4ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.648218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d727ed-bb4b-4ea2-8c16-2fcf68a4ddcb admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.649026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d727ed-bb4b-4ea2-8c16-2fcf68a4ddcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.651149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d727ed-bb4b-4ea2-8c16-2fcf68a4ddcb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.681799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1007/2015] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:38 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:38.686020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d727ed-bb4b-4ea2-8c16-2fcf68a4ddcb admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.690403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe115a-72c5-4d50-affb-4e5f8c2c4732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.691032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe115a-72c5-4d50-affb-4e5f8c2c4732 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.691312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe115a-72c5-4d50-affb-4e5f8c2c4732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.691587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe115a-72c5-4d50-affb-4e5f8c2c4732 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.692233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe115a-72c5-4d50-affb-4e5f8c2c4732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.694193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe115a-72c5-4d50-affb-4e5f8c2c4732 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.695839 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d727ed-bb4b-4ea2-8c16-2fcf68a4ddcb admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.700417 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c21b6-ad34-401c-abbe-33efcacd48ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.701051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c21b6-ad34-401c-abbe-33efcacd48ff admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.701334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c21b6-ad34-401c-abbe-33efcacd48ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.701614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c21b6-ad34-401c-abbe-33efcacd48ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.702316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c21b6-ad34-401c-abbe-33efcacd48ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.703916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c21b6-ad34-401c-abbe-33efcacd48ff admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.715486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1008/2016] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:38.720589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1009/2017] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:38 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:38.721734 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c21b6-ad34-401c-abbe-33efcacd48ff admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.721869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe115a-72c5-4d50-affb-4e5f8c2c4732 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.731973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe115a-72c5-4d50-affb-4e5f8c2c4732 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.732707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c21b6-ad34-401c-abbe-33efcacd48ff admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.738431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ba8c9-4156-4177-bb82-f47f6b62f169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.739160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ba8c9-4156-4177-bb82-f47f6b62f169 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.739384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ba8c9-4156-4177-bb82-f47f6b62f169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.739637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ba8c9-4156-4177-bb82-f47f6b62f169 admin admin] PATH_INFO: `/v3/projects/1fe31235675146b2b676ab03869eb7a8/users/e89b82bf8bdd46bb9af678b8e964cb12/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.740884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862f0bd-cc20-488b-a7f8-702689ff0e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.741545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f0bd-cc20-488b-a7f8-702689ff0e3c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.741832 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f0bd-cc20-488b-a7f8-702689ff0e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.742090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f0bd-cc20-488b-a7f8-702689ff0e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.742753 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862f0bd-cc20-488b-a7f8-702689ff0e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.744371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862f0bd-cc20-488b-a7f8-702689ff0e3c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.747403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:38.757715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ba8c9-4156-4177-bb82-f47f6b62f169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe31235675146b2b676ab03869eb7a8, user_id=e89b82bf8bdd46bb9af678b8e964cb12, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.760510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1010/2018] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:38.762391 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ba8c9-4156-4177-bb82-f47f6b62f169 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.766824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862f0bd-cc20-488b-a7f8-702689ff0e3c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.780607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1009/2019] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:38 2022] PUT /identity/v3/projects/1fe31235675146b2b676ab03869eb7a8/users/e89b82bf8bdd46bb9af678b8e964cb12/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:38.784143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862f0bd-cc20-488b-a7f8-702689ff0e3c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.785050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ba8c9-4156-4177-bb82-f47f6b62f169 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.856208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4c4c5-23da-4ecf-8d62-d9c665715ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.856847 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4c4c5-23da-4ecf-8d62-d9c665715ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.857164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4c4c5-23da-4ecf-8d62-d9c665715ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.857420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4c4c5-23da-4ecf-8d62-d9c665715ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.858110 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4c4c5-23da-4ecf-8d62-d9c665715ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.859493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ba8c9-4156-4177-bb82-f47f6b62f169 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.859758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4c4c5-23da-4ecf-8d62-d9c665715ac5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.870484 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1011/2020] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:38.871956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0338dd-478f-47d9-9167-c377600c4e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.872858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0338dd-478f-47d9-9167-c377600c4e31 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.873225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0338dd-478f-47d9-9167-c377600c4e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.873509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0338dd-478f-47d9-9167-c377600c4e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.874277 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0338dd-478f-47d9-9167-c377600c4e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.874746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4c4c5-23da-4ecf-8d62-d9c665715ac5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.875929 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0338dd-478f-47d9-9167-c377600c4e31 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.884835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4c4c5-23da-4ecf-8d62-d9c665715ac5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.888925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1010/2021] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:38.891477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0338dd-478f-47d9-9167-c377600c4e31 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:38.892199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff0c27-8843-440c-9b95-d531b70382d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.893008 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff0c27-8843-440c-9b95-d531b70382d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.893383 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff0c27-8843-440c-9b95-d531b70382d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.893827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff0c27-8843-440c-9b95-d531b70382d5 admin admin] PATH_INFO: `/v3/projects/d7ecedd9cb7942c88c305b61d7a0ddfc/users/7f2873575ac54efc896211285cf3a575/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.908754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0338dd-478f-47d9-9167-c377600c4e31 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:38.917174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff0c27-8843-440c-9b95-d531b70382d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ecedd9cb7942c88c305b61d7a0ddfc, user_id=7f2873575ac54efc896211285cf3a575, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.917435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621e198-19fc-4a21-b164-7f9814f12dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:38.917435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621e198-19fc-4a21-b164-7f9814f12dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.917435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621e198-19fc-4a21-b164-7f9814f12dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.917435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621e198-19fc-4a21-b164-7f9814f12dc4 admin admin] PATH_INFO: `/v3/projects/1fe31235675146b2b676ab03869eb7a8/users/e89b82bf8bdd46bb9af678b8e964cb12/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.917742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff0c27-8843-440c-9b95-d531b70382d5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.918977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621e198-19fc-4a21-b164-7f9814f12dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe31235675146b2b676ab03869eb7a8, user_id=e89b82bf8bdd46bb9af678b8e964cb12, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:38.921942 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621e198-19fc-4a21-b164-7f9814f12dc4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:38.934195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1011/2022] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:38 2022] PUT /identity/v3/projects/1fe31235675146b2b676ab03869eb7a8/users/e89b82bf8bdd46bb9af678b8e964cb12/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:38.934402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1012/2023] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:38 2022] PUT /identity/v3/projects/d7ecedd9cb7942c88c305b61d7a0ddfc/users/7f2873575ac54efc896211285cf3a575/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:38.946374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a2fe9-40bc-46b1-8afd-2907f0a73a37 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:38.946668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a2fe9-40bc-46b1-8afd-2907f0a73a37 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:38.947262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a2fe9-40bc-46b1-8afd-2907f0a73a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:38.975842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:38.982260 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-057a2fe9-40bc-46b1-8afd-2907f0a73a37 None None] MFA Rules not processed for user `7f2873575ac54efc896211285cf3a575`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:38.982260 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-057a2fe9-40bc-46b1-8afd-2907f0a73a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:39.072953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1012/2024] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:39.078416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff0c27-8843-440c-9b95-d531b70382d5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:39.164071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff0c27-8843-440c-9b95-d531b70382d5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:39.240341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e39a2-dae2-47df-96b7-2e85b9f866d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:39.245720 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e39a2-dae2-47df-96b7-2e85b9f866d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:39.245720 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e39a2-dae2-47df-96b7-2e85b9f866d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:39.245914 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e39a2-dae2-47df-96b7-2e85b9f866d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:39.246568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e39a2-dae2-47df-96b7-2e85b9f866d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:39.253012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e39a2-dae2-47df-96b7-2e85b9f866d8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:39.297206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1013/2025] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:39 2022] POST /identity/v3/projects => generated 367 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:39.299112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a2fe9-40bc-46b1-8afd-2907f0a73a37 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:39.311956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a2fe9-40bc-46b1-8afd-2907f0a73a37 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:39.387258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fbf3f-ec1d-4a91-b262-fd6417755817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:39.388099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fbf3f-ec1d-4a91-b262-fd6417755817 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:39.388232 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fbf3f-ec1d-4a91-b262-fd6417755817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:39.389536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fbf3f-ec1d-4a91-b262-fd6417755817 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:39.390431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fbf3f-ec1d-4a91-b262-fd6417755817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:39.402261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fbf3f-ec1d-4a91-b262-fd6417755817 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:39.426783 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1013/2026] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:39 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:39.430544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e39a2-dae2-47df-96b7-2e85b9f866d8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:39.436346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:39.442919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e39a2-dae2-47df-96b7-2e85b9f866d8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:39.451883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e737c-afdc-4c1f-9d57-f6fd8ed09eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:39.453029 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e737c-afdc-4c1f-9d57-f6fd8ed09eac admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:39.453642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e737c-afdc-4c1f-9d57-f6fd8ed09eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:39.454126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e737c-afdc-4c1f-9d57-f6fd8ed09eac admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:39.455744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e737c-afdc-4c1f-9d57-f6fd8ed09eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:39.457676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e737c-afdc-4c1f-9d57-f6fd8ed09eac admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:39.470712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1014/2027] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:39.475654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fbf3f-ec1d-4a91-b262-fd6417755817 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:39.486717 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fbf3f-ec1d-4a91-b262-fd6417755817 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:39.491975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460355b-407f-48b9-84ed-b6324786f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:39.492638 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460355b-407f-48b9-84ed-b6324786f69c admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:39.493023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460355b-407f-48b9-84ed-b6324786f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:39.493361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460355b-407f-48b9-84ed-b6324786f69c admin admin] PATH_INFO: `/v3/projects/746225812ea84aa0ba2fbe5e8ee54c49/users/0d2a8fc9779348ea892ecbeb71501d92/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:39.521175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460355b-407f-48b9-84ed-b6324786f69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=746225812ea84aa0ba2fbe5e8ee54c49, user_id=0d2a8fc9779348ea892ecbeb71501d92, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:39.523808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460355b-407f-48b9-84ed-b6324786f69c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:39.544767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1014/2028] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:39 2022] PUT /identity/v3/projects/746225812ea84aa0ba2fbe5e8ee54c49/users/0d2a8fc9779348ea892ecbeb71501d92/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:39.548170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e737c-afdc-4c1f-9d57-f6fd8ed09eac admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:39.559394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e737c-afdc-4c1f-9d57-f6fd8ed09eac admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:39.634160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facdea2-e3e0-4965-acfb-9a8b873c724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:39.634795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facdea2-e3e0-4965-acfb-9a8b873c724e admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:39.635257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facdea2-e3e0-4965-acfb-9a8b873c724e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:39.635598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facdea2-e3e0-4965-acfb-9a8b873c724e admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:39.636438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facdea2-e3e0-4965-acfb-9a8b873c724e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:39.638263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facdea2-e3e0-4965-acfb-9a8b873c724e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:39.653801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1015/2029] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:39.655261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460355b-407f-48b9-84ed-b6324786f69c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:39.666137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460355b-407f-48b9-84ed-b6324786f69c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:39.671670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7d65b-876d-4771-8161-8fbdfe4448b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:39.672559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7d65b-876d-4771-8161-8fbdfe4448b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:39.672967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7d65b-876d-4771-8161-8fbdfe4448b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:39.673429 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7d65b-876d-4771-8161-8fbdfe4448b3 admin admin] PATH_INFO: `/v3/projects/746225812ea84aa0ba2fbe5e8ee54c49/users/0d2a8fc9779348ea892ecbeb71501d92/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:39.676352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7d65b-876d-4771-8161-8fbdfe4448b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746225812ea84aa0ba2fbe5e8ee54c49, user_id=0d2a8fc9779348ea892ecbeb71501d92, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:39.679764 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7d65b-876d-4771-8161-8fbdfe4448b3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:39.694465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1015/2030] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:39 2022] PUT /identity/v3/projects/746225812ea84aa0ba2fbe5e8ee54c49/users/0d2a8fc9779348ea892ecbeb71501d92/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:39.705702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6591ff-3e6a-422b-8a2e-6ba702087c2e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:39.705932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6591ff-3e6a-422b-8a2e-6ba702087c2e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:39.706137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6591ff-3e6a-422b-8a2e-6ba702087c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:39.745224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4b6591ff-3e6a-422b-8a2e-6ba702087c2e None None] MFA Rules not processed for user `0d2a8fc9779348ea892ecbeb71501d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:39.746803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4b6591ff-3e6a-422b-8a2e-6ba702087c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:39.832750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1016/2031] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:39.843504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7d65b-876d-4771-8161-8fbdfe4448b3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:39.845383 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-66e7d65b-876d-4771-8161-8fbdfe4448b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:39.896816 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a20fc-808e-4d86-869d-b5bbd97f9293 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:39.897965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a20fc-808e-4d86-869d-b5bbd97f9293 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:39.897965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a20fc-808e-4d86-869d-b5bbd97f9293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:39.940577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-946a20fc-808e-4d86-869d-b5bbd97f9293 None None] MFA Rules not processed for user `e89b82bf8bdd46bb9af678b8e964cb12`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:39.941960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-946a20fc-808e-4d86-869d-b5bbd97f9293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:39.949080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7d65b-876d-4771-8161-8fbdfe4448b3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:39.961592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02102db4-145c-4b54-aebc-bb61f3dd79bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:39.962262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02102db4-145c-4b54-aebc-bb61f3dd79bb service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:39.962573 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02102db4-145c-4b54-aebc-bb61f3dd79bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:39.962831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02102db4-145c-4b54-aebc-bb61f3dd79bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:40.006680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02102db4-145c-4b54-aebc-bb61f3dd79bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:40.008166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02102db4-145c-4b54-aebc-bb61f3dd79bb service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:40.034974 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:40.051110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1016/2032] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:40.156401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:40.186419 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1017/2033] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:40.223069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02102db4-145c-4b54-aebc-bb61f3dd79bb service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:40.232313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02102db4-145c-4b54-aebc-bb61f3dd79bb service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:40.238505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e642db-2fb6-44b4-b316-c6c205f0079a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:40.239138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e642db-2fb6-44b4-b316-c6c205f0079a service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:40.239423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e642db-2fb6-44b4-b316-c6c205f0079a service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:40.239695 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e642db-2fb6-44b4-b316-c6c205f0079a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:40.270291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a20fc-808e-4d86-869d-b5bbd97f9293 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:40.271752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-946a20fc-808e-4d86-869d-b5bbd97f9293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:40.290861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a20fc-808e-4d86-869d-b5bbd97f9293 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:40.295378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104730d-efa4-4b44-9dc7-1ce6af093e65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:40.296010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104730d-efa4-4b44-9dc7-1ce6af093e65 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:40.296293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104730d-efa4-4b44-9dc7-1ce6af093e65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:40.296569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104730d-efa4-4b44-9dc7-1ce6af093e65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:40.361820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e642db-2fb6-44b4-b316-c6c205f0079a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:40.364376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e642db-2fb6-44b4-b316-c6c205f0079a service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:40.364505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104730d-efa4-4b44-9dc7-1ce6af093e65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:40.366036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104730d-efa4-4b44-9dc7-1ce6af093e65 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:40.380008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1017/2034] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:40.396500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1018/2035] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:41.865140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e642db-2fb6-44b4-b316-c6c205f0079a service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:41.874683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e642db-2fb6-44b4-b316-c6c205f0079a service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:41.880835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91612c1f-76be-4993-ad21-6a9a9f3e7bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:41.881587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91612c1f-76be-4993-ad21-6a9a9f3e7bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:41.881730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91612c1f-76be-4993-ad21-6a9a9f3e7bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:41.881999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91612c1f-76be-4993-ad21-6a9a9f3e7bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:41.891953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91612c1f-76be-4993-ad21-6a9a9f3e7bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:41.893430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91612c1f-76be-4993-ad21-6a9a9f3e7bf4 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:41.903248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1018/2036] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:42.238994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104730d-efa4-4b44-9dc7-1ce6af093e65 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:42.240557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7104730d-efa4-4b44-9dc7-1ce6af093e65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:42.317108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104730d-efa4-4b44-9dc7-1ce6af093e65 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:42.321129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:42.321801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:42.322113 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:42.322393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] PATH_INFO: `/v3/users/8bb1e436a0694784ace52ad4057a0ea5` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:42.323579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb1e436a0694784ace52ad4057a0ea5)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:42.325721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:42.373999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb1e436a0694784ace52ad4057a0ea5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:42.387761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb1e436a0694784ace52ad4057a0ea5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:42.388478 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb1e436a0694784ace52ad4057a0ea5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:42.396344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb1e436a0694784ace52ad4057a0ea5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:42.406517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb1e436a0694784ace52ad4057a0ea5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:42.412846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1019/2037] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:42 2022] DELETE /identity/v3/users/8bb1e436a0694784ace52ad4057a0ea5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:42.418399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed255e4-0ed0-4fb4-8a60-f2127c5e491f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:42.418830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed255e4-0ed0-4fb4-8a60-f2127c5e491f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:42.419283 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed255e4-0ed0-4fb4-8a60-f2127c5e491f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:42.439295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5ed255e4-0ed0-4fb4-8a60-f2127c5e491f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:42.440916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5ed255e4-0ed0-4fb4-8a60-f2127c5e491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:42.500989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1019/2038] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:42.511066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:42.512732 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:42.535260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:42.577066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e23372-f4fc-449a-9752-084736b03c6c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:42.581416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1420d-81d6-4d0a-a0f4-659f4859a1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:42.582207 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1420d-81d6-4d0a-a0f4-659f4859a1ab service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:42.582581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1420d-81d6-4d0a-a0f4-659f4859a1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:42.582829 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1420d-81d6-4d0a-a0f4-659f4859a1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:42.593606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1420d-81d6-4d0a-a0f4-659f4859a1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:42.595117 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1420d-81d6-4d0a-a0f4-659f4859a1ab service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:42.604773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1020/2039] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:42.881299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed255e4-0ed0-4fb4-8a60-f2127c5e491f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:42.882733 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5ed255e4-0ed0-4fb4-8a60-f2127c5e491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:42.899361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed255e4-0ed0-4fb4-8a60-f2127c5e491f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:42.909030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ed020-f04d-4a9e-983d-1e3020526a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:42.910253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ed020-f04d-4a9e-983d-1e3020526a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:42.910634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ed020-f04d-4a9e-983d-1e3020526a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:42.911118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ed020-f04d-4a9e-983d-1e3020526a40 admin admin] PATH_INFO: `/v3/projects/6118c6b8c34f46b8bad432d1b517d941` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:42.919234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ed020-f04d-4a9e-983d-1e3020526a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6118c6b8c34f46b8bad432d1b517d941)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:42.921560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ed020-f04d-4a9e-983d-1e3020526a40 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:42.992589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-797ed020-f04d-4a9e-983d-1e3020526a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6118c6b8c34f46b8bad432d1b517d941', 'request_id': 'req-797ed020-f04d-4a9e-983d-1e3020526a40'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:43.000030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-797ed020-f04d-4a9e-983d-1e3020526a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6118c6b8c34f46b8bad432d1b517d941', 'request_id': 'req-797ed020-f04d-4a9e-983d-1e3020526a40'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:43.007222 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-797ed020-f04d-4a9e-983d-1e3020526a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6118c6b8c34f46b8bad432d1b517d941', 'request_id': 'req-797ed020-f04d-4a9e-983d-1e3020526a40'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:43.021692 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-797ed020-f04d-4a9e-983d-1e3020526a40 admin admin] The token cache is being invalidate because project 6118c6b8c34f46b8bad432d1b517d941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:43.021980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-797ed020-f04d-4a9e-983d-1e3020526a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:43.022591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-797ed020-f04d-4a9e-983d-1e3020526a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:43.024245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1020/2040] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:42 2022] DELETE /identity/v3/projects/6118c6b8c34f46b8bad432d1b517d941 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:43.029320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb538d58-cb31-4474-9cef-e8a2ba61a438 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:43.029612 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb538d58-cb31-4474-9cef-e8a2ba61a438 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:43.029891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb538d58-cb31-4474-9cef-e8a2ba61a438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:43.053702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cb538d58-cb31-4474-9cef-e8a2ba61a438 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:43.054844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cb538d58-cb31-4474-9cef-e8a2ba61a438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:43.112937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1021/2041] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:43.120954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978ae58-ebfa-4150-984e-5b24da4b670b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:43.121271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978ae58-ebfa-4150-984e-5b24da4b670b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:43.121549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978ae58-ebfa-4150-984e-5b24da4b670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:43.136342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:43.142706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5978ae58-ebfa-4150-984e-5b24da4b670b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:43.144538 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5978ae58-ebfa-4150-984e-5b24da4b670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:43.153817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1021/2042] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:43.158311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb538d58-cb31-4474-9cef-e8a2ba61a438 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:43.168303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb538d58-cb31-4474-9cef-e8a2ba61a438 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:43.173167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34b061-eb9d-49b8-97df-88290665dbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:43.173784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34b061-eb9d-49b8-97df-88290665dbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:43.174065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34b061-eb9d-49b8-97df-88290665dbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:43.174343 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34b061-eb9d-49b8-97df-88290665dbb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:43.175018 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34b061-eb9d-49b8-97df-88290665dbb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:43.175331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34b061-eb9d-49b8-97df-88290665dbb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:43.176969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34b061-eb9d-49b8-97df-88290665dbb9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:43.193900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1022/2043] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:24:43.194649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978ae58-ebfa-4150-984e-5b24da4b670b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:43.207882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978ae58-ebfa-4150-984e-5b24da4b670b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:43.216376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a7d17-e9de-485d-92ec-76822db8f65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:43.217244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a7d17-e9de-485d-92ec-76822db8f65c admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:43.217588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a7d17-e9de-485d-92ec-76822db8f65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:43.217944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a7d17-e9de-485d-92ec-76822db8f65c admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:43.218727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a7d17-e9de-485d-92ec-76822db8f65c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:43.222594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a7d17-e9de-485d-92ec-76822db8f65c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:43.274513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1022/2044] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:43 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:43.277168 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34b061-eb9d-49b8-97df-88290665dbb9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:43.289338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34b061-eb9d-49b8-97df-88290665dbb9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:43.367048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14afad-4e48-4d6b-a1d1-1763ea4b3f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:43.367490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14afad-4e48-4d6b-a1d1-1763ea4b3f96 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:43.367776 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14afad-4e48-4d6b-a1d1-1763ea4b3f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:43.368079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14afad-4e48-4d6b-a1d1-1763ea4b3f96 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:43.368742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14afad-4e48-4d6b-a1d1-1763ea4b3f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:43.371037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14afad-4e48-4d6b-a1d1-1763ea4b3f96 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:43.409098 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1023/2045] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:43 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:43.413270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a7d17-e9de-485d-92ec-76822db8f65c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:43.424827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a7d17-e9de-485d-92ec-76822db8f65c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:43.433000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93554-5d30-468e-95d2-9b4d68da1d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:43.433645 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93554-5d30-468e-95d2-9b4d68da1d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:43.434028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93554-5d30-468e-95d2-9b4d68da1d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:43.434240 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93554-5d30-468e-95d2-9b4d68da1d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:43.434900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb93554-5d30-468e-95d2-9b4d68da1d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:43.439419 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb93554-5d30-468e-95d2-9b4d68da1d0c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:43.478552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1023/2046] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:43.481414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14afad-4e48-4d6b-a1d1-1763ea4b3f96 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:43.494839 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14afad-4e48-4d6b-a1d1-1763ea4b3f96 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:43.510941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea280c0-2203-4f0b-bdd3-b19a5b69475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:43.512099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea280c0-2203-4f0b-bdd3-b19a5b69475f admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:43.512666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea280c0-2203-4f0b-bdd3-b19a5b69475f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:43.513307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea280c0-2203-4f0b-bdd3-b19a5b69475f admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:43.516224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea280c0-2203-4f0b-bdd3-b19a5b69475f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:43.518233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea280c0-2203-4f0b-bdd3-b19a5b69475f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:43.561218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1024/2047] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:43.566431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93554-5d30-468e-95d2-9b4d68da1d0c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:43.591891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93554-5d30-468e-95d2-9b4d68da1d0c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:43.610907 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aceb5c-f8b9-4abe-92a2-4771a73d569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:43.620452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aceb5c-f8b9-4abe-92a2-4771a73d569b admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:43.620817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aceb5c-f8b9-4abe-92a2-4771a73d569b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:43.621187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aceb5c-f8b9-4abe-92a2-4771a73d569b admin admin] PATH_INFO: `/v3/projects/9d263e866dde46929430fd1b304cfbcf/users/92012e075d3341b7941505a0583a731a/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:43.655616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aceb5c-f8b9-4abe-92a2-4771a73d569b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d263e866dde46929430fd1b304cfbcf, user_id=92012e075d3341b7941505a0583a731a, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:43.659478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aceb5c-f8b9-4abe-92a2-4771a73d569b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:43.678450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1024/2048] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:43 2022] PUT /identity/v3/projects/9d263e866dde46929430fd1b304cfbcf/users/92012e075d3341b7941505a0583a731a/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:43.691132 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955b87-0562-4fe3-ac00-292051360b38 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:43.691474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955b87-0562-4fe3-ac00-292051360b38 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:43.691761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955b87-0562-4fe3-ac00-292051360b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:43.752248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8b955b87-0562-4fe3-ac00-292051360b38 None None] MFA Rules not processed for user `92012e075d3341b7941505a0583a731a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:43.752248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8b955b87-0562-4fe3-ac00-292051360b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:43.767900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:43.858691 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aceb5c-f8b9-4abe-92a2-4771a73d569b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:43.871499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1025/2049] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:43.973133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aceb5c-f8b9-4abe-92a2-4771a73d569b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:43.987545 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae1aa4-f813-4b48-81bb-3837b70d4a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:43.988183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae1aa4-f813-4b48-81bb-3837b70d4a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:43.988454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae1aa4-f813-4b48-81bb-3837b70d4a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:43.988742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae1aa4-f813-4b48-81bb-3837b70d4a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:43.989381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae1aa4-f813-4b48-81bb-3837b70d4a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:43.991742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae1aa4-f813-4b48-81bb-3837b70d4a00 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:44.028428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b955b87-0562-4fe3-ac00-292051360b38 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:44.028986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1025/2050] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:43 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:44.039282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b955b87-0562-4fe3-ac00-292051360b38 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:44.108820 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7f1e2-ab7b-4d78-a0bf-8256510a9d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:44.109644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7f1e2-ab7b-4d78-a0bf-8256510a9d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:44.110114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7f1e2-ab7b-4d78-a0bf-8256510a9d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:44.110750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7f1e2-ab7b-4d78-a0bf-8256510a9d83 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:44.111566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7f1e2-ab7b-4d78-a0bf-8256510a9d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:44.113702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7f1e2-ab7b-4d78-a0bf-8256510a9d83 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:44.140945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1026/2051] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:44 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:44.145281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae1aa4-f813-4b48-81bb-3837b70d4a00 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:44.158330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae1aa4-f813-4b48-81bb-3837b70d4a00 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:44.164994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aa105-9601-4134-af4c-56ab2bf00ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:44.165713 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aa105-9601-4134-af4c-56ab2bf00ddf admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:44.166008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aa105-9601-4134-af4c-56ab2bf00ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:44.166309 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aa105-9601-4134-af4c-56ab2bf00ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:44.167056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2aa105-9601-4134-af4c-56ab2bf00ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:44.169172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2aa105-9601-4134-af4c-56ab2bf00ddf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:44.186507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1026/2052] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:44.188337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7f1e2-ab7b-4d78-a0bf-8256510a9d83 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:44.200149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7f1e2-ab7b-4d78-a0bf-8256510a9d83 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:44.205606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e024c4-b71c-426f-9f2c-79e686a1b273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:44.206285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e024c4-b71c-426f-9f2c-79e686a1b273 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:44.206683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e024c4-b71c-426f-9f2c-79e686a1b273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:44.207437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e024c4-b71c-426f-9f2c-79e686a1b273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:44.207950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e024c4-b71c-426f-9f2c-79e686a1b273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:44.210019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e024c4-b71c-426f-9f2c-79e686a1b273 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:44.221493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1027/2053] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:44.225930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aa105-9601-4134-af4c-56ab2bf00ddf admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:44.237185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aa105-9601-4134-af4c-56ab2bf00ddf admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:44.242667 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728f19e-1ad1-41d6-b19b-4a095cd5fad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:44.243387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728f19e-1ad1-41d6-b19b-4a095cd5fad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:44.243711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728f19e-1ad1-41d6-b19b-4a095cd5fad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:44.243986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728f19e-1ad1-41d6-b19b-4a095cd5fad8 admin admin] PATH_INFO: `/v3/projects/2717c8c7d122423f8ea21e158f27a443/users/6f8a5c33fffa42aa8fbde701246eb9aa/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:44.261560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728f19e-1ad1-41d6-b19b-4a095cd5fad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2717c8c7d122423f8ea21e158f27a443, user_id=6f8a5c33fffa42aa8fbde701246eb9aa, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:44.265493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728f19e-1ad1-41d6-b19b-4a095cd5fad8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:44.281387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1027/2054] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:44 2022] PUT /identity/v3/projects/2717c8c7d122423f8ea21e158f27a443/users/6f8a5c33fffa42aa8fbde701246eb9aa/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:44.292906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eace9-0368-4b91-9397-5a92740be306 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:44.293408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eace9-0368-4b91-9397-5a92740be306 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:44.293509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eace9-0368-4b91-9397-5a92740be306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:44.332300 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-528eace9-0368-4b91-9397-5a92740be306 None None] MFA Rules not processed for user `6f8a5c33fffa42aa8fbde701246eb9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:44.333579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-528eace9-0368-4b91-9397-5a92740be306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:44.458434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1028/2055] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:44.463206 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728f19e-1ad1-41d6-b19b-4a095cd5fad8 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:44.539939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:44.552281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728f19e-1ad1-41d6-b19b-4a095cd5fad8 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:44.557393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafd5b0-6ab8-4e15-9bb7-29677d8afb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:44.557949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafd5b0-6ab8-4e15-9bb7-29677d8afb9e admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:44.558247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafd5b0-6ab8-4e15-9bb7-29677d8afb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:44.558516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafd5b0-6ab8-4e15-9bb7-29677d8afb9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:44.559202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafd5b0-6ab8-4e15-9bb7-29677d8afb9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:44.561190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafd5b0-6ab8-4e15-9bb7-29677d8afb9e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:44.587468 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1028/2056] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:44 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:44.591743 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528eace9-0368-4b91-9397-5a92740be306 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:44.602976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528eace9-0368-4b91-9397-5a92740be306 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:44.622510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:44.677452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351fdf6-35ed-406b-b551-c11896382f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:44.678069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351fdf6-35ed-406b-b551-c11896382f9d admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:44.678348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351fdf6-35ed-406b-b551-c11896382f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:44.678618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351fdf6-35ed-406b-b551-c11896382f9d admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:44.679266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351fdf6-35ed-406b-b551-c11896382f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:44.681222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351fdf6-35ed-406b-b551-c11896382f9d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:44.704774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1029/2057] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:44 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:44.708345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafd5b0-6ab8-4e15-9bb7-29677d8afb9e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:44.719325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafd5b0-6ab8-4e15-9bb7-29677d8afb9e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:44.724895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ea2ae-cc9b-406d-9884-824c68f4e474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:44.725505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ea2ae-cc9b-406d-9884-824c68f4e474 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:44.725914 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ea2ae-cc9b-406d-9884-824c68f4e474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:44.726189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ea2ae-cc9b-406d-9884-824c68f4e474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:44.726937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ea2ae-cc9b-406d-9884-824c68f4e474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:44.728871 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ea2ae-cc9b-406d-9884-824c68f4e474 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:44.743679 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1029/2058] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:44.744968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351fdf6-35ed-406b-b551-c11896382f9d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:44.756158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351fdf6-35ed-406b-b551-c11896382f9d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:44.761907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a7b09-3398-4f58-a4d5-dc8f109bf372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:44.762634 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a7b09-3398-4f58-a4d5-dc8f109bf372 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:44.762962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a7b09-3398-4f58-a4d5-dc8f109bf372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:44.763183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a7b09-3398-4f58-a4d5-dc8f109bf372 admin admin] PATH_INFO: `/v3/projects/3f0c3a88858b40f99c03475a531def29/users/16d3c6c14d6d42768cb79e48658e56e7/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:44.781671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a7b09-3398-4f58-a4d5-dc8f109bf372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0c3a88858b40f99c03475a531def29, user_id=16d3c6c14d6d42768cb79e48658e56e7, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:44.784474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a7b09-3398-4f58-a4d5-dc8f109bf372 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:44.802391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1030/2059] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:44 2022] PUT /identity/v3/projects/3f0c3a88858b40f99c03475a531def29/users/16d3c6c14d6d42768cb79e48658e56e7/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:44.803783 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ea2ae-cc9b-406d-9884-824c68f4e474 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:44.815131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ea2ae-cc9b-406d-9884-824c68f4e474 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:44.888045 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4f354-536d-48d3-bb4e-99500a0a55af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:44.888674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4f354-536d-48d3-bb4e-99500a0a55af admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:44.889313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4f354-536d-48d3-bb4e-99500a0a55af admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:44.889589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4f354-536d-48d3-bb4e-99500a0a55af admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:44.890241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4f354-536d-48d3-bb4e-99500a0a55af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:44.891868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4f354-536d-48d3-bb4e-99500a0a55af admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:44.903041 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1030/2060] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:44.907285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a7b09-3398-4f58-a4d5-dc8f109bf372 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:44.917764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a7b09-3398-4f58-a4d5-dc8f109bf372 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:44.922847 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3c95c-a023-4001-8f45-0ecda3d1350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:44.923510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3c95c-a023-4001-8f45-0ecda3d1350a admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:44.923785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3c95c-a023-4001-8f45-0ecda3d1350a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:44.924053 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3c95c-a023-4001-8f45-0ecda3d1350a admin admin] PATH_INFO: `/v3/projects/3f0c3a88858b40f99c03475a531def29/users/16d3c6c14d6d42768cb79e48658e56e7/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:44.925971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3c95c-a023-4001-8f45-0ecda3d1350a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0c3a88858b40f99c03475a531def29, user_id=16d3c6c14d6d42768cb79e48658e56e7, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:44.929205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3c95c-a023-4001-8f45-0ecda3d1350a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:44.943351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1031/2061] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:44 2022] PUT /identity/v3/projects/3f0c3a88858b40f99c03475a531def29/users/16d3c6c14d6d42768cb79e48658e56e7/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:44.960471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a522e-963c-467c-b3ee-5d1a47ab2a3e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:44.961325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a522e-963c-467c-b3ee-5d1a47ab2a3e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:44.961704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a522e-963c-467c-b3ee-5d1a47ab2a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:44.998531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c22a522e-963c-467c-b3ee-5d1a47ab2a3e None None] MFA Rules not processed for user `16d3c6c14d6d42768cb79e48658e56e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:45.000247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c22a522e-963c-467c-b3ee-5d1a47ab2a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:45.109964 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1031/2062] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:45.117401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3c95c-a023-4001-8f45-0ecda3d1350a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:45.119091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-49e3c95c-a023-4001-8f45-0ecda3d1350a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:45.176148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3c95c-a023-4001-8f45-0ecda3d1350a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:45.179810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6903-6148-4b07-badd-4599c4b07c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:45.180425 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6903-6148-4b07-badd-4599c4b07c78 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:45.180684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6903-6148-4b07-badd-4599c4b07c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:45.180997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6903-6148-4b07-badd-4599c4b07c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:45.241290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a6903-6148-4b07-badd-4599c4b07c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:45.243174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a6903-6148-4b07-badd-4599c4b07c78 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:45.255272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1032/2063] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:45.736290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a522e-963c-467c-b3ee-5d1a47ab2a3e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:45.737755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c22a522e-963c-467c-b3ee-5d1a47ab2a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:45.785949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:45.802698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a522e-963c-467c-b3ee-5d1a47ab2a3e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:45.807719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:45.808363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:45.808652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:45.808980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] PATH_INFO: `/v3/users/7f2873575ac54efc896211285cf3a575` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:45.810131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2873575ac54efc896211285cf3a575)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:45.812057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:45.861049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2873575ac54efc896211285cf3a575'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:45.861788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2873575ac54efc896211285cf3a575'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:45.870075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2873575ac54efc896211285cf3a575'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:45.877650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2873575ac54efc896211285cf3a575'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:45.878288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2873575ac54efc896211285cf3a575'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:45.897318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1032/2064] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:45 2022] DELETE /identity/v3/users/7f2873575ac54efc896211285cf3a575 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:45.902267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4806f46-07fc-4818-a741-3b75fe5226d1 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:45.902740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4806f46-07fc-4818-a741-3b75fe5226d1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:45.902960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4806f46-07fc-4818-a741-3b75fe5226d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:45.923999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f4806f46-07fc-4818-a741-3b75fe5226d1 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:45.925263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f4806f46-07fc-4818-a741-3b75fe5226d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:45.952657 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:45.989508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1033/2065] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:45.999262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:46.000848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:46.061391 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcea1f1-cd56-4a3e-8624-640756cc56e6 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:46.067313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992e77e-4bcd-4f3c-ae66-7fd65c6eec5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:46.068053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992e77e-4bcd-4f3c-ae66-7fd65c6eec5a service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:46.068426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992e77e-4bcd-4f3c-ae66-7fd65c6eec5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:46.068956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992e77e-4bcd-4f3c-ae66-7fd65c6eec5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:46.080424 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992e77e-4bcd-4f3c-ae66-7fd65c6eec5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:46.081890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992e77e-4bcd-4f3c-ae66-7fd65c6eec5a service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:46.092104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1033/2066] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:46.417015 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4806f46-07fc-4818-a741-3b75fe5226d1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:46.417015 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f4806f46-07fc-4818-a741-3b75fe5226d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:46.431586 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4806f46-07fc-4818-a741-3b75fe5226d1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:46.438335 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:46.439481 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:46.440317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:46.440910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] PATH_INFO: `/v3/projects/d7ecedd9cb7942c88c305b61d7a0ddfc` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:46.442378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ecedd9cb7942c88c305b61d7a0ddfc)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:46.444398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:46.520154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ecedd9cb7942c88c305b61d7a0ddfc', 'request_id': 'req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:46.529857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ecedd9cb7942c88c305b61d7a0ddfc', 'request_id': 'req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:46.536911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ecedd9cb7942c88c305b61d7a0ddfc', 'request_id': 'req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:46.552251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] The token cache is being invalidate because project d7ecedd9cb7942c88c305b61d7a0ddfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:46.552610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:46.553434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:46.555366 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1034/2067] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:46 2022] DELETE /identity/v3/projects/d7ecedd9cb7942c88c305b61d7a0ddfc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:46.559526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992e77e-4bcd-4f3c-ae66-7fd65c6eec5a service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:46.570493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992e77e-4bcd-4f3c-ae66-7fd65c6eec5a service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:46.654433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:46.655078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:46.655355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:46.655627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] PATH_INFO: `/v3/users/0d2a8fc9779348ea892ecbeb71501d92` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:46.656858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d2a8fc9779348ea892ecbeb71501d92)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:46.658900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:46.675104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:46.714153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d2a8fc9779348ea892ecbeb71501d92'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:46.714791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d2a8fc9779348ea892ecbeb71501d92'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:46.729795 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d2a8fc9779348ea892ecbeb71501d92'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:46.737367 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d2a8fc9779348ea892ecbeb71501d92'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:46.738202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d2a8fc9779348ea892ecbeb71501d92'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:46.756143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1034/2068] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:46 2022] DELETE /identity/v3/users/0d2a8fc9779348ea892ecbeb71501d92 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:46.787127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:46.788636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:46.847388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a24e0-4590-4ad1-901d-15e73a0de9ed admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:46.897995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72a86d-4848-4edd-95f6-c4d1eb738e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:46.900015 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72a86d-4848-4edd-95f6-c4d1eb738e78 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:46.900015 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72a86d-4848-4edd-95f6-c4d1eb738e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:46.900015 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72a86d-4848-4edd-95f6-c4d1eb738e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:46.903694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0d72a86d-4848-4edd-95f6-c4d1eb738e78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:46.929068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:46.972467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72a86d-4848-4edd-95f6-c4d1eb738e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:46.974465 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72a86d-4848-4edd-95f6-c4d1eb738e78 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:46.983989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1035/2069] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:47.076564 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:47.078652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:47.191896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f661427-af46-4e47-9bc7-25fed159f4c1 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:47.196895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19815-0b6d-456d-aea1-f1349432d3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:47.197542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19815-0b6d-456d-aea1-f1349432d3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:47.197823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19815-0b6d-456d-aea1-f1349432d3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:47.198232 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19815-0b6d-456d-aea1-f1349432d3b5 admin admin] PATH_INFO: `/v3/projects/746225812ea84aa0ba2fbe5e8ee54c49` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:47.199390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19815-0b6d-456d-aea1-f1349432d3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=746225812ea84aa0ba2fbe5e8ee54c49)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:47.201407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19815-0b6d-456d-aea1-f1349432d3b5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:47.254152 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2bf19815-0b6d-456d-aea1-f1349432d3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746225812ea84aa0ba2fbe5e8ee54c49', 'request_id': 'req-2bf19815-0b6d-456d-aea1-f1349432d3b5'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:47.260346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2bf19815-0b6d-456d-aea1-f1349432d3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746225812ea84aa0ba2fbe5e8ee54c49', 'request_id': 'req-2bf19815-0b6d-456d-aea1-f1349432d3b5'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:47.267385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2bf19815-0b6d-456d-aea1-f1349432d3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746225812ea84aa0ba2fbe5e8ee54c49', 'request_id': 'req-2bf19815-0b6d-456d-aea1-f1349432d3b5'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:47.280464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2bf19815-0b6d-456d-aea1-f1349432d3b5 admin admin] The token cache is being invalidate because project 746225812ea84aa0ba2fbe5e8ee54c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:47.280787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2bf19815-0b6d-456d-aea1-f1349432d3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:47.281422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2bf19815-0b6d-456d-aea1-f1349432d3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:47.284139 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1035/2070] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:47 2022] DELETE /identity/v3/projects/746225812ea84aa0ba2fbe5e8ee54c49 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:47.288761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298a971-9b79-443f-9e64-526463150e2b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:47.289150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298a971-9b79-443f-9e64-526463150e2b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:47.289322 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298a971-9b79-443f-9e64-526463150e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:47.311128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3298a971-9b79-443f-9e64-526463150e2b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:47.312894 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3298a971-9b79-443f-9e64-526463150e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:47.389612 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1036/2071] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:47.399733 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eded7f-1c8b-4d8b-a24a-6e9305d49e9b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:47.400014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eded7f-1c8b-4d8b-a24a-6e9305d49e9b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:47.400281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eded7f-1c8b-4d8b-a24a-6e9305d49e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:47.421214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f9eded7f-1c8b-4d8b-a24a-6e9305d49e9b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:47.422425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f9eded7f-1c8b-4d8b-a24a-6e9305d49e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:47.430704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1036/2072] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:47.435287 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298a971-9b79-443f-9e64-526463150e2b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:47.448215 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298a971-9b79-443f-9e64-526463150e2b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:47.453038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06506bb2-bb52-43f3-bdfa-c7239062bfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:47.453711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06506bb2-bb52-43f3-bdfa-c7239062bfcd admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:47.454214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06506bb2-bb52-43f3-bdfa-c7239062bfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:47.454533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06506bb2-bb52-43f3-bdfa-c7239062bfcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:47.455502 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06506bb2-bb52-43f3-bdfa-c7239062bfcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:47.455813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06506bb2-bb52-43f3-bdfa-c7239062bfcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:47.458050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06506bb2-bb52-43f3-bdfa-c7239062bfcd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:47.471180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1037/2073] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:24:47.481248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eded7f-1c8b-4d8b-a24a-6e9305d49e9b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:47.486470 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eded7f-1c8b-4d8b-a24a-6e9305d49e9b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:47.491346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f30c8-119a-492d-ae69-d4d2fb5a08e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:47.491952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f30c8-119a-492d-ae69-d4d2fb5a08e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:47.492229 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f30c8-119a-492d-ae69-d4d2fb5a08e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:47.492530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f30c8-119a-492d-ae69-d4d2fb5a08e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:47.493218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f30c8-119a-492d-ae69-d4d2fb5a08e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:47.495113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f30c8-119a-492d-ae69-d4d2fb5a08e4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:47.508614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:47.534781 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06506bb2-bb52-43f3-bdfa-c7239062bfcd admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:47.535889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1037/2074] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:47 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:47.545490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06506bb2-bb52-43f3-bdfa-c7239062bfcd admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:47.617408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35728f-0afe-4bbc-967f-3ee22654cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:47.618134 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35728f-0afe-4bbc-967f-3ee22654cc2a admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:47.618489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35728f-0afe-4bbc-967f-3ee22654cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:47.618832 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35728f-0afe-4bbc-967f-3ee22654cc2a admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:47.619600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35728f-0afe-4bbc-967f-3ee22654cc2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:47.621743 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35728f-0afe-4bbc-967f-3ee22654cc2a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:47.660835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1038/2075] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:47 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:47.663012 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f30c8-119a-492d-ae69-d4d2fb5a08e4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:47.666680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-539f30c8-119a-492d-ae69-d4d2fb5a08e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:47.668756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35728f-0afe-4bbc-967f-3ee22654cc2a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:47.696155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35728f-0afe-4bbc-967f-3ee22654cc2a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:47.707514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd2f9e-fd39-4a68-b2e9-fcedca435824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:47.708573 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd2f9e-fd39-4a68-b2e9-fcedca435824 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:47.709062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd2f9e-fd39-4a68-b2e9-fcedca435824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:47.709512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd2f9e-fd39-4a68-b2e9-fcedca435824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:47.711690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd2f9e-fd39-4a68-b2e9-fcedca435824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:47.714976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd2f9e-fd39-4a68-b2e9-fcedca435824 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:47.743614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1039/2076] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:47.748094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd2f9e-fd39-4a68-b2e9-fcedca435824 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:47.768636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd2f9e-fd39-4a68-b2e9-fcedca435824 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:47.777070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f30c8-119a-492d-ae69-d4d2fb5a08e4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:47.782366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d297157-1ede-4b0c-9228-6313711e9ca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:47.783101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d297157-1ede-4b0c-9228-6313711e9ca8 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:47.783355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d297157-1ede-4b0c-9228-6313711e9ca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:47.783636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d297157-1ede-4b0c-9228-6313711e9ca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:47.785201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d40a5-6dfd-4ea7-9552-dec0218190fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:47.786071 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2d297157-1ede-4b0c-9228-6313711e9ca8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:47.786761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d40a5-6dfd-4ea7-9552-dec0218190fa admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:47.787440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d40a5-6dfd-4ea7-9552-dec0218190fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:47.787889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d40a5-6dfd-4ea7-9552-dec0218190fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:47.788926 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d40a5-6dfd-4ea7-9552-dec0218190fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:47.791153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d40a5-6dfd-4ea7-9552-dec0218190fa admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:47.820228 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1040/2077] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:47.822362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d40a5-6dfd-4ea7-9552-dec0218190fa admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:47.844840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d40a5-6dfd-4ea7-9552-dec0218190fa admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:47.852968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19095f5c-387e-4e7b-97b9-3791725ebc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:47.854470 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19095f5c-387e-4e7b-97b9-3791725ebc75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:47.855160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19095f5c-387e-4e7b-97b9-3791725ebc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:47.855398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19095f5c-387e-4e7b-97b9-3791725ebc75 admin admin] PATH_INFO: `/v3/projects/4b75ae9bc5594982893eb49f6828210d/users/b21bc3d9485447a8b952df1c402d8c6e/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:47.880768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19095f5c-387e-4e7b-97b9-3791725ebc75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b75ae9bc5594982893eb49f6828210d, user_id=b21bc3d9485447a8b952df1c402d8c6e, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:47.886520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19095f5c-387e-4e7b-97b9-3791725ebc75 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:47.890889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:47.892550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d297157-1ede-4b0c-9228-6313711e9ca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:47.894129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d297157-1ede-4b0c-9228-6313711e9ca8 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:47.913441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1038/2078] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:47.918006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1041/2079] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:47 2022] PUT /identity/v3/projects/4b75ae9bc5594982893eb49f6828210d/users/b21bc3d9485447a8b952df1c402d8c6e/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:47.936485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ea7d3-5b4b-429a-af93-295ec4f95eb9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:47.938528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ea7d3-5b4b-429a-af93-295ec4f95eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:47.939277 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ea7d3-5b4b-429a-af93-295ec4f95eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:47.994672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-730ea7d3-5b4b-429a-af93-295ec4f95eb9 None None] MFA Rules not processed for user `b21bc3d9485447a8b952df1c402d8c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:47.997820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-730ea7d3-5b4b-429a-af93-295ec4f95eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:48.117295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1039/2080] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:48.121980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19095f5c-387e-4e7b-97b9-3791725ebc75 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:48.191721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19095f5c-387e-4e7b-97b9-3791725ebc75 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:48.198112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e3607-a8f9-45d8-9c44-52e403a63356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:48.199343 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e3607-a8f9-45d8-9c44-52e403a63356 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:48.199690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e3607-a8f9-45d8-9c44-52e403a63356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:48.199976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e3607-a8f9-45d8-9c44-52e403a63356 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:48.200917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e3607-a8f9-45d8-9c44-52e403a63356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:48.202871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e3607-a8f9-45d8-9c44-52e403a63356 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:48.258796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1042/2081] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:48 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:48.264387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ea7d3-5b4b-429a-af93-295ec4f95eb9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:48.279065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ea7d3-5b4b-429a-af93-295ec4f95eb9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:48.312934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:48.353777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae938d37-aff2-4ebe-9ba7-0627b2183610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:48.354556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae938d37-aff2-4ebe-9ba7-0627b2183610 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:48.355288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae938d37-aff2-4ebe-9ba7-0627b2183610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:48.355573 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae938d37-aff2-4ebe-9ba7-0627b2183610 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:48.356277 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae938d37-aff2-4ebe-9ba7-0627b2183610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:48.359407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae938d37-aff2-4ebe-9ba7-0627b2183610 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:48.392699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1040/2082] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:48 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:48.396864 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e3607-a8f9-45d8-9c44-52e403a63356 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:48.409533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e3607-a8f9-45d8-9c44-52e403a63356 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:48.414760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b023ef3-5262-4f05-bc8b-0aed92903e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:48.415382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b023ef3-5262-4f05-bc8b-0aed92903e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:48.416003 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b023ef3-5262-4f05-bc8b-0aed92903e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:48.416433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b023ef3-5262-4f05-bc8b-0aed92903e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:48.417284 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b023ef3-5262-4f05-bc8b-0aed92903e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:48.418952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b023ef3-5262-4f05-bc8b-0aed92903e3e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:48.431358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1043/2083] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:48.435679 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae938d37-aff2-4ebe-9ba7-0627b2183610 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:48.448485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae938d37-aff2-4ebe-9ba7-0627b2183610 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:48.453696 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3290b-487e-4912-89f5-6bdebbe16d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:48.454366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3290b-487e-4912-89f5-6bdebbe16d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:48.454643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3290b-487e-4912-89f5-6bdebbe16d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:48.454917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3290b-487e-4912-89f5-6bdebbe16d7e admin admin] PATH_INFO: `/v3/projects/21f37f89f2d141c48d10960f7c96291e/users/b7e42222ebff4653acbaba85fa481884/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:48.470355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3290b-487e-4912-89f5-6bdebbe16d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f37f89f2d141c48d10960f7c96291e, user_id=b7e42222ebff4653acbaba85fa481884, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:48.473064 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3290b-487e-4912-89f5-6bdebbe16d7e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:48.487313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1041/2084] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:48 2022] PUT /identity/v3/projects/21f37f89f2d141c48d10960f7c96291e/users/b7e42222ebff4653acbaba85fa481884/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:48.491662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b023ef3-5262-4f05-bc8b-0aed92903e3e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:48.502028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b023ef3-5262-4f05-bc8b-0aed92903e3e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:48.563009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ba58e-e9da-46b7-ad55-57fa4bd84b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:48.563544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ba58e-e9da-46b7-ad55-57fa4bd84b46 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:48.563824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ba58e-e9da-46b7-ad55-57fa4bd84b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:48.564091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ba58e-e9da-46b7-ad55-57fa4bd84b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:48.564800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ba58e-e9da-46b7-ad55-57fa4bd84b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:48.566412 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ba58e-e9da-46b7-ad55-57fa4bd84b46 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:48.577463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1044/2085] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:48.581727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3290b-487e-4912-89f5-6bdebbe16d7e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:48.592997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3290b-487e-4912-89f5-6bdebbe16d7e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:48.597963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f95811-faa6-458a-bee2-bf9a1366496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:48.598644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f95811-faa6-458a-bee2-bf9a1366496b admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:48.598932 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f95811-faa6-458a-bee2-bf9a1366496b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:48.599214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f95811-faa6-458a-bee2-bf9a1366496b admin admin] PATH_INFO: `/v3/projects/21f37f89f2d141c48d10960f7c96291e/users/b7e42222ebff4653acbaba85fa481884/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:48.601279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f95811-faa6-458a-bee2-bf9a1366496b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f37f89f2d141c48d10960f7c96291e, user_id=b7e42222ebff4653acbaba85fa481884, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:48.603951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f95811-faa6-458a-bee2-bf9a1366496b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:48.615985 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1042/2086] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:48 2022] PUT /identity/v3/projects/21f37f89f2d141c48d10960f7c96291e/users/b7e42222ebff4653acbaba85fa481884/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:48.626581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bae548-e691-4469-aa28-39dc40c2e8a6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:48.626884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bae548-e691-4469-aa28-39dc40c2e8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:48.627119 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bae548-e691-4469-aa28-39dc40c2e8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:48.657659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-12bae548-e691-4469-aa28-39dc40c2e8a6 None None] MFA Rules not processed for user `b7e42222ebff4653acbaba85fa481884`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:48.658924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-12bae548-e691-4469-aa28-39dc40c2e8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:48.710416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:48.732140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1045/2087] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:48.749172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f95811-faa6-458a-bee2-bf9a1366496b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:48.751348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c8f95811-faa6-458a-bee2-bf9a1366496b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:48.811388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f95811-faa6-458a-bee2-bf9a1366496b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:48.815109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a6d3e-8ca1-44ef-92cf-b25dcfb3fa19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:48.815653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a6d3e-8ca1-44ef-92cf-b25dcfb3fa19 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:48.815928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a6d3e-8ca1-44ef-92cf-b25dcfb3fa19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:48.816227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a6d3e-8ca1-44ef-92cf-b25dcfb3fa19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:48.825484 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a6d3e-8ca1-44ef-92cf-b25dcfb3fa19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:48.826967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a6d3e-8ca1-44ef-92cf-b25dcfb3fa19 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:48.837132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1043/2088] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:49.385722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bae548-e691-4469-aa28-39dc40c2e8a6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:49.536344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bae548-e691-4469-aa28-39dc40c2e8a6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:49.553591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:49.554248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:49.554545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:49.554823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] PATH_INFO: `/v3/users/b21bc3d9485447a8b952df1c402d8c6e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:49.556268 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21bc3d9485447a8b952df1c402d8c6e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:49.558147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:49.621514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21bc3d9485447a8b952df1c402d8c6e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:49.642870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21bc3d9485447a8b952df1c402d8c6e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:49.643737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21bc3d9485447a8b952df1c402d8c6e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:49.653271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21bc3d9485447a8b952df1c402d8c6e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:49.663269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21bc3d9485447a8b952df1c402d8c6e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:49.673231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1046/2089] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:49 2022] DELETE /identity/v3/users/b21bc3d9485447a8b952df1c402d8c6e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:49.675570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8244d9-b8f0-41b6-ad5c-8dd9362005c2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:49.676045 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8244d9-b8f0-41b6-ad5c-8dd9362005c2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:49.676308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8244d9-b8f0-41b6-ad5c-8dd9362005c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:49.696989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1b8244d9-b8f0-41b6-ad5c-8dd9362005c2 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:49.698301 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1b8244d9-b8f0-41b6-ad5c-8dd9362005c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:49.771848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1044/2090] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:49.780536 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:49.783158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:49.896476 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed1c81-4557-4783-a784-ae0f24e017e0 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:49.906114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc79b7-f0d5-4098-b539-c339c6e9b59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:49.907265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc79b7-f0d5-4098-b539-c339c6e9b59e service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:49.907265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc79b7-f0d5-4098-b539-c339c6e9b59e service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:49.908212 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc79b7-f0d5-4098-b539-c339c6e9b59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:49.932693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc79b7-f0d5-4098-b539-c339c6e9b59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:49.934641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc79b7-f0d5-4098-b539-c339c6e9b59e service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:49.952817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1047/2091] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:50.335440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8244d9-b8f0-41b6-ad5c-8dd9362005c2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:50.336628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1b8244d9-b8f0-41b6-ad5c-8dd9362005c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:50.356079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8244d9-b8f0-41b6-ad5c-8dd9362005c2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:50.369300 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:50.369972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:50.370271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:50.370590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] PATH_INFO: `/v3/projects/4b75ae9bc5594982893eb49f6828210d` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:50.372656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b75ae9bc5594982893eb49f6828210d)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:50.374737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:50.406306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:50.443410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b75ae9bc5594982893eb49f6828210d', 'request_id': 'req-abce8f24-5976-49fe-9015-3536d9ad5f6f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:50.452072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b75ae9bc5594982893eb49f6828210d', 'request_id': 'req-abce8f24-5976-49fe-9015-3536d9ad5f6f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:50.461455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b75ae9bc5594982893eb49f6828210d', 'request_id': 'req-abce8f24-5976-49fe-9015-3536d9ad5f6f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:50.484996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] The token cache is being invalidate because project 4b75ae9bc5594982893eb49f6828210d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:50.485577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:50.486127 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:50.487972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1045/2092] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:50 2022] DELETE /identity/v3/projects/4b75ae9bc5594982893eb49f6828210d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:50.491811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc79b7-f0d5-4098-b539-c339c6e9b59e service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:50.504406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc79b7-f0d5-4098-b539-c339c6e9b59e service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:50.531838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:50.613458 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf3ce5-037e-48a8-8047-114806556d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:50.614227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf3ce5-037e-48a8-8047-114806556d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:50.614570 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf3ce5-037e-48a8-8047-114806556d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:50.614986 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf3ce5-037e-48a8-8047-114806556d78 admin admin] PATH_INFO: `/v3/users/b7e42222ebff4653acbaba85fa481884` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:50.616233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf3ce5-037e-48a8-8047-114806556d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e42222ebff4653acbaba85fa481884)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:50.618381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf3ce5-037e-48a8-8047-114806556d78 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:50.688654 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f3bf3ce5-037e-48a8-8047-114806556d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e42222ebff4653acbaba85fa481884'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:50.702382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f3bf3ce5-037e-48a8-8047-114806556d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e42222ebff4653acbaba85fa481884'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:50.703281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f3bf3ce5-037e-48a8-8047-114806556d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e42222ebff4653acbaba85fa481884'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:50.716929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f3bf3ce5-037e-48a8-8047-114806556d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e42222ebff4653acbaba85fa481884'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:50.720995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f3bf3ce5-037e-48a8-8047-114806556d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e42222ebff4653acbaba85fa481884'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:50.729137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1048/2093] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:50 2022] DELETE /identity/v3/users/b7e42222ebff4653acbaba85fa481884 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:51.333776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:51.336969 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:51.351998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce8f24-5976-49fe-9015-3536d9ad5f6f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:51.465369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bc408-021f-4876-8442-c0585ae1654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:51.466327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bc408-021f-4876-8442-c0585ae1654b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:51.466808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bc408-021f-4876-8442-c0585ae1654b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:51.467252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bc408-021f-4876-8442-c0585ae1654b admin admin] PATH_INFO: `/v3/projects/21f37f89f2d141c48d10960f7c96291e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:51.469314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bc408-021f-4876-8442-c0585ae1654b admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f37f89f2d141c48d10960f7c96291e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:51.471653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bc408-021f-4876-8442-c0585ae1654b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:51.549298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7a7bc408-021f-4876-8442-c0585ae1654b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f37f89f2d141c48d10960f7c96291e', 'request_id': 'req-7a7bc408-021f-4876-8442-c0585ae1654b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:51.554974 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7a7bc408-021f-4876-8442-c0585ae1654b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f37f89f2d141c48d10960f7c96291e', 'request_id': 'req-7a7bc408-021f-4876-8442-c0585ae1654b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:51.562252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7a7bc408-021f-4876-8442-c0585ae1654b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f37f89f2d141c48d10960f7c96291e', 'request_id': 'req-7a7bc408-021f-4876-8442-c0585ae1654b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:51.579709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7a7bc408-021f-4876-8442-c0585ae1654b admin admin] The token cache is being invalidate because project 21f37f89f2d141c48d10960f7c96291e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:51.580136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7a7bc408-021f-4876-8442-c0585ae1654b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:51.581050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7a7bc408-021f-4876-8442-c0585ae1654b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:51.583225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1046/2094] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:51 2022] DELETE /identity/v3/projects/21f37f89f2d141c48d10960f7c96291e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:51.587962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798305cd-fa17-4231-a145-987001093b17 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:51.588839 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798305cd-fa17-4231-a145-987001093b17 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:51.589323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798305cd-fa17-4231-a145-987001093b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:51.616195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-798305cd-fa17-4231-a145-987001093b17 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:51.617255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-798305cd-fa17-4231-a145-987001093b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:51.717098 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1049/2095] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:51.725680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6547e-5b56-47e7-a207-71bd900aa727 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:51.725957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6547e-5b56-47e7-a207-71bd900aa727 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:51.726229 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6547e-5b56-47e7-a207-71bd900aa727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:51.753968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-70c6547e-5b56-47e7-a207-71bd900aa727 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:51.761737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-70c6547e-5b56-47e7-a207-71bd900aa727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:51.772463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1047/2096] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:51.776742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798305cd-fa17-4231-a145-987001093b17 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:51.793578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798305cd-fa17-4231-a145-987001093b17 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:51.804502 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac55f3-c653-4223-ad81-4fd3c42460f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:51.806135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac55f3-c653-4223-ad81-4fd3c42460f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:51.807770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac55f3-c653-4223-ad81-4fd3c42460f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:51.808263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac55f3-c653-4223-ad81-4fd3c42460f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:51.809406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac55f3-c653-4223-ad81-4fd3c42460f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:51.809913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac55f3-c653-4223-ad81-4fd3c42460f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:51.825699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac55f3-c653-4223-ad81-4fd3c42460f5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:51.840433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1050/2097] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:24:51.845404 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6547e-5b56-47e7-a207-71bd900aa727 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:51.854912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6547e-5b56-47e7-a207-71bd900aa727 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:51.859987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b4f2-7411-415c-9880-5bcc71dbf346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:51.861179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b4f2-7411-415c-9880-5bcc71dbf346 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:51.861179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b4f2-7411-415c-9880-5bcc71dbf346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:51.861417 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b4f2-7411-415c-9880-5bcc71dbf346 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:51.862080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40b4f2-7411-415c-9880-5bcc71dbf346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:51.864982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40b4f2-7411-415c-9880-5bcc71dbf346 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:51.928005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1048/2098] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:51 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:51.932340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac55f3-c653-4223-ad81-4fd3c42460f5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:51.943931 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac55f3-c653-4223-ad81-4fd3c42460f5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:51.959373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:52.053813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961853c-c810-400c-a768-346e7e8dd5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:52.054474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961853c-c810-400c-a768-346e7e8dd5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.054751 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961853c-c810-400c-a768-346e7e8dd5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.055022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961853c-c810-400c-a768-346e7e8dd5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.055789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961853c-c810-400c-a768-346e7e8dd5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:52.058206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961853c-c810-400c-a768-346e7e8dd5c4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:52.095106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1051/2099] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:51 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:24:52.096508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b4f2-7411-415c-9880-5bcc71dbf346 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:52.108204 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b4f2-7411-415c-9880-5bcc71dbf346 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:52.113444 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90514860-75d2-4aac-a764-4955ef293665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:52.114069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90514860-75d2-4aac-a764-4955ef293665 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.114627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90514860-75d2-4aac-a764-4955ef293665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.114999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90514860-75d2-4aac-a764-4955ef293665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.115605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961853c-c810-400c-a768-346e7e8dd5c4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:52.115726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90514860-75d2-4aac-a764-4955ef293665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:52.117388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90514860-75d2-4aac-a764-4955ef293665 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:52.117523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a961853c-c810-400c-a768-346e7e8dd5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:52.123788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:52.131136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1049/2100] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:52.134189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8aeae-c584-485c-acd7-367f15e65d3e None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.134481 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8aeae-c584-485c-acd7-367f15e65d3e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.134763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8aeae-c584-485c-acd7-367f15e65d3e None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.136407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961853c-c810-400c-a768-346e7e8dd5c4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:52.136739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1050/2101] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:24:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:24:52.137763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8aeae-c584-485c-acd7-367f15e65d3e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:52.143523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:52.144167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.144565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.144872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] PATH_INFO: `/v3/users/92012e075d3341b7941505a0583a731a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.146385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=92012e075d3341b7941505a0583a731a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:52.149578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:52.152471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8aeae-c584-485c-acd7-367f15e65d3e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:52.158421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93f5a-be62-4c66-8cc1-2140a1f4df9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:52.159103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93f5a-be62-4c66-8cc1-2140a1f4df9d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.159453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93f5a-be62-4c66-8cc1-2140a1f4df9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.159800 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93f5a-be62-4c66-8cc1-2140a1f4df9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.160557 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b93f5a-be62-4c66-8cc1-2140a1f4df9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:52.162360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b93f5a-be62-4c66-8cc1-2140a1f4df9d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:52.177882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1051/2102] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:52.177882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea41a7e-d633-46d1-b84f-13822945d8b2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.177882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea41a7e-d633-46d1-b84f-13822945d8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.177882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea41a7e-d633-46d1-b84f-13822945d8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.201875 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-aea41a7e-d633-46d1-b84f-13822945d8b2 None None] MFA Rules not processed for user `dd9eef8921de43f18245f47559f3fa71`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:52.203211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-aea41a7e-d633-46d1-b84f-13822945d8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:52.211380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92012e075d3341b7941505a0583a731a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.231191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92012e075d3341b7941505a0583a731a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.231776 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92012e075d3341b7941505a0583a731a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.239788 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92012e075d3341b7941505a0583a731a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.250371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92012e075d3341b7941505a0583a731a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.260133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1052/2103] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:52 2022] DELETE /identity/v3/users/92012e075d3341b7941505a0583a731a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:52.261338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:52.262855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:52.305802 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1052/2104] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:24:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:52.306464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea41a7e-d633-46d1-b84f-13822945d8b2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:52.307777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-aea41a7e-d633-46d1-b84f-13822945d8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:52.323579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea41a7e-d633-46d1-b84f-13822945d8b2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:52.338440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dbdd7-f177-4d50-bef9-fac193bbbf4e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:52.343218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404d4b5-4fe2-4e1d-9d53-ef68b3278006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:52.343889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404d4b5-4fe2-4e1d-9d53-ef68b3278006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.344178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404d4b5-4fe2-4e1d-9d53-ef68b3278006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.344581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404d4b5-4fe2-4e1d-9d53-ef68b3278006 admin admin] PATH_INFO: `/v3/projects/ac20d8460a184be2ac6463f1191fc1cd/users/ddf561a77e1c4400930ab693bcdd6345/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.361312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404d4b5-4fe2-4e1d-9d53-ef68b3278006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac20d8460a184be2ac6463f1191fc1cd, user_id=ddf561a77e1c4400930ab693bcdd6345, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:52.365092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404d4b5-4fe2-4e1d-9d53-ef68b3278006 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:52.379652 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1053/2105] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:52 2022] PUT /identity/v3/projects/ac20d8460a184be2ac6463f1191fc1cd/users/ddf561a77e1c4400930ab693bcdd6345/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:52.381043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81273bf3-1cbc-4df4-aa21-15a5f7afc602 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.381344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81273bf3-1cbc-4df4-aa21-15a5f7afc602 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.381613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81273bf3-1cbc-4df4-aa21-15a5f7afc602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.382335 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81c8c9-7114-487b-8200-dfc243b59910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:52.383508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c8c9-7114-487b-8200-dfc243b59910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.383964 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c8c9-7114-487b-8200-dfc243b59910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.384415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c8c9-7114-487b-8200-dfc243b59910 admin admin] PATH_INFO: `/v3/users/c019d1c81a764d42b98222c8146b8ce2` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.386177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c8c9-7114-487b-8200-dfc243b59910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c019d1c81a764d42b98222c8146b8ce2)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:52.388632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:52.388806 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c8c9-7114-487b-8200-dfc243b59910 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:52.403259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-81273bf3-1cbc-4df4-aa21-15a5f7afc602 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:52.404784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-81273bf3-1cbc-4df4-aa21-15a5f7afc602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:52.441054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cd81c8c9-7114-487b-8200-dfc243b59910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c019d1c81a764d42b98222c8146b8ce2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.441668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cd81c8c9-7114-487b-8200-dfc243b59910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c019d1c81a764d42b98222c8146b8ce2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.450173 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cd81c8c9-7114-487b-8200-dfc243b59910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c019d1c81a764d42b98222c8146b8ce2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.458698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cd81c8c9-7114-487b-8200-dfc243b59910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c019d1c81a764d42b98222c8146b8ce2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.459602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cd81c8c9-7114-487b-8200-dfc243b59910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c019d1c81a764d42b98222c8146b8ce2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.476948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1054/2106] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:52.481332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1053/2107] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:52 2022] DELETE /identity/v3/users/c019d1c81a764d42b98222c8146b8ce2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:52.481332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6afe9-da09-45fd-b09a-1c65c2fcc9ab None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.482002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081dd71-a792-49c0-a6d9-e32a287f9b70 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.482002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081dd71-a792-49c0-a6d9-e32a287f9b70 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.482002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081dd71-a792-49c0-a6d9-e32a287f9b70 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.483346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1055/2108] 10.222.0.45 () {54 vars in 961 bytes} [Fri Aug 26 18:24:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:24:52.485006 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6afe9-da09-45fd-b09a-1c65c2fcc9ab None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.485314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6afe9-da09-45fd-b09a-1c65c2fcc9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.489275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf46b8-5dba-4ae8-aa20-fed5cab43245 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.489560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf46b8-5dba-4ae8-aa20-fed5cab43245 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.489834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf46b8-5dba-4ae8-aa20-fed5cab43245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.495366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:52.527317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9ec6afe9-da09-45fd-b09a-1c65c2fcc9ab None None] MFA Rules not processed for user `ddf561a77e1c4400930ab693bcdd6345`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:52.529581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9ec6afe9-da09-45fd-b09a-1c65c2fcc9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:52.530346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e5bf46b8-5dba-4ae8-aa20-fed5cab43245 None None] MFA Rules not processed for user `dd9eef8921de43f18245f47559f3fa71`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:52.531533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e5bf46b8-5dba-4ae8-aa20-fed5cab43245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:52.610324 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1056/2109] 10.222.0.45 () {58 vars in 1058 bytes} [Fri Aug 26 18:24:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:52.611201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf46b8-5dba-4ae8-aa20-fed5cab43245 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:52.612598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e5bf46b8-5dba-4ae8-aa20-fed5cab43245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:52.644010 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1054/2110] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:52.645118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6afe9-da09-45fd-b09a-1c65c2fcc9ab None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:52.661561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6afe9-da09-45fd-b09a-1c65c2fcc9ab None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:52.674403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e530b71-dbd4-403d-98a2-2b9222532774 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9eef8921de43f18245f47559f3fa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:52.675542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e530b71-dbd4-403d-98a2-2b9222532774 service placement] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.676025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e530b71-dbd4-403d-98a2-2b9222532774 service placement] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.677101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e530b71-dbd4-403d-98a2-2b9222532774 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.680083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9e530b71-dbd4-403d-98a2-2b9222532774 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:52.685308 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf46b8-5dba-4ae8-aa20-fed5cab43245 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:52.689545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f2b27-4117-4151-91f5-a86b9010953b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:52.690179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f2b27-4117-4151-91f5-a86b9010953b service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.690455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f2b27-4117-4151-91f5-a86b9010953b service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.693698 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f2b27-4117-4151-91f5-a86b9010953b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.706999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e530b71-dbd4-403d-98a2-2b9222532774 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:52.710270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e530b71-dbd4-403d-98a2-2b9222532774 service placement] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:52.722690 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1055/2111] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:52.723380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e530b71-dbd4-403d-98a2-2b9222532774 service placement] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:52.724842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9e530b71-dbd4-403d-98a2-2b9222532774 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:52.771603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:52.786503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f2b27-4117-4151-91f5-a86b9010953b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:52.788001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f2b27-4117-4151-91f5-a86b9010953b service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:52.799503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1057/2112] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:52.805082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e530b71-dbd4-403d-98a2-2b9222532774 service placement] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:52.807275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f2b27-4117-4151-91f5-a86b9010953b service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:52.809833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa415cbc-bfaa-4213-98d8-6bbc724ba117 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ee7b50c34742ce896a734f3ef34a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:52.810701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa415cbc-bfaa-4213-98d8-6bbc724ba117 service glance] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.810890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa415cbc-bfaa-4213-98d8-6bbc724ba117 service glance] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.811015 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-eb0f2b27-4117-4151-91f5-a86b9010953b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:52.811193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa415cbc-bfaa-4213-98d8-6bbc724ba117 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.821980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa415cbc-bfaa-4213-98d8-6bbc724ba117 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:52.823683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa415cbc-bfaa-4213-98d8-6bbc724ba117 service glance] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:52.826942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f2b27-4117-4151-91f5-a86b9010953b service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:52.832142 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c749e5-2c09-4328-94d9-bcad76179bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:52.832807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c749e5-2c09-4328-94d9-bcad76179bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.833087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c749e5-2c09-4328-94d9-bcad76179bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.833663 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c749e5-2c09-4328-94d9-bcad76179bdf admin admin] PATH_INFO: `/v3/projects/c525ea582b264cd5866aa7f403999cba` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.834838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c749e5-2c09-4328-94d9-bcad76179bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c525ea582b264cd5866aa7f403999cba)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:52.836184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1056/2113] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:52.836848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c749e5-2c09-4328-94d9-bcad76179bdf admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:52.895906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5c749e5-2c09-4328-94d9-bcad76179bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c525ea582b264cd5866aa7f403999cba', 'request_id': 'req-d5c749e5-2c09-4328-94d9-bcad76179bdf'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.904871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5c749e5-2c09-4328-94d9-bcad76179bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c525ea582b264cd5866aa7f403999cba', 'request_id': 'req-d5c749e5-2c09-4328-94d9-bcad76179bdf'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.912679 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5c749e5-2c09-4328-94d9-bcad76179bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c525ea582b264cd5866aa7f403999cba', 'request_id': 'req-d5c749e5-2c09-4328-94d9-bcad76179bdf'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.927825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5c749e5-2c09-4328-94d9-bcad76179bdf admin admin] The token cache is being invalidate because project c525ea582b264cd5866aa7f403999cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:52.928161 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5c749e5-2c09-4328-94d9-bcad76179bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.929444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5c749e5-2c09-4328-94d9-bcad76179bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:52.932931 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1058/2114] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:52 2022] DELETE /identity/v3/projects/c525ea582b264cd5866aa7f403999cba => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:52.936692 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71395a-2ac7-4ae2-9ee3-5c98f45ed7bf None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:52.937096 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71395a-2ac7-4ae2-9ee3-5c98f45ed7bf None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:52.937437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71395a-2ac7-4ae2-9ee3-5c98f45ed7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:52.960404 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ff71395a-2ac7-4ae2-9ee3-5c98f45ed7bf None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:52.962215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ff71395a-2ac7-4ae2-9ee3-5c98f45ed7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:53.032500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1057/2115] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:53.040268 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf444a2-190a-43c5-bfdb-8e3c9c8be089 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:53.040558 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf444a2-190a-43c5-bfdb-8e3c9c8be089 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:53.040865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf444a2-190a-43c5-bfdb-8e3c9c8be089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:53.070700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4bf444a2-190a-43c5-bfdb-8e3c9c8be089 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:53.072200 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4bf444a2-190a-43c5-bfdb-8e3c9c8be089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:53.093224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1059/2116] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:53.097565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71395a-2ac7-4ae2-9ee3-5c98f45ed7bf None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:53.108129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71395a-2ac7-4ae2-9ee3-5c98f45ed7bf None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:53.113102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72a7bc-ec57-41f2-a4c6-fb79917e96cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:53.113717 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72a7bc-ec57-41f2-a4c6-fb79917e96cc admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:53.114005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72a7bc-ec57-41f2-a4c6-fb79917e96cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:53.114264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72a7bc-ec57-41f2-a4c6-fb79917e96cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:53.114926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72a7bc-ec57-41f2-a4c6-fb79917e96cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:53.115219 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72a7bc-ec57-41f2-a4c6-fb79917e96cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:53.116872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72a7bc-ec57-41f2-a4c6-fb79917e96cc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:53.128980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf444a2-190a-43c5-bfdb-8e3c9c8be089 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:53.130417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4bf444a2-190a-43c5-bfdb-8e3c9c8be089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:53.136502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1058/2117] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:24:53.137449 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72a7bc-ec57-41f2-a4c6-fb79917e96cc admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:53.146490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf444a2-190a-43c5-bfdb-8e3c9c8be089 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:53.151134 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72a7bc-ec57-41f2-a4c6-fb79917e96cc admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:53.151953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:53.152593 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:53.152958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:53.153233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] PATH_INFO: `/v3/projects/9d263e866dde46929430fd1b304cfbcf` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:53.154354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d263e866dde46929430fd1b304cfbcf)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:53.156412 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:53.158211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7772a8-1a04-475e-8f1f-2d1eda3c0e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:53.158905 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7772a8-1a04-475e-8f1f-2d1eda3c0e68 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:53.159252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7772a8-1a04-475e-8f1f-2d1eda3c0e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:53.159532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7772a8-1a04-475e-8f1f-2d1eda3c0e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:53.160373 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7772a8-1a04-475e-8f1f-2d1eda3c0e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:53.163011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7772a8-1a04-475e-8f1f-2d1eda3c0e68 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:53.178283 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:53.205112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1059/2118] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:53 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:53.206717 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7772a8-1a04-475e-8f1f-2d1eda3c0e68 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:53.216486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d263e866dde46929430fd1b304cfbcf', 'request_id': 'req-ce16ac11-546c-4cf9-a588-4b75891691a7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:53.226281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d263e866dde46929430fd1b304cfbcf', 'request_id': 'req-ce16ac11-546c-4cf9-a588-4b75891691a7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:53.236042 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d263e866dde46929430fd1b304cfbcf', 'request_id': 'req-ce16ac11-546c-4cf9-a588-4b75891691a7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:53.248084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] The token cache is being invalidate because project 9d263e866dde46929430fd1b304cfbcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:53.248422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:53.249242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:53.251054 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1060/2119] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:53 2022] DELETE /identity/v3/projects/9d263e866dde46929430fd1b304cfbcf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:53.255034 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:53.256215 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:53.290738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7772a8-1a04-475e-8f1f-2d1eda3c0e68 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:53.297042 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f14cff-fb79-490c-9c1b-79fb6b18598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:53.297668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14cff-fb79-490c-9c1b-79fb6b18598e admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:53.297949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14cff-fb79-490c-9c1b-79fb6b18598e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:53.298228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14cff-fb79-490c-9c1b-79fb6b18598e admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:53.298872 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f14cff-fb79-490c-9c1b-79fb6b18598e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:53.300843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f14cff-fb79-490c-9c1b-79fb6b18598e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:53.314454 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:53.337696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16ac11-546c-4cf9-a588-4b75891691a7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:53.341945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7b156-9dff-4ed3-a057-fd99e5f763c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:53.341945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7b156-9dff-4ed3-a057-fd99e5f763c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:53.341945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7b156-9dff-4ed3-a057-fd99e5f763c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:53.341945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7b156-9dff-4ed3-a057-fd99e5f763c3 admin admin] PATH_INFO: `/v3/users/6f8a5c33fffa42aa8fbde701246eb9aa` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:53.342624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7b156-9dff-4ed3-a057-fd99e5f763c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8a5c33fffa42aa8fbde701246eb9aa)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:53.343357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1060/2120] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:53 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:53.344959 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7b156-9dff-4ed3-a057-fd99e5f763c3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:53.347323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f14cff-fb79-490c-9c1b-79fb6b18598e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:53.350141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-76f14cff-fb79-490c-9c1b-79fb6b18598e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:53.365861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f14cff-fb79-490c-9c1b-79fb6b18598e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:53.371609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0962d7c-6c93-48b5-84be-0fba7fe1f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:53.372443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0962d7c-6c93-48b5-84be-0fba7fe1f583 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:53.372845 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0962d7c-6c93-48b5-84be-0fba7fe1f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:53.373206 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0962d7c-6c93-48b5-84be-0fba7fe1f583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:53.373934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0962d7c-6c93-48b5-84be-0fba7fe1f583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:53.375806 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0962d7c-6c93-48b5-84be-0fba7fe1f583 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:53.388749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1061/2121] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:53.391498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0962d7c-6c93-48b5-84be-0fba7fe1f583 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:53.403247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0962d7c-6c93-48b5-84be-0fba7fe1f583 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:53.408770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701321f-e83b-4544-b827-f3fb59c88afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:53.409418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701321f-e83b-4544-b827-f3fb59c88afe admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:53.409701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701321f-e83b-4544-b827-f3fb59c88afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:53.409975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701321f-e83b-4544-b827-f3fb59c88afe admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:53.410623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701321f-e83b-4544-b827-f3fb59c88afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:53.412238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701321f-e83b-4544-b827-f3fb59c88afe admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:53.413836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-72a7b156-9dff-4ed3-a057-fd99e5f763c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8a5c33fffa42aa8fbde701246eb9aa'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:53.424358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1062/2122] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:24:53.427805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-72a7b156-9dff-4ed3-a057-fd99e5f763c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8a5c33fffa42aa8fbde701246eb9aa'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:53.428340 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701321f-e83b-4544-b827-f3fb59c88afe admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:53.428672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-72a7b156-9dff-4ed3-a057-fd99e5f763c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8a5c33fffa42aa8fbde701246eb9aa'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:53.437750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-72a7b156-9dff-4ed3-a057-fd99e5f763c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8a5c33fffa42aa8fbde701246eb9aa'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:53.439158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701321f-e83b-4544-b827-f3fb59c88afe admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:53.446063 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b32349-b991-4cb4-bbde-fb38a4cafc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:53.446730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b32349-b991-4cb4-bbde-fb38a4cafc11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:53.447008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b32349-b991-4cb4-bbde-fb38a4cafc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:53.447137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-72a7b156-9dff-4ed3-a057-fd99e5f763c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8a5c33fffa42aa8fbde701246eb9aa'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:53.447296 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b32349-b991-4cb4-bbde-fb38a4cafc11 admin admin] PATH_INFO: `/v3/projects/67f4fd75428040ab9ff8a0458e4708fb/users/a1be02f9e7fd4bdabc05ec48e2a35f56/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:53.453331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1061/2123] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:53 2022] DELETE /identity/v3/users/6f8a5c33fffa42aa8fbde701246eb9aa => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:53.462633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b32349-b991-4cb4-bbde-fb38a4cafc11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f4fd75428040ab9ff8a0458e4708fb, user_id=a1be02f9e7fd4bdabc05ec48e2a35f56, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:53.465482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b32349-b991-4cb4-bbde-fb38a4cafc11 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:53.479258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1063/2124] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:53 2022] PUT /identity/v3/projects/67f4fd75428040ab9ff8a0458e4708fb/users/a1be02f9e7fd4bdabc05ec48e2a35f56/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:53.484491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d377-4a3d-40e2-aab5-7a9f7b6d91b0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:53.484817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d377-4a3d-40e2-aab5-7a9f7b6d91b0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:53.485096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d377-4a3d-40e2-aab5-7a9f7b6d91b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:53.504862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-74a1d377-4a3d-40e2-aab5-7a9f7b6d91b0 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:53.506105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-74a1d377-4a3d-40e2-aab5-7a9f7b6d91b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:53.571238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1062/2125] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:53.581385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b32349-b991-4cb4-bbde-fb38a4cafc11 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:53.583295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b1b32349-b991-4cb4-bbde-fb38a4cafc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:53.654271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b32349-b991-4cb4-bbde-fb38a4cafc11 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:53.658609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5a34a-baaf-40d1-bf3f-935c1424bed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:53.659234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5a34a-baaf-40d1-bf3f-935c1424bed4 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:53.659545 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5a34a-baaf-40d1-bf3f-935c1424bed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:53.659814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5a34a-baaf-40d1-bf3f-935c1424bed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:53.670859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5a34a-baaf-40d1-bf3f-935c1424bed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:53.672322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5a34a-baaf-40d1-bf3f-935c1424bed4 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:53.682996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1064/2126] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:24:54.050568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1d377-4a3d-40e2-aab5-7a9f7b6d91b0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:54.052277 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-74a1d377-4a3d-40e2-aab5-7a9f7b6d91b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:54.066482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1d377-4a3d-40e2-aab5-7a9f7b6d91b0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:54.072166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:54.073096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:54.074009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:54.074009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] PATH_INFO: `/v3/projects/2717c8c7d122423f8ea21e158f27a443` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:54.075557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2717c8c7d122423f8ea21e158f27a443)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:54.077754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:54.141193 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2717c8c7d122423f8ea21e158f27a443', 'request_id': 'req-99761f08-9efd-4e6d-96e7-b9f21b41aab7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:54.150440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2717c8c7d122423f8ea21e158f27a443', 'request_id': 'req-99761f08-9efd-4e6d-96e7-b9f21b41aab7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:54.157976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2717c8c7d122423f8ea21e158f27a443', 'request_id': 'req-99761f08-9efd-4e6d-96e7-b9f21b41aab7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:54.160248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:54.170590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] The token cache is being invalidate because project 2717c8c7d122423f8ea21e158f27a443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:54.170886 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:54.171643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:54.173205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1063/2127] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:54 2022] DELETE /identity/v3/projects/2717c8c7d122423f8ea21e158f27a443 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:54.177321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5a34a-baaf-40d1-bf3f-935c1424bed4 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:54.188243 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5a34a-baaf-40d1-bf3f-935c1424bed4 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:54.226127 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:54.262176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e15e8b-9fe1-4bec-b09a-154a1142d29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:54.263161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e15e8b-9fe1-4bec-b09a-154a1142d29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:54.263528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e15e8b-9fe1-4bec-b09a-154a1142d29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:54.263925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e15e8b-9fe1-4bec-b09a-154a1142d29d admin admin] PATH_INFO: `/v3/users/16d3c6c14d6d42768cb79e48658e56e7` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:54.265812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e15e8b-9fe1-4bec-b09a-154a1142d29d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d3c6c14d6d42768cb79e48658e56e7)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:54.267967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e15e8b-9fe1-4bec-b09a-154a1142d29d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:54.318280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-48e15e8b-9fe1-4bec-b09a-154a1142d29d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d3c6c14d6d42768cb79e48658e56e7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:54.319011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-48e15e8b-9fe1-4bec-b09a-154a1142d29d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d3c6c14d6d42768cb79e48658e56e7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:54.331195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-48e15e8b-9fe1-4bec-b09a-154a1142d29d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d3c6c14d6d42768cb79e48658e56e7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:54.339059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-48e15e8b-9fe1-4bec-b09a-154a1142d29d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d3c6c14d6d42768cb79e48658e56e7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:54.340229 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-48e15e8b-9fe1-4bec-b09a-154a1142d29d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d3c6c14d6d42768cb79e48658e56e7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:54.358894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1065/2128] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:54 2022] DELETE /identity/v3/users/16d3c6c14d6d42768cb79e48658e56e7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:54.828163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:54.829756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:54.843462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99761f08-9efd-4e6d-96e7-b9f21b41aab7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:54.917577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d765a6c-b383-4293-b082-cc2cf5ce8745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:54.918426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765a6c-b383-4293-b082-cc2cf5ce8745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:54.919029 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765a6c-b383-4293-b082-cc2cf5ce8745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:54.919222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765a6c-b383-4293-b082-cc2cf5ce8745 admin admin] PATH_INFO: `/v3/projects/3f0c3a88858b40f99c03475a531def29` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:54.920811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d765a6c-b383-4293-b082-cc2cf5ce8745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0c3a88858b40f99c03475a531def29)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:54.922916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d765a6c-b383-4293-b082-cc2cf5ce8745 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:54.995959 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d765a6c-b383-4293-b082-cc2cf5ce8745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0c3a88858b40f99c03475a531def29', 'request_id': 'req-1d765a6c-b383-4293-b082-cc2cf5ce8745'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:55.006789 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d765a6c-b383-4293-b082-cc2cf5ce8745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0c3a88858b40f99c03475a531def29', 'request_id': 'req-1d765a6c-b383-4293-b082-cc2cf5ce8745'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:55.017202 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d765a6c-b383-4293-b082-cc2cf5ce8745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0c3a88858b40f99c03475a531def29', 'request_id': 'req-1d765a6c-b383-4293-b082-cc2cf5ce8745'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:55.030279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d765a6c-b383-4293-b082-cc2cf5ce8745 admin admin] The token cache is being invalidate because project 3f0c3a88858b40f99c03475a531def29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:24:55.030836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d765a6c-b383-4293-b082-cc2cf5ce8745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:55.031648 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d765a6c-b383-4293-b082-cc2cf5ce8745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:55.037083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1064/2129] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:54 2022] DELETE /identity/v3/projects/3f0c3a88858b40f99c03475a531def29 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:55.038384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9333-4e25-4649-801a-53dd5e363540 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:55.038899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9333-4e25-4649-801a-53dd5e363540 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:55.039016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9333-4e25-4649-801a-53dd5e363540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:55.061617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f70f9333-4e25-4649-801a-53dd5e363540 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:55.063653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f70f9333-4e25-4649-801a-53dd5e363540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:55.166640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1066/2130] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:55.174786 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829a884-ffeb-45c3-a33d-81a706642fb9 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:55.175364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829a884-ffeb-45c3-a33d-81a706642fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:55.175364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829a884-ffeb-45c3-a33d-81a706642fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:55.196214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d829a884-ffeb-45c3-a33d-81a706642fb9 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:55.197517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d829a884-ffeb-45c3-a33d-81a706642fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:55.211647 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1065/2131] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:55.212129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f9333-4e25-4649-801a-53dd5e363540 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:55.231496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f9333-4e25-4649-801a-53dd5e363540 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:55.236605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6b820-069a-410c-9785-a5bd9177b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:55.237408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6b820-069a-410c-9785-a5bd9177b129 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:55.237738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6b820-069a-410c-9785-a5bd9177b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:55.239649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6b820-069a-410c-9785-a5bd9177b129 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:55.239833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6b820-069a-410c-9785-a5bd9177b129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:24:55.241259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6b820-069a-410c-9785-a5bd9177b129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:55.244030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6b820-069a-410c-9785-a5bd9177b129 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:55.260390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1067/2132] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:24:55.261857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829a884-ffeb-45c3-a33d-81a706642fb9 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:55.272183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829a884-ffeb-45c3-a33d-81a706642fb9 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:55.278845 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba0198-985d-4f00-9b28-e3556c01477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:55.279590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba0198-985d-4f00-9b28-e3556c01477a admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:55.280191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba0198-985d-4f00-9b28-e3556c01477a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:55.280564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba0198-985d-4f00-9b28-e3556c01477a admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:55.282024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba0198-985d-4f00-9b28-e3556c01477a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:55.284589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba0198-985d-4f00-9b28-e3556c01477a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:55.324676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1066/2133] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:24:55 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:55.328462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6b820-069a-410c-9785-a5bd9177b129 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:55.342977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6b820-069a-410c-9785-a5bd9177b129 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:55.426822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:55.446930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06308c4e-e65d-4e0a-a2d2-4c8da2f44f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:55.448193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06308c4e-e65d-4e0a-a2d2-4c8da2f44f30 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:55.448823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06308c4e-e65d-4e0a-a2d2-4c8da2f44f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:55.449650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06308c4e-e65d-4e0a-a2d2-4c8da2f44f30 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:55.450991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06308c4e-e65d-4e0a-a2d2-4c8da2f44f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:55.453640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06308c4e-e65d-4e0a-a2d2-4c8da2f44f30 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:55.494602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1068/2134] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:24:55 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:24:55.496755 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba0198-985d-4f00-9b28-e3556c01477a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:55.513918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba0198-985d-4f00-9b28-e3556c01477a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:55.528206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd54e4-68c2-40bf-9909-bf16c5323791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:55.529058 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd54e4-68c2-40bf-9909-bf16c5323791 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:55.529439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd54e4-68c2-40bf-9909-bf16c5323791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:55.529992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd54e4-68c2-40bf-9909-bf16c5323791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:55.531249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd54e4-68c2-40bf-9909-bf16c5323791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:55.532791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd54e4-68c2-40bf-9909-bf16c5323791 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:55.550374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06308c4e-e65d-4e0a-a2d2-4c8da2f44f30 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:55.551257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1067/2135] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:55.566708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06308c4e-e65d-4e0a-a2d2-4c8da2f44f30 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:55.572726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b48640-913c-4309-82da-1a94b2e07c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:55.573647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b48640-913c-4309-82da-1a94b2e07c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:55.574140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b48640-913c-4309-82da-1a94b2e07c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:55.574647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b48640-913c-4309-82da-1a94b2e07c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:55.575781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b48640-913c-4309-82da-1a94b2e07c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:55.577667 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b48640-913c-4309-82da-1a94b2e07c1a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:55.594370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd54e4-68c2-40bf-9909-bf16c5323791 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:55.601320 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1069/2136] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:24:55.605977 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd54e4-68c2-40bf-9909-bf16c5323791 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:55.611849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f5f02-a53f-4f73-beca-fb3f04f92355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:55.612635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f5f02-a53f-4f73-beca-fb3f04f92355 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:55.613048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f5f02-a53f-4f73-beca-fb3f04f92355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:55.613566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f5f02-a53f-4f73-beca-fb3f04f92355 admin admin] PATH_INFO: `/v3/projects/62a8ceb72d38430da081bf1a280ec13a/users/9b559d3676324d118771e07248aee539/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:55.633640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f5f02-a53f-4f73-beca-fb3f04f92355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a8ceb72d38430da081bf1a280ec13a, user_id=9b559d3676324d118771e07248aee539, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:55.636546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f5f02-a53f-4f73-beca-fb3f04f92355 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:55.666654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0edf3-7fa5-4d02-94c9-6b0a2b3bbbb0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:55.667166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0edf3-7fa5-4d02-94c9-6b0a2b3bbbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:55.668732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0edf3-7fa5-4d02-94c9-6b0a2b3bbbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:55.672240 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1068/2137] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:24:55 2022] PUT /identity/v3/projects/62a8ceb72d38430da081bf1a280ec13a/users/9b559d3676324d118771e07248aee539/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:24:55.697826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e1d0edf3-7fa5-4d02-94c9-6b0a2b3bbbb0 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:55.702235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e1d0edf3-7fa5-4d02-94c9-6b0a2b3bbbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:55.831562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1070/2138] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:55.843338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f5f02-a53f-4f73-beca-fb3f04f92355 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:55.845655 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d51f5f02-a53f-4f73-beca-fb3f04f92355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:55.881383 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:55.931347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f5f02-a53f-4f73-beca-fb3f04f92355 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:55.944259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9351d-9807-4ca6-8792-66e2a8ea21c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:55.946734 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9351d-9807-4ca6-8792-66e2a8ea21c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:55.947290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9351d-9807-4ca6-8792-66e2a8ea21c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:55.947629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9351d-9807-4ca6-8792-66e2a8ea21c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:55.959529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9351d-9807-4ca6-8792-66e2a8ea21c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:55.961685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9351d-9807-4ca6-8792-66e2a8ea21c7 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:55.973409 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1069/2139] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:56.873424 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c0cb5-5a7a-4983-8598-febbd08a9a0b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:56.873424 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c0cb5-5a7a-4983-8598-febbd08a9a0b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:56.873424 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c0cb5-5a7a-4983-8598-febbd08a9a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:56.921879 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-526c0cb5-5a7a-4983-8598-febbd08a9a0b None None] MFA Rules not processed for user `9b559d3676324d118771e07248aee539`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:56.923104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-526c0cb5-5a7a-4983-8598-febbd08a9a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:57.045042 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1071/2140] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:57.056824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9351d-9807-4ca6-8792-66e2a8ea21c7 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:57.059234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f7c9351d-9807-4ca6-8792-66e2a8ea21c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:57.130248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9351d-9807-4ca6-8792-66e2a8ea21c7 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:57.136336 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9d4a5-1c99-4c3a-bba9-2f551645fd30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:57.137543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9d4a5-1c99-4c3a-bba9-2f551645fd30 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:57.138044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9d4a5-1c99-4c3a-bba9-2f551645fd30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:57.138521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9d4a5-1c99-4c3a-bba9-2f551645fd30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:57.149566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9d4a5-1c99-4c3a-bba9-2f551645fd30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:57.151493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9d4a5-1c99-4c3a-bba9-2f551645fd30 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:57.165090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1070/2141] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:58.322193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c8629-4dd0-46ee-b612-0c94a755dbd1 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:58.322785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c8629-4dd0-46ee-b612-0c94a755dbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:58.322785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c8629-4dd0-46ee-b612-0c94a755dbd1 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:58.324627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1072/2142] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:24:58.367312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209432f-f962-410e-9d13-6a64b71aaf05 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:58.367910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209432f-f962-410e-9d13-6a64b71aaf05 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:58.367910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209432f-f962-410e-9d13-6a64b71aaf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:58.411109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c209432f-f962-410e-9d13-6a64b71aaf05 None None] MFA Rules not processed for user `dd9eef8921de43f18245f47559f3fa71`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:58.414102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c209432f-f962-410e-9d13-6a64b71aaf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:58.633486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1071/2143] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:24:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:24:58.648814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c8629-4dd0-46ee-b612-0c94a755dbd1 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:58.651055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4d4c8629-4dd0-46ee-b612-0c94a755dbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:58.681974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49369-86ca-456c-a096-bc66520a9c4a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:58.682375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49369-86ca-456c-a096-bc66520a9c4a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:58.682549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49369-86ca-456c-a096-bc66520a9c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:58.700099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c8629-4dd0-46ee-b612-0c94a755dbd1 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:58.721674 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6fd49369-86ca-456c-a096-bc66520a9c4a None None] MFA Rules not processed for user `9b559d3676324d118771e07248aee539`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:58.725361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6fd49369-86ca-456c-a096-bc66520a9c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:58.729632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078fd3d-af97-47ea-9eb9-e051f7b64a6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9eef8921de43f18245f47559f3fa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:58.730278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078fd3d-af97-47ea-9eb9-e051f7b64a6d service placement] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:58.730557 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078fd3d-af97-47ea-9eb9-e051f7b64a6d service placement] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:58.730830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078fd3d-af97-47ea-9eb9-e051f7b64a6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:58.749423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078fd3d-af97-47ea-9eb9-e051f7b64a6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:58.750594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078fd3d-af97-47ea-9eb9-e051f7b64a6d service placement] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:58.766407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1072/2144] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:58.784237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1073/2145] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:59.304391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd49369-86ca-456c-a096-bc66520a9c4a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:59.321402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6fd49369-86ca-456c-a096-bc66520a9c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:59.342083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd49369-86ca-456c-a096-bc66520a9c4a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:59.349145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:59.350012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:59.350465 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:59.350872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] PATH_INFO: `/v3/users/d2bf0ac23ce049608412dc53cba9e1d2` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:59.352211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2bf0ac23ce049608412dc53cba9e1d2)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:59.354947 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:59.378433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4462d-56e1-4944-8b8b-a831f1f1170a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:59.378991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4462d-56e1-4944-8b8b-a831f1f1170a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:59.379266 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4462d-56e1-4944-8b8b-a831f1f1170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:59.424359 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-13f4462d-56e1-4944-8b8b-a831f1f1170a None None] MFA Rules not processed for user `a1be02f9e7fd4bdabc05ec48e2a35f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:24:59.426552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-13f4462d-56e1-4944-8b8b-a831f1f1170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:59.469061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2bf0ac23ce049608412dc53cba9e1d2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:59.471780 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:59.475233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:59.509339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2bf0ac23ce049608412dc53cba9e1d2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:59.510990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2bf0ac23ce049608412dc53cba9e1d2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:59.536282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2bf0ac23ce049608412dc53cba9e1d2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:59.537369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1074/2146] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:24:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:24:59.549686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2bf0ac23ce049608412dc53cba9e1d2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:24:59.551633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4462d-56e1-4944-8b8b-a831f1f1170a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:59.553223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-13f4462d-56e1-4944-8b8b-a831f1f1170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:59.559243 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1073/2147] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:24:59 2022] DELETE /identity/v3/users/d2bf0ac23ce049608412dc53cba9e1d2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:24:59.671487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4462d-56e1-4944-8b8b-a831f1f1170a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:24:59.750680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d1d16-86ab-41b1-a406-4c6be6d415d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:24:59.751659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d1d16-86ab-41b1-a406-4c6be6d415d1 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:24:59.751659 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d1d16-86ab-41b1-a406-4c6be6d415d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:24:59.752041 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d1d16-86ab-41b1-a406-4c6be6d415d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:24:59.753991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e47d1d16-86ab-41b1-a406-4c6be6d415d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:24:59.825460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d1d16-86ab-41b1-a406-4c6be6d415d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:24:59.827112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d1d16-86ab-41b1-a406-4c6be6d415d1 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:24:59.843147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1075/2148] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:24:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:24:59.888037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:24:59.890038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:00.064707 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73fd0a-3bd1-4188-b94e-85ac31037b62 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:00.074349 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:00.075099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:00.075646 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:00.075925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] PATH_INFO: `/v3/projects/bb941c2af4de42f195ef9a9337a520c4` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:00.077649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb941c2af4de42f195ef9a9337a520c4)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:00.079753 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:00.271923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb941c2af4de42f195ef9a9337a520c4', 'request_id': 'req-56ba906a-b732-4df9-bbf7-5389dc16be97'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.292317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb941c2af4de42f195ef9a9337a520c4', 'request_id': 'req-56ba906a-b732-4df9-bbf7-5389dc16be97'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.304869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb941c2af4de42f195ef9a9337a520c4', 'request_id': 'req-56ba906a-b732-4df9-bbf7-5389dc16be97'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.321449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] The token cache is being invalidate because project bb941c2af4de42f195ef9a9337a520c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:25:00.321821 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.335441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.337937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1074/2149] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:24:59 2022] DELETE /identity/v3/projects/bb941c2af4de42f195ef9a9337a520c4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:25:00.349615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d1d16-86ab-41b1-a406-4c6be6d415d1 service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:00.358315 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:00.369977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d1d16-86ab-41b1-a406-4c6be6d415d1 service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:00.496261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:00.499611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:00.643552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46373c1d-2ab3-4832-968b-6d283169481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:00.645917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46373c1d-2ab3-4832-968b-6d283169481f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:00.646721 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46373c1d-2ab3-4832-968b-6d283169481f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:00.647719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46373c1d-2ab3-4832-968b-6d283169481f admin admin] PATH_INFO: `/v3/users/e89b82bf8bdd46bb9af678b8e964cb12` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:00.650306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46373c1d-2ab3-4832-968b-6d283169481f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89b82bf8bdd46bb9af678b8e964cb12)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:00.656895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46373c1d-2ab3-4832-968b-6d283169481f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:00.663887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:00.669780 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba906a-b732-4df9-bbf7-5389dc16be97 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:00.678628 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:00.679663 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:00.680306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:00.680833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] PATH_INFO: `/v3/users/b4f5f26577544225b636f713f6ee3c39` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:00.684267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f5f26577544225b636f713f6ee3c39)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:00.687036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:00.789540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-46373c1d-2ab3-4832-968b-6d283169481f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89b82bf8bdd46bb9af678b8e964cb12'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.790870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-46373c1d-2ab3-4832-968b-6d283169481f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89b82bf8bdd46bb9af678b8e964cb12'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.800127 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-46373c1d-2ab3-4832-968b-6d283169481f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89b82bf8bdd46bb9af678b8e964cb12'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.819249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f5f26577544225b636f713f6ee3c39'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.821298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-46373c1d-2ab3-4832-968b-6d283169481f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89b82bf8bdd46bb9af678b8e964cb12'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.825063 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-46373c1d-2ab3-4832-968b-6d283169481f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89b82bf8bdd46bb9af678b8e964cb12'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.848616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f5f26577544225b636f713f6ee3c39'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.854385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f5f26577544225b636f713f6ee3c39'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.860754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1076/2150] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:25:00 2022] DELETE /identity/v3/users/e89b82bf8bdd46bb9af678b8e964cb12 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:25:00.879767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f5f26577544225b636f713f6ee3c39'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.894903 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f5f26577544225b636f713f6ee3c39'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:00.909221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1075/2151] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:25:00 2022] DELETE /identity/v3/users/b4f5f26577544225b636f713f6ee3c39 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:25:00.913709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56ac89-bf99-4ce6-be62-69a167192ac5 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:00.914113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56ac89-bf99-4ce6-be62-69a167192ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:00.914319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56ac89-bf99-4ce6-be62-69a167192ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:00.944223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5f56ac89-bf99-4ce6-be62-69a167192ac5 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:00.945657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5f56ac89-bf99-4ce6-be62-69a167192ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:01.101845 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1077/2152] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:25:01.127767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:01.127767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:01.245783 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56ac89-bf99-4ce6-be62-69a167192ac5 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:01.248870 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5f56ac89-bf99-4ce6-be62-69a167192ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:01.277027 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56ac89-bf99-4ce6-be62-69a167192ac5 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:01.306772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4bc60-631b-4542-bde5-bd75e47b0aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:01.307443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4bc60-631b-4542-bde5-bd75e47b0aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:01.307724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4bc60-631b-4542-bde5-bd75e47b0aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:01.308001 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4bc60-631b-4542-bde5-bd75e47b0aa2 admin admin] PATH_INFO: `/v3/projects/1fe31235675146b2b676ab03869eb7a8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:01.312253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4bc60-631b-4542-bde5-bd75e47b0aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe31235675146b2b676ab03869eb7a8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:01.320683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4bc60-631b-4542-bde5-bd75e47b0aa2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:01.325679 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54d3cd-1ccc-466f-8690-f2dd0c439d9d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:01.336242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821a680-9139-4894-98c5-e3aa20a2413c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:01.337611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821a680-9139-4894-98c5-e3aa20a2413c service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:01.337898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821a680-9139-4894-98c5-e3aa20a2413c service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:01.338175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821a680-9139-4894-98c5-e3aa20a2413c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:01.368281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821a680-9139-4894-98c5-e3aa20a2413c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:01.369873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821a680-9139-4894-98c5-e3aa20a2413c service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:01.375236 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:01.383136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1076/2153] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:25:01.455199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-01b4bc60-631b-4542-bde5-bd75e47b0aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe31235675146b2b676ab03869eb7a8', 'request_id': 'req-01b4bc60-631b-4542-bde5-bd75e47b0aa2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:01.464003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-01b4bc60-631b-4542-bde5-bd75e47b0aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe31235675146b2b676ab03869eb7a8', 'request_id': 'req-01b4bc60-631b-4542-bde5-bd75e47b0aa2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:01.473776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-01b4bc60-631b-4542-bde5-bd75e47b0aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe31235675146b2b676ab03869eb7a8', 'request_id': 'req-01b4bc60-631b-4542-bde5-bd75e47b0aa2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:01.494988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-01b4bc60-631b-4542-bde5-bd75e47b0aa2 admin admin] The token cache is being invalidate because project 1fe31235675146b2b676ab03869eb7a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:25:01.496234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-01b4bc60-631b-4542-bde5-bd75e47b0aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:01.497664 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-01b4bc60-631b-4542-bde5-bd75e47b0aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:01.499978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1078/2154] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:25:01 2022] DELETE /identity/v3/projects/1fe31235675146b2b676ab03869eb7a8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:25:01.508269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde60233-22a9-4449-b155-11563f56ace6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:01.508269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde60233-22a9-4449-b155-11563f56ace6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:01.508269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde60233-22a9-4449-b155-11563f56ace6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:01.536276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-bde60233-22a9-4449-b155-11563f56ace6 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:01.539226 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bde60233-22a9-4449-b155-11563f56ace6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:01.615709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1077/2155] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:01.623334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf1b8f-2ec6-4467-aefc-8df96cb24c09 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:01.623833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf1b8f-2ec6-4467-aefc-8df96cb24c09 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:01.624661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf1b8f-2ec6-4467-aefc-8df96cb24c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:01.653615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-17bf1b8f-2ec6-4467-aefc-8df96cb24c09 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:01.666379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-17bf1b8f-2ec6-4467-aefc-8df96cb24c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:01.679574 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1079/2156] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:01.683577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde60233-22a9-4449-b155-11563f56ace6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:01.710421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde60233-22a9-4449-b155-11563f56ace6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:01.720433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73908a-6a78-4031-b8f8-0f01ff8db9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:01.721320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73908a-6a78-4031-b8f8-0f01ff8db9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:01.721654 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73908a-6a78-4031-b8f8-0f01ff8db9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:01.722262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73908a-6a78-4031-b8f8-0f01ff8db9c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:01.722773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73908a-6a78-4031-b8f8-0f01ff8db9c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:25:01.723147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73908a-6a78-4031-b8f8-0f01ff8db9c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:01.725094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73908a-6a78-4031-b8f8-0f01ff8db9c8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:01.737930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1078/2157] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:25:01.742300 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf1b8f-2ec6-4467-aefc-8df96cb24c09 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:01.754632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf1b8f-2ec6-4467-aefc-8df96cb24c09 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:01.779882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665f7c1-12f8-46ae-8db1-48c335a1e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:01.780531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665f7c1-12f8-46ae-8db1-48c335a1e19b admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:01.780838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665f7c1-12f8-46ae-8db1-48c335a1e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:01.781110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665f7c1-12f8-46ae-8db1-48c335a1e19b admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:01.781770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665f7c1-12f8-46ae-8db1-48c335a1e19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:01.783729 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665f7c1-12f8-46ae-8db1-48c335a1e19b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:01.799974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73908a-6a78-4031-b8f8-0f01ff8db9c8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:01.802066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7d73908a-6a78-4031-b8f8-0f01ff8db9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:01.816278 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:01.823562 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73908a-6a78-4031-b8f8-0f01ff8db9c8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:01.835640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:01.836473 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:01.836702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:01.837384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] PATH_INFO: `/v3/projects/d75212b13bb84f8d9405945038de0e0f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:01.838645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d75212b13bb84f8d9405945038de0e0f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:01.840614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:01.845608 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1080/2158] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:25:01 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:25:01.849567 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665f7c1-12f8-46ae-8db1-48c335a1e19b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:01.896472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75212b13bb84f8d9405945038de0e0f', 'request_id': 'req-abc8c19c-9268-417a-a396-f541843399f6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:01.913221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75212b13bb84f8d9405945038de0e0f', 'request_id': 'req-abc8c19c-9268-417a-a396-f541843399f6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:01.927398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75212b13bb84f8d9405945038de0e0f', 'request_id': 'req-abc8c19c-9268-417a-a396-f541843399f6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:01.942722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] The token cache is being invalidate because project d75212b13bb84f8d9405945038de0e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:25:01.943139 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:01.943940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:01.956838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1079/2159] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:25:01 2022] DELETE /identity/v3/projects/d75212b13bb84f8d9405945038de0e0f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:25:01.957085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665f7c1-12f8-46ae-8db1-48c335a1e19b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:02.050871 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf8858-f1aa-43c2-baf6-e0f54e66e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:02.051516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf8858-f1aa-43c2-baf6-e0f54e66e9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:02.051800 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf8858-f1aa-43c2-baf6-e0f54e66e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:02.052403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf8858-f1aa-43c2-baf6-e0f54e66e9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:02.053100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf8858-f1aa-43c2-baf6-e0f54e66e9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:02.062967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf8858-f1aa-43c2-baf6-e0f54e66e9e5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:02.111521 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1081/2160] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:25:01 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:25:02.116753 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:02.118267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:02.143188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8c19c-9268-417a-a396-f541843399f6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:02.155476 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819bcb1-1ee2-444e-86c8-9b669650b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:02.156748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819bcb1-1ee2-444e-86c8-9b669650b1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:02.156748 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819bcb1-1ee2-444e-86c8-9b669650b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:02.157026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819bcb1-1ee2-444e-86c8-9b669650b1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:02.171521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819bcb1-1ee2-444e-86c8-9b669650b1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:02.174799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819bcb1-1ee2-444e-86c8-9b669650b1b9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:02.201192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1080/2161] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:25:02.203047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf8858-f1aa-43c2-baf6-e0f54e66e9e5 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:02.215160 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf8858-f1aa-43c2-baf6-e0f54e66e9e5 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:02.220409 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b084be-8910-45d0-967b-b2d287a6d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:02.221225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b084be-8910-45d0-967b-b2d287a6d861 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:02.221381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b084be-8910-45d0-967b-b2d287a6d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:02.221615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b084be-8910-45d0-967b-b2d287a6d861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:02.224338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee392-584a-47cd-81e7-90380c013993 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:02.224821 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee392-584a-47cd-81e7-90380c013993 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:02.225237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee392-584a-47cd-81e7-90380c013993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:02.231200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b084be-8910-45d0-967b-b2d287a6d861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:02.233295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b084be-8910-45d0-967b-b2d287a6d861 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:02.267834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1082/2162] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:25:02.285777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b084be-8910-45d0-967b-b2d287a6d861 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:02.287277 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ff5ee392-584a-47cd-81e7-90380c013993 None None] MFA Rules not processed for user `a1be02f9e7fd4bdabc05ec48e2a35f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:02.289500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ff5ee392-584a-47cd-81e7-90380c013993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:02.293703 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:02.302649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b084be-8910-45d0-967b-b2d287a6d861 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:02.309922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bfe4a-ed6b-4460-bf95-1256cdf6e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:02.310654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bfe4a-ed6b-4460-bf95-1256cdf6e31a admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:02.310937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bfe4a-ed6b-4460-bf95-1256cdf6e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:02.311211 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bfe4a-ed6b-4460-bf95-1256cdf6e31a admin admin] PATH_INFO: `/v3/projects/7344e4cd5e3f41a3baf61f01cb3f3aeb/users/6331f50625b7410faebb462a84f801cb/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:02.345778 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bfe4a-ed6b-4460-bf95-1256cdf6e31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7344e4cd5e3f41a3baf61f01cb3f3aeb, user_id=6331f50625b7410faebb462a84f801cb, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:02.351962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bfe4a-ed6b-4460-bf95-1256cdf6e31a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:02.401506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1083/2163] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:25:02 2022] PUT /identity/v3/projects/7344e4cd5e3f41a3baf61f01cb3f3aeb/users/6331f50625b7410faebb462a84f801cb/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:25:02.413390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa79d-4de9-4c0e-afe4-3db1f2ada1ae None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:02.413963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa79d-4de9-4c0e-afe4-3db1f2ada1ae None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:02.414483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa79d-4de9-4c0e-afe4-3db1f2ada1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:02.429067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1081/2164] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:02.478223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-410fa79d-4de9-4c0e-afe4-3db1f2ada1ae None None] MFA Rules not processed for user `6331f50625b7410faebb462a84f801cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:02.481974 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-410fa79d-4de9-4c0e-afe4-3db1f2ada1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:02.630722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1084/2165] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:02.644867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ee392-584a-47cd-81e7-90380c013993 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:02.646413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ff5ee392-584a-47cd-81e7-90380c013993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:02.729108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ee392-584a-47cd-81e7-90380c013993 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:02.768642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:02.791005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897067e4-5ec1-4f12-bf39-7f1fc8aa4aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:02.791005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897067e4-5ec1-4f12-bf39-7f1fc8aa4aec service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:02.791880 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897067e4-5ec1-4f12-bf39-7f1fc8aa4aec service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:02.792603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897067e4-5ec1-4f12-bf39-7f1fc8aa4aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:02.804930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897067e4-5ec1-4f12-bf39-7f1fc8aa4aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:02.810077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897067e4-5ec1-4f12-bf39-7f1fc8aa4aec service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:02.834073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1082/2166] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:25:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:25:02.843797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa79d-4de9-4c0e-afe4-3db1f2ada1ae None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:02.920024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa79d-4de9-4c0e-afe4-3db1f2ada1ae None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:02.925697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:02.925878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:02.928846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:02.928846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] PATH_INFO: `/v3/users/6331f50625b7410faebb462a84f801cb` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:02.937568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6331f50625b7410faebb462a84f801cb)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:02.939860 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:03.003104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6331f50625b7410faebb462a84f801cb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:03.003772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6331f50625b7410faebb462a84f801cb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:03.013091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6331f50625b7410faebb462a84f801cb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:03.020755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6331f50625b7410faebb462a84f801cb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:03.021464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6331f50625b7410faebb462a84f801cb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:03.027508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:03.055580 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1085/2167] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:25:02 2022] DELETE /identity/v3/users/6331f50625b7410faebb462a84f801cb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:25:03.060329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad4b2c-cb94-4938-8a01-40eb68c53add None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:03.060620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad4b2c-cb94-4938-8a01-40eb68c53add None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:03.061229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad4b2c-cb94-4938-8a01-40eb68c53add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:03.088175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-14ad4b2c-cb94-4938-8a01-40eb68c53add None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:03.089475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-14ad4b2c-cb94-4938-8a01-40eb68c53add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:03.159333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1083/2168] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:25:03.180302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:03.182633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:03.276568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570dbc6-6aa9-41a6-be14-5590a3102369 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:03.281655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750260-c4a2-49b9-855d-cf39533c6b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:03.282985 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750260-c4a2-49b9-855d-cf39533c6b99 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:03.283445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750260-c4a2-49b9-855d-cf39533c6b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:03.284178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750260-c4a2-49b9-855d-cf39533c6b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:03.297791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750260-c4a2-49b9-855d-cf39533c6b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:03.299840 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750260-c4a2-49b9-855d-cf39533c6b99 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:03.318871 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1086/2169] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:25:03.915262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad4b2c-cb94-4938-8a01-40eb68c53add None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:03.919760 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-14ad4b2c-cb94-4938-8a01-40eb68c53add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:03.949393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad4b2c-cb94-4938-8a01-40eb68c53add None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:03.957469 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:03.958310 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:03.958597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:03.959636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6 admin admin] PATH_INFO: `/v3/projects/7344e4cd5e3f41a3baf61f01cb3f3aeb` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:03.961331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7344e4cd5e3f41a3baf61f01cb3f3aeb)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:03.963375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:04.021452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7344e4cd5e3f41a3baf61f01cb3f3aeb', 'request_id': 'req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:04.030453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7344e4cd5e3f41a3baf61f01cb3f3aeb', 'request_id': 'req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:04.037082 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7344e4cd5e3f41a3baf61f01cb3f3aeb', 'request_id': 'req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:04.049371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6 admin admin] The token cache is being invalidate because project 7344e4cd5e3f41a3baf61f01cb3f3aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:25:04.049563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:04.050254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-670f7ef4-6219-48c7-8ca4-3be62f22b5d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:04.052600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1084/2170] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:25:03 2022] DELETE /identity/v3/projects/7344e4cd5e3f41a3baf61f01cb3f3aeb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:25:04.057544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b60ed7-c569-4508-99ce-ca3e41f0f172 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:04.060220 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b60ed7-c569-4508-99ce-ca3e41f0f172 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:04.060526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b60ed7-c569-4508-99ce-ca3e41f0f172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:04.082806 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-64b60ed7-c569-4508-99ce-ca3e41f0f172 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:04.084048 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-64b60ed7-c569-4508-99ce-ca3e41f0f172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:04.157898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1087/2171] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:25:04.169359 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b6038-997c-4dd1-a640-2195ed5bc0a0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:04.169741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b6038-997c-4dd1-a640-2195ed5bc0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:04.170179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b6038-997c-4dd1-a640-2195ed5bc0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:04.197004 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0a7b6038-997c-4dd1-a640-2195ed5bc0a0 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:04.198250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0a7b6038-997c-4dd1-a640-2195ed5bc0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:04.208932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1085/2172] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:04.211251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b60ed7-c569-4508-99ce-ca3e41f0f172 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:04.224538 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b60ed7-c569-4508-99ce-ca3e41f0f172 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:04.231278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9216-7152-442d-9432-f20e4a9dfb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:04.231941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9216-7152-442d-9432-f20e4a9dfb6a admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:04.232287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9216-7152-442d-9432-f20e4a9dfb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:04.232620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9216-7152-442d-9432-f20e4a9dfb6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:04.233389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d9216-7152-442d-9432-f20e4a9dfb6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:25:04.233832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d9216-7152-442d-9432-f20e4a9dfb6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:04.235661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d9216-7152-442d-9432-f20e4a9dfb6a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:04.250567 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1088/2173] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:25:04.257099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b6038-997c-4dd1-a640-2195ed5bc0a0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:04.271485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b6038-997c-4dd1-a640-2195ed5bc0a0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:04.278056 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f4047-24c3-4ae9-9cbd-740afdba7701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:04.278731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f4047-24c3-4ae9-9cbd-740afdba7701 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:04.279016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f4047-24c3-4ae9-9cbd-740afdba7701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:04.279293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f4047-24c3-4ae9-9cbd-740afdba7701 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:04.284991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f4047-24c3-4ae9-9cbd-740afdba7701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:04.288069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f4047-24c3-4ae9-9cbd-740afdba7701 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:04.324758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1086/2174] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:25:04 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:25:04.328268 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9216-7152-442d-9432-f20e4a9dfb6a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:04.339778 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9216-7152-442d-9432-f20e4a9dfb6a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:04.463805 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332ad1f-aadd-44a9-b549-30d6e23a3d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:04.464343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332ad1f-aadd-44a9-b549-30d6e23a3d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:04.464624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332ad1f-aadd-44a9-b549-30d6e23a3d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:04.464960 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332ad1f-aadd-44a9-b549-30d6e23a3d73 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:04.465707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332ad1f-aadd-44a9-b549-30d6e23a3d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:04.471020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332ad1f-aadd-44a9-b549-30d6e23a3d73 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:04.540113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1089/2175] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:25:04 2022] POST /identity/v3/users => generated 284 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:25:04.544221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f4047-24c3-4ae9-9cbd-740afdba7701 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:04.563873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f4047-24c3-4ae9-9cbd-740afdba7701 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:04.570615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a18da3-4b24-482f-8eba-240a7bbd92f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:04.571422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a18da3-4b24-482f-8eba-240a7bbd92f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:04.571701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a18da3-4b24-482f-8eba-240a7bbd92f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:04.571972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a18da3-4b24-482f-8eba-240a7bbd92f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:04.574026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a18da3-4b24-482f-8eba-240a7bbd92f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:04.576607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a18da3-4b24-482f-8eba-240a7bbd92f2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:04.592467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1087/2176] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:25:04.594362 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332ad1f-aadd-44a9-b549-30d6e23a3d73 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:04.614174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332ad1f-aadd-44a9-b549-30d6e23a3d73 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:04.657588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1852f-d809-45fc-88cd-e98ac2e700c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:04.658235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1852f-d809-45fc-88cd-e98ac2e700c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:04.658518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1852f-d809-45fc-88cd-e98ac2e700c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:04.658791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1852f-d809-45fc-88cd-e98ac2e700c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:04.659454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1852f-d809-45fc-88cd-e98ac2e700c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:04.661249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1852f-d809-45fc-88cd-e98ac2e700c8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:04.662833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:04.701259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1090/2177] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:25:04.702688 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a18da3-4b24-482f-8eba-240a7bbd92f2 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:04.719839 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a18da3-4b24-482f-8eba-240a7bbd92f2 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:04.742378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b08a9d-6246-4db4-8c92-b20866f136f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:04.743093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b08a9d-6246-4db4-8c92-b20866f136f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:04.743309 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b08a9d-6246-4db4-8c92-b20866f136f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:04.743605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b08a9d-6246-4db4-8c92-b20866f136f5 admin admin] PATH_INFO: `/v3/projects/d3c8566bd6da4478a3743ffe499e9ff1/users/bc89c03bd8fd45e7b35dbe0a05d2be54/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:04.784015 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b08a9d-6246-4db4-8c92-b20866f136f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c8566bd6da4478a3743ffe499e9ff1, user_id=bc89c03bd8fd45e7b35dbe0a05d2be54, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:04.787827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b08a9d-6246-4db4-8c92-b20866f136f5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:04.799779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:04.806578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1088/2178] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:25:04 2022] PUT /identity/v3/projects/d3c8566bd6da4478a3743ffe499e9ff1/users/bc89c03bd8fd45e7b35dbe0a05d2be54/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:25:04.817702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0f64a-25cb-4b69-b6ea-1474f147ee77 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:04.817987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0f64a-25cb-4b69-b6ea-1474f147ee77 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:04.818263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0f64a-25cb-4b69-b6ea-1474f147ee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:04.881051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-22c0f64a-25cb-4b69-b6ea-1474f147ee77 None None] MFA Rules not processed for user `bc89c03bd8fd45e7b35dbe0a05d2be54`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:04.882252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-22c0f64a-25cb-4b69-b6ea-1474f147ee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:04.992636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1091/2179] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:04.999969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b08a9d-6246-4db4-8c92-b20866f136f5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:05.002641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-48b08a9d-6246-4db4-8c92-b20866f136f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:05.094197 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b08a9d-6246-4db4-8c92-b20866f136f5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:05.098337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd094f-69d9-491a-ab62-58a947b197cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ee7b50c34742ce896a734f3ef34a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:05.098999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd094f-69d9-491a-ab62-58a947b197cb service glance] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:05.099285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd094f-69d9-491a-ab62-58a947b197cb service glance] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:05.099565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd094f-69d9-491a-ab62-58a947b197cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:05.109544 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd094f-69d9-491a-ab62-58a947b197cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:05.112123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd094f-69d9-491a-ab62-58a947b197cb service glance] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:05.130850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1089/2180] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:25:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:25:14.982689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=34 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:15.119400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=26 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:15.328634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0f64a-25cb-4b69-b6ea-1474f147ee77 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:15.330486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-22c0f64a-25cb-4b69-b6ea-1474f147ee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:15.400680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0f64a-25cb-4b69-b6ea-1474f147ee77 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:15.405649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:15.406280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:15.406554 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:15.406826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] PATH_INFO: `/v3/users/ddf561a77e1c4400930ab693bcdd6345` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:15.407982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf561a77e1c4400930ab693bcdd6345)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:15.409952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:15.460918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf561a77e1c4400930ab693bcdd6345'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:15.461569 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf561a77e1c4400930ab693bcdd6345'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:15.469835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf561a77e1c4400930ab693bcdd6345'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:15.476775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf561a77e1c4400930ab693bcdd6345'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:15.477432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf561a77e1c4400930ab693bcdd6345'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:15.495078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1092/2181] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:25:15 2022] DELETE /identity/v3/users/ddf561a77e1c4400930ab693bcdd6345 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:25:15.499775 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f079236-92e7-4708-b619-ce5e16dd3351 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:15.500143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f079236-92e7-4708-b619-ce5e16dd3351 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:15.500422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f079236-92e7-4708-b619-ce5e16dd3351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:15.520823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2f079236-92e7-4708-b619-ce5e16dd3351 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:15.521968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2f079236-92e7-4708-b619-ce5e16dd3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:15.583143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1090/2182] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:15.593366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:15.594860 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:15.657786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90052ed8-40ad-42cc-84ce-d8ea80694fb3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:15.661671 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18789b55-3da7-447a-b611-7570bb409a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:15.662292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18789b55-3da7-447a-b611-7570bb409a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:15.662568 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18789b55-3da7-447a-b611-7570bb409a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:15.662838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18789b55-3da7-447a-b611-7570bb409a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:15.673717 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18789b55-3da7-447a-b611-7570bb409a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:15.675762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18789b55-3da7-447a-b611-7570bb409a86 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:15.689561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1093/2183] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:25:15.997718 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f079236-92e7-4708-b619-ce5e16dd3351 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:15.999272 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2f079236-92e7-4708-b619-ce5e16dd3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:16.013092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f079236-92e7-4708-b619-ce5e16dd3351 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:16.018434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d1769-88af-4ff8-98bb-f520caf877ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:16.019214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d1769-88af-4ff8-98bb-f520caf877ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:16.019492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d1769-88af-4ff8-98bb-f520caf877ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:16.019771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d1769-88af-4ff8-98bb-f520caf877ec admin admin] PATH_INFO: `/v3/projects/ac20d8460a184be2ac6463f1191fc1cd` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:16.022139 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d1769-88af-4ff8-98bb-f520caf877ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac20d8460a184be2ac6463f1191fc1cd)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:16.023995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d1769-88af-4ff8-98bb-f520caf877ec admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:16.076289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d8d1769-88af-4ff8-98bb-f520caf877ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac20d8460a184be2ac6463f1191fc1cd', 'request_id': 'req-1d8d1769-88af-4ff8-98bb-f520caf877ec'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:16.084227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d8d1769-88af-4ff8-98bb-f520caf877ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac20d8460a184be2ac6463f1191fc1cd', 'request_id': 'req-1d8d1769-88af-4ff8-98bb-f520caf877ec'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:16.092290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d8d1769-88af-4ff8-98bb-f520caf877ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac20d8460a184be2ac6463f1191fc1cd', 'request_id': 'req-1d8d1769-88af-4ff8-98bb-f520caf877ec'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:16.106028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d8d1769-88af-4ff8-98bb-f520caf877ec admin admin] The token cache is being invalidate because project ac20d8460a184be2ac6463f1191fc1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:25:16.106316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d8d1769-88af-4ff8-98bb-f520caf877ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:16.107013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d8d1769-88af-4ff8-98bb-f520caf877ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:16.108584 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1091/2184] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:25:15 2022] DELETE /identity/v3/projects/ac20d8460a184be2ac6463f1191fc1cd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:25:16.115694 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a4e67-24bc-4f5f-95cf-ab1b4fc388aa None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:16.116190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a4e67-24bc-4f5f-95cf-ab1b4fc388aa None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:16.116270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a4e67-24bc-4f5f-95cf-ab1b4fc388aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:16.136967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-196a4e67-24bc-4f5f-95cf-ab1b4fc388aa None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:16.138393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-196a4e67-24bc-4f5f-95cf-ab1b4fc388aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:16.160797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:16.223415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1094/2185] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:16.231322 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275df4-b9a0-49da-8457-5167e2cce564 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:16.231857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275df4-b9a0-49da-8457-5167e2cce564 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:16.232092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275df4-b9a0-49da-8457-5167e2cce564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:16.258185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-35275df4-b9a0-49da-8457-5167e2cce564 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:16.259402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-35275df4-b9a0-49da-8457-5167e2cce564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:16.267866 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1092/2186] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:16.272242 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a4e67-24bc-4f5f-95cf-ab1b4fc388aa None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:16.281987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a4e67-24bc-4f5f-95cf-ab1b4fc388aa None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:16.286831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f1f8-d1a9-49aa-897b-0ff1726412f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:16.287434 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f1f8-d1a9-49aa-897b-0ff1726412f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:16.287714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f1f8-d1a9-49aa-897b-0ff1726412f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:16.288009 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f1f8-d1a9-49aa-897b-0ff1726412f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:16.288743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f1f8-d1a9-49aa-897b-0ff1726412f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:25:16.289058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f1f8-d1a9-49aa-897b-0ff1726412f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:16.290746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f1f8-d1a9-49aa-897b-0ff1726412f8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:16.304745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1095/2187] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:25:16.307579 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35275df4-b9a0-49da-8457-5167e2cce564 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:16.317609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35275df4-b9a0-49da-8457-5167e2cce564 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:16.322561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa3211-8f60-4b84-9d78-10c81a0f365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:16.323109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa3211-8f60-4b84-9d78-10c81a0f365e admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:16.323384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa3211-8f60-4b84-9d78-10c81a0f365e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:16.323697 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa3211-8f60-4b84-9d78-10c81a0f365e admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:16.324344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa3211-8f60-4b84-9d78-10c81a0f365e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:16.326325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa3211-8f60-4b84-9d78-10c81a0f365e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:16.360961 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1093/2188] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:25:16 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:25:16.362144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f1f8-d1a9-49aa-897b-0ff1726412f8 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:16.372765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f1f8-d1a9-49aa-897b-0ff1726412f8 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:16.431816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f57128-fe7d-4c32-ad73-0e5a729385b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:16.432523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57128-fe7d-4c32-ad73-0e5a729385b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:16.432861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57128-fe7d-4c32-ad73-0e5a729385b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:16.433130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57128-fe7d-4c32-ad73-0e5a729385b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:16.433772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f57128-fe7d-4c32-ad73-0e5a729385b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:16.436087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f57128-fe7d-4c32-ad73-0e5a729385b2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:16.460283 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1096/2189] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:25:16 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:25:16.464522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa3211-8f60-4b84-9d78-10c81a0f365e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:16.476660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa3211-8f60-4b84-9d78-10c81a0f365e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:16.485169 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6153182-fb09-41bd-ab8f-c6e60a86914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:16.485812 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6153182-fb09-41bd-ab8f-c6e60a86914a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:16.486095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6153182-fb09-41bd-ab8f-c6e60a86914a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:16.486376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6153182-fb09-41bd-ab8f-c6e60a86914a admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:16.487235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6153182-fb09-41bd-ab8f-c6e60a86914a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:16.489067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6153182-fb09-41bd-ab8f-c6e60a86914a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:16.501484 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1094/2190] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:25:16.505206 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f57128-fe7d-4c32-ad73-0e5a729385b2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:16.517792 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f57128-fe7d-4c32-ad73-0e5a729385b2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:16.530202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d565a-d165-410f-af71-ebe2658cca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:16.531059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d565a-d165-410f-af71-ebe2658cca61 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:16.531489 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d565a-d165-410f-af71-ebe2658cca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:16.531910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d565a-d165-410f-af71-ebe2658cca61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:16.532862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d565a-d165-410f-af71-ebe2658cca61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:16.537551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d565a-d165-410f-af71-ebe2658cca61 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:16.548519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1097/2191] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:25:16.552832 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6153182-fb09-41bd-ab8f-c6e60a86914a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:16.568262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6153182-fb09-41bd-ab8f-c6e60a86914a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:16.575384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eba3c-3f93-400b-b9cc-7cc9c32f0659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:16.576086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eba3c-3f93-400b-b9cc-7cc9c32f0659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:16.576348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eba3c-3f93-400b-b9cc-7cc9c32f0659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:16.576801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eba3c-3f93-400b-b9cc-7cc9c32f0659 admin admin] PATH_INFO: `/v3/projects/44c9832086724954853fc474a2a92747/users/deb80cf02c84476182960a91d69b6da1/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:16.594192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eba3c-3f93-400b-b9cc-7cc9c32f0659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c9832086724954853fc474a2a92747, user_id=deb80cf02c84476182960a91d69b6da1, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:16.600427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eba3c-3f93-400b-b9cc-7cc9c32f0659 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:16.619352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1095/2192] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:25:16 2022] PUT /identity/v3/projects/44c9832086724954853fc474a2a92747/users/deb80cf02c84476182960a91d69b6da1/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:25:16.624337 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889eed8-d222-4fcd-9818-f2ae4ae4658a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:16.624669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889eed8-d222-4fcd-9818-f2ae4ae4658a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:16.625002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889eed8-d222-4fcd-9818-f2ae4ae4658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:16.648773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0889eed8-d222-4fcd-9818-f2ae4ae4658a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:16.650018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0889eed8-d222-4fcd-9818-f2ae4ae4658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:16.715748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1098/2193] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:25:16.725407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eba3c-3f93-400b-b9cc-7cc9c32f0659 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:16.727170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cf1eba3c-3f93-400b-b9cc-7cc9c32f0659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:16.750686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:16.789417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eba3c-3f93-400b-b9cc-7cc9c32f0659 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:16.793707 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6e3dc-2815-4b26-8c81-72050da95961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:16.794380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6e3dc-2815-4b26-8c81-72050da95961 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:16.794658 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6e3dc-2815-4b26-8c81-72050da95961 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:16.794991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6e3dc-2815-4b26-8c81-72050da95961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:16.804590 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6e3dc-2815-4b26-8c81-72050da95961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:16.806081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6e3dc-2815-4b26-8c81-72050da95961 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:16.815745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1096/2194] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:25:21.898501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c86280-05e4-4950-8650-b2256a1942c3 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:21.898942 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c86280-05e4-4950-8650-b2256a1942c3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:21.899570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c86280-05e4-4950-8650-b2256a1942c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:21.935602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b9c86280-05e4-4950-8650-b2256a1942c3 None None] MFA Rules not processed for user `9b559d3676324d118771e07248aee539`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:21.936966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b9c86280-05e4-4950-8650-b2256a1942c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:21.970224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:22.012204 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1099/2195] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:23.016108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d1966-9942-443d-bfe0-8bb4f94b3759 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:23.016613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d1966-9942-443d-bfe0-8bb4f94b3759 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:23.016907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d1966-9942-443d-bfe0-8bb4f94b3759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:23.052840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-163d1966-9942-443d-bfe0-8bb4f94b3759 None None] MFA Rules not processed for user `deb80cf02c84476182960a91d69b6da1`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:23.054254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-163d1966-9942-443d-bfe0-8bb4f94b3759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:23.130332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1097/2196] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:23.135047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c86280-05e4-4950-8650-b2256a1942c3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:23.147413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c86280-05e4-4950-8650-b2256a1942c3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:23.152709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c690372-419c-4c37-81b0-c69e9c5e7241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:23.153410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c690372-419c-4c37-81b0-c69e9c5e7241 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:23.153760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c690372-419c-4c37-81b0-c69e9c5e7241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:23.154038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c690372-419c-4c37-81b0-c69e9c5e7241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:23.154686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c690372-419c-4c37-81b0-c69e9c5e7241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:23.156661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c690372-419c-4c37-81b0-c69e9c5e7241 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:23.190136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1100/2197] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:25:23 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:25:23.191164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d1966-9942-443d-bfe0-8bb4f94b3759 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:23.207675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d1966-9942-443d-bfe0-8bb4f94b3759 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:23.273361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c40691-8896-4752-8a2a-8c708ac2ba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:23.273997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c40691-8896-4752-8a2a-8c708ac2ba61 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:23.274281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c40691-8896-4752-8a2a-8c708ac2ba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:23.274555 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c40691-8896-4752-8a2a-8c708ac2ba61 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:23.275320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c40691-8896-4752-8a2a-8c708ac2ba61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:23.277320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c40691-8896-4752-8a2a-8c708ac2ba61 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:23.301971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1098/2198] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:25:23 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:25:23.307646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c690372-419c-4c37-81b0-c69e9c5e7241 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:23.318505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c690372-419c-4c37-81b0-c69e9c5e7241 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:23.324693 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36095bc0-af66-4681-a279-e2065ea8abdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:23.325462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36095bc0-af66-4681-a279-e2065ea8abdf admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:23.325855 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36095bc0-af66-4681-a279-e2065ea8abdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:23.326129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36095bc0-af66-4681-a279-e2065ea8abdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:23.326780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36095bc0-af66-4681-a279-e2065ea8abdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:23.328450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36095bc0-af66-4681-a279-e2065ea8abdf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:23.339304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1101/2199] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:25:23.343572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c40691-8896-4752-8a2a-8c708ac2ba61 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:23.355721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c40691-8896-4752-8a2a-8c708ac2ba61 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:23.360841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa2a54-1b90-46f7-8693-8077d3cfbbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:23.361700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa2a54-1b90-46f7-8693-8077d3cfbbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:23.361978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa2a54-1b90-46f7-8693-8077d3cfbbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:23.362253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa2a54-1b90-46f7-8693-8077d3cfbbc9 admin admin] PATH_INFO: `/v3/projects/f82958cab68c4da0b6dd1898892d0025/users/fad46c549d3246108c63a9f9fcfce754/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:23.382678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa2a54-1b90-46f7-8693-8077d3cfbbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82958cab68c4da0b6dd1898892d0025, user_id=fad46c549d3246108c63a9f9fcfce754, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:23.386175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa2a54-1b90-46f7-8693-8077d3cfbbc9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:23.406494 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1099/2200] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:25:23 2022] PUT /identity/v3/projects/f82958cab68c4da0b6dd1898892d0025/users/fad46c549d3246108c63a9f9fcfce754/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:25:23.407617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36095bc0-af66-4681-a279-e2065ea8abdf admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:23.421314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36095bc0-af66-4681-a279-e2065ea8abdf admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:23.483308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7070f2d-a63c-41bc-bdd6-dc4092432c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:23.483534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7070f2d-a63c-41bc-bdd6-dc4092432c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:23.483769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7070f2d-a63c-41bc-bdd6-dc4092432c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:23.483976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7070f2d-a63c-41bc-bdd6-dc4092432c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:23.484644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7070f2d-a63c-41bc-bdd6-dc4092432c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:23.486324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7070f2d-a63c-41bc-bdd6-dc4092432c04 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:23.500597 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1102/2201] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:25:23.503267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa2a54-1b90-46f7-8693-8077d3cfbbc9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:23.519431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa2a54-1b90-46f7-8693-8077d3cfbbc9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:23.526825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb9d0b-168d-4a8b-88f1-70e280379665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:23.527507 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb9d0b-168d-4a8b-88f1-70e280379665 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:23.527785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb9d0b-168d-4a8b-88f1-70e280379665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:23.528053 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb9d0b-168d-4a8b-88f1-70e280379665 admin admin] PATH_INFO: `/v3/projects/f82958cab68c4da0b6dd1898892d0025/users/fad46c549d3246108c63a9f9fcfce754/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:23.530078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb9d0b-168d-4a8b-88f1-70e280379665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82958cab68c4da0b6dd1898892d0025, user_id=fad46c549d3246108c63a9f9fcfce754, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:23.532737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb9d0b-168d-4a8b-88f1-70e280379665 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:23.543677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1100/2202] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:25:23 2022] PUT /identity/v3/projects/f82958cab68c4da0b6dd1898892d0025/users/fad46c549d3246108c63a9f9fcfce754/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:25:29.748366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c342447-9fd6-4a17-a4c9-c94a2be6b9aa None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:29.748860 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c342447-9fd6-4a17-a4c9-c94a2be6b9aa None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:29.749237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c342447-9fd6-4a17-a4c9-c94a2be6b9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:29.782890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3c342447-9fd6-4a17-a4c9-c94a2be6b9aa None None] MFA Rules not processed for user `fad46c549d3246108c63a9f9fcfce754`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:29.784783 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3c342447-9fd6-4a17-a4c9-c94a2be6b9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:29.881102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1103/2203] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:29.895685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb9d0b-168d-4a8b-88f1-70e280379665 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:29.897572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ecbb9d0b-168d-4a8b-88f1-70e280379665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:29.904409 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:30.006429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb9d0b-168d-4a8b-88f1-70e280379665 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:30.014444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d75ba3-0bd2-44aa-90f8-1a45d276b8fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:30.017361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75ba3-0bd2-44aa-90f8-1a45d276b8fa service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:30.017783 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75ba3-0bd2-44aa-90f8-1a45d276b8fa service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:30.018150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75ba3-0bd2-44aa-90f8-1a45d276b8fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:30.124952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d75ba3-0bd2-44aa-90f8-1a45d276b8fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:30.126681 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d75ba3-0bd2-44aa-90f8-1a45d276b8fa service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:30.149132 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1101/2204] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:25:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:25:39.876397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:40.134221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=54 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:44.619348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c342447-9fd6-4a17-a4c9-c94a2be6b9aa None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:44.621047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3c342447-9fd6-4a17-a4c9-c94a2be6b9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:44.711426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c342447-9fd6-4a17-a4c9-c94a2be6b9aa None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:44.716785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:44.717745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:44.718031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:44.718309 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] PATH_INFO: `/v3/users/bc89c03bd8fd45e7b35dbe0a05d2be54` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:44.719602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc89c03bd8fd45e7b35dbe0a05d2be54)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:44.721616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:44.775007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc89c03bd8fd45e7b35dbe0a05d2be54'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:44.775838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc89c03bd8fd45e7b35dbe0a05d2be54'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:44.783783 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc89c03bd8fd45e7b35dbe0a05d2be54'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:44.791235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc89c03bd8fd45e7b35dbe0a05d2be54'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:44.791894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc89c03bd8fd45e7b35dbe0a05d2be54'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:44.808970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1104/2205] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:25:44 2022] DELETE /identity/v3/users/bc89c03bd8fd45e7b35dbe0a05d2be54 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:25:44.813698 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284e267-131b-42b0-b21f-7dbefd2fd249 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:44.814180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284e267-131b-42b0-b21f-7dbefd2fd249 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:44.814329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284e267-131b-42b0-b21f-7dbefd2fd249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:44.833164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9284e267-131b-42b0-b21f-7dbefd2fd249 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:44.834386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9284e267-131b-42b0-b21f-7dbefd2fd249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:44.897108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1102/2206] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:25:44.911113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:44.912616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:44.974218 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a30b88-3420-46bd-8a90-ecd80079b273 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:44.981502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a495215-1668-48e0-80b7-7c5e2b5c54cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:44.982118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a495215-1668-48e0-80b7-7c5e2b5c54cc service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:44.982252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a495215-1668-48e0-80b7-7c5e2b5c54cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:44.982527 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a495215-1668-48e0-80b7-7c5e2b5c54cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:44.996779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a495215-1668-48e0-80b7-7c5e2b5c54cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:44.998354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a495215-1668-48e0-80b7-7c5e2b5c54cc service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:45.009371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1105/2207] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:25:45.572801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284e267-131b-42b0-b21f-7dbefd2fd249 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:45.574381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9284e267-131b-42b0-b21f-7dbefd2fd249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:45.595671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284e267-131b-42b0-b21f-7dbefd2fd249 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:45.605261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:45.605261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:45.605261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:45.605668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4 admin admin] PATH_INFO: `/v3/projects/d3c8566bd6da4478a3743ffe499e9ff1` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:45.607083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c8566bd6da4478a3743ffe499e9ff1)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:45.618605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:45.685670 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c8566bd6da4478a3743ffe499e9ff1', 'request_id': 'req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:45.693718 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c8566bd6da4478a3743ffe499e9ff1', 'request_id': 'req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:45.700693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c8566bd6da4478a3743ffe499e9ff1', 'request_id': 'req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:45.712551 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4 admin admin] The token cache is being invalidate because project d3c8566bd6da4478a3743ffe499e9ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:25:45.712908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:45.716611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-74f9e2af-9fed-4b0f-a2a8-03b4b26a56c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:25:45.716611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1103/2208] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:25:45 2022] DELETE /identity/v3/projects/d3c8566bd6da4478a3743ffe499e9ff1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:25:45.721625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e76ef-4262-4121-8960-2029753d6c27 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:45.722210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e76ef-4262-4121-8960-2029753d6c27 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:45.722210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e76ef-4262-4121-8960-2029753d6c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:45.742145 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-023e76ef-4262-4121-8960-2029753d6c27 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:45.743363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-023e76ef-4262-4121-8960-2029753d6c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:45.762630 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:45.811743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1106/2209] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:25:45.819838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897551fe-e812-4453-90c1-2aee8eb95325 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:45.820505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897551fe-e812-4453-90c1-2aee8eb95325 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:45.820505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897551fe-e812-4453-90c1-2aee8eb95325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:45.839987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-897551fe-e812-4453-90c1-2aee8eb95325 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:45.841245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-897551fe-e812-4453-90c1-2aee8eb95325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:45.856952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1104/2210] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:45.857534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c904419-3691-4a2d-9fc5-5d664d0e06c1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:45.857825 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c904419-3691-4a2d-9fc5-5d664d0e06c1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:45.858098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c904419-3691-4a2d-9fc5-5d664d0e06c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:45.859898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897551fe-e812-4453-90c1-2aee8eb95325 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:45.874246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897551fe-e812-4453-90c1-2aee8eb95325 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:45.879824 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4c904419-3691-4a2d-9fc5-5d664d0e06c1 None None] MFA Rules not processed for user `c78657cb0d4144cfaf0a7be1e3388ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:45.881478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4c904419-3691-4a2d-9fc5-5d664d0e06c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:45.882520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a7760-e31a-48f3-bec2-6da76e4fb4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:45.883236 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a7760-e31a-48f3-bec2-6da76e4fb4ec admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:45.883538 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a7760-e31a-48f3-bec2-6da76e4fb4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:45.883832 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a7760-e31a-48f3-bec2-6da76e4fb4ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:45.884556 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a7760-e31a-48f3-bec2-6da76e4fb4ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:25:45.884963 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a7760-e31a-48f3-bec2-6da76e4fb4ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:45.886687 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a7760-e31a-48f3-bec2-6da76e4fb4ec admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:45.900010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1105/2211] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:25:45.904990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a7760-e31a-48f3-bec2-6da76e4fb4ec admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:45.915017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a7760-e31a-48f3-bec2-6da76e4fb4ec admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:45.919997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68863b-fe23-4bac-831c-2c30d9148db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:45.920615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68863b-fe23-4bac-831c-2c30d9148db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:45.920929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68863b-fe23-4bac-831c-2c30d9148db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:45.921235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68863b-fe23-4bac-831c-2c30d9148db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:45.921878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68863b-fe23-4bac-831c-2c30d9148db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:45.923875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68863b-fe23-4bac-831c-2c30d9148db6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:45.947215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1107/2212] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:25:45.959152 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1106/2213] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:25:45 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:25:45.963320 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c904419-3691-4a2d-9fc5-5d664d0e06c1 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:45.974785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c904419-3691-4a2d-9fc5-5d664d0e06c1 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:46.031618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8440b61-1c95-4670-aea1-6f05f871e14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:46.032264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8440b61-1c95-4670-aea1-6f05f871e14c admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:46.032543 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8440b61-1c95-4670-aea1-6f05f871e14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:46.032851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8440b61-1c95-4670-aea1-6f05f871e14c admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:46.033484 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8440b61-1c95-4670-aea1-6f05f871e14c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:46.035445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8440b61-1c95-4670-aea1-6f05f871e14c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:46.060402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1108/2214] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:25:45 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:25:46.064682 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68863b-fe23-4bac-831c-2c30d9148db6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:46.075609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68863b-fe23-4bac-831c-2c30d9148db6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:46.080130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e162b7-93eb-44d4-b354-4031ab05a95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:46.080742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e162b7-93eb-44d4-b354-4031ab05a95d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:46.081437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e162b7-93eb-44d4-b354-4031ab05a95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:46.081437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e162b7-93eb-44d4-b354-4031ab05a95d admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:46.082124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e162b7-93eb-44d4-b354-4031ab05a95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:46.083734 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e162b7-93eb-44d4-b354-4031ab05a95d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:46.094575 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1107/2215] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:25:46.098535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8440b61-1c95-4670-aea1-6f05f871e14c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:46.115022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8440b61-1c95-4670-aea1-6f05f871e14c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:46.119799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d96a0-a4c3-40fd-8ffc-ef7ec4c1dca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:46.120510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d96a0-a4c3-40fd-8ffc-ef7ec4c1dca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:46.120892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d96a0-a4c3-40fd-8ffc-ef7ec4c1dca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:46.121234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d96a0-a4c3-40fd-8ffc-ef7ec4c1dca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:46.121976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d96a0-a4c3-40fd-8ffc-ef7ec4c1dca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:46.123674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d96a0-a4c3-40fd-8ffc-ef7ec4c1dca1 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:46.137297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1109/2216] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:25:46.138346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e162b7-93eb-44d4-b354-4031ab05a95d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:46.149350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e162b7-93eb-44d4-b354-4031ab05a95d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:46.153909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1ae18-baa9-4906-b10f-90a61386e007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:46.154613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1ae18-baa9-4906-b10f-90a61386e007 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:46.154887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1ae18-baa9-4906-b10f-90a61386e007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:46.155154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1ae18-baa9-4906-b10f-90a61386e007 admin admin] PATH_INFO: `/v3/projects/1b7e87f26c6748f3a55767285de31cde/users/0c70c266fe3a46ebad73127c1f1e5c61/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:46.170597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1ae18-baa9-4906-b10f-90a61386e007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7e87f26c6748f3a55767285de31cde, user_id=0c70c266fe3a46ebad73127c1f1e5c61, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:46.173453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1ae18-baa9-4906-b10f-90a61386e007 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:46.188586 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1108/2217] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:25:46 2022] PUT /identity/v3/projects/1b7e87f26c6748f3a55767285de31cde/users/0c70c266fe3a46ebad73127c1f1e5c61/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:25:46.199026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e2826-054a-42ca-826b-0694081f05e6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:46.199419 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e2826-054a-42ca-826b-0694081f05e6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:46.199769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e2826-054a-42ca-826b-0694081f05e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:46.228054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2d9e2826-054a-42ca-826b-0694081f05e6 None None] MFA Rules not processed for user `0c70c266fe3a46ebad73127c1f1e5c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:46.229347 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2d9e2826-054a-42ca-826b-0694081f05e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:46.265341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:46.299539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1110/2218] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:46.310527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1ae18-baa9-4906-b10f-90a61386e007 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:46.312296 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c4b1ae18-baa9-4906-b10f-90a61386e007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:46.324263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:46.407583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1ae18-baa9-4906-b10f-90a61386e007 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:46.411942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432255e-de7c-4894-987e-f9051ca7cd01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:46.412706 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432255e-de7c-4894-987e-f9051ca7cd01 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:46.413135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432255e-de7c-4894-987e-f9051ca7cd01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:46.413503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432255e-de7c-4894-987e-f9051ca7cd01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:46.422843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432255e-de7c-4894-987e-f9051ca7cd01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:46.424473 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432255e-de7c-4894-987e-f9051ca7cd01 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:46.437448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1109/2219] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:25:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:25:47.946940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a98ea-e197-4e2f-acbd-6c8dc2099602 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:47.947482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a98ea-e197-4e2f-acbd-6c8dc2099602 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:47.947482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a98ea-e197-4e2f-acbd-6c8dc2099602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:47.968103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d78a98ea-e197-4e2f-acbd-6c8dc2099602 None None] MFA Rules not processed for user `0c70c266fe3a46ebad73127c1f1e5c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:47.969347 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d78a98ea-e197-4e2f-acbd-6c8dc2099602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:47.976409 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1111/2220] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:54.297012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe635c-74c5-423c-b198-49433f66c7b3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:54.297494 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe635c-74c5-423c-b198-49433f66c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:54.297720 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe635c-74c5-423c-b198-49433f66c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:54.309115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091db03-5d1d-4eaf-9815-4d1a684a680f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:54.309558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091db03-5d1d-4eaf-9815-4d1a684a680f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:54.309974 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091db03-5d1d-4eaf-9815-4d1a684a680f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:54.317241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b1fe635c-74c5-423c-b198-49433f66c7b3 None None] MFA Rules not processed for user `deb80cf02c84476182960a91d69b6da1`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:54.319515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b1fe635c-74c5-423c-b198-49433f66c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:54.330366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3091db03-5d1d-4eaf-9815-4d1a684a680f None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:54.331637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3091db03-5d1d-4eaf-9815-4d1a684a680f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:54.376383 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1110/2221] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:25:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:54.389175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1112/2222] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:25:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:25:54.432754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe635c-74c5-423c-b198-49433f66c7b3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:54.434452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b1fe635c-74c5-423c-b198-49433f66c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:54.510191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe635c-74c5-423c-b198-49433f66c7b3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:54.515344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26b13f-c137-4857-9687-ed55becfaea9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:54.515971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26b13f-c137-4857-9687-ed55becfaea9 service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:54.516265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26b13f-c137-4857-9687-ed55becfaea9 service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:54.516537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26b13f-c137-4857-9687-ed55becfaea9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:54.526115 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26b13f-c137-4857-9687-ed55becfaea9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:54.527719 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26b13f-c137-4857-9687-ed55becfaea9 service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:54.536430 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1111/2223] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:25:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:25:58.843047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601f94-ec5c-4aed-812c-10784ac13acc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:58.844796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601f94-ec5c-4aed-812c-10784ac13acc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:58.845223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601f94-ec5c-4aed-812c-10784ac13acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:58.902068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-85601f94-ec5c-4aed-812c-10784ac13acc None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:25:58.906536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-85601f94-ec5c-4aed-812c-10784ac13acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:25:58.945540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1113/2224] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:25:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:25:58.976930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26b13f-c137-4857-9687-ed55becfaea9 service swift] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:25:58.995232 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26b13f-c137-4857-9687-ed55becfaea9 service swift] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:25:59.029206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787264aa-767c-458f-9140-83d711760ab8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:25:59.030255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787264aa-767c-458f-9140-83d711760ab8 service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:25:59.032345 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787264aa-767c-458f-9140-83d711760ab8 service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:25:59.032808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787264aa-767c-458f-9140-83d711760ab8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:25:59.048899 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787264aa-767c-458f-9140-83d711760ab8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:25:59.052957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787264aa-767c-458f-9140-83d711760ab8 service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:25:59.073898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1112/2225] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:25:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:26:08.874131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=42 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:09.064884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=86 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:14.198976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7681ad-49c4-4835-a67b-6f91e436e700 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:14.199581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7681ad-49c4-4835-a67b-6f91e436e700 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:14.199581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7681ad-49c4-4835-a67b-6f91e436e700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:14.220378 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6b7681ad-49c4-4835-a67b-6f91e436e700 None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:14.222321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6b7681ad-49c4-4835-a67b-6f91e436e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:14.231477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1114/2226] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:26:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:14.246281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787264aa-767c-458f-9140-83d711760ab8 service swift] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:14.260782 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787264aa-767c-458f-9140-83d711760ab8 service swift] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:14.271568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffe260-c8e1-4684-b22b-3948aaf15220 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:14.272992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffe260-c8e1-4684-b22b-3948aaf15220 service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:14.273452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffe260-c8e1-4684-b22b-3948aaf15220 service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:14.274124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffe260-c8e1-4684-b22b-3948aaf15220 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:14.289987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffe260-c8e1-4684-b22b-3948aaf15220 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:14.291637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffe260-c8e1-4684-b22b-3948aaf15220 service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:14.309864 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1113/2227] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:26:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:26:15.080439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527cc84-5b85-4ba5-8c95-7ee73383fb2b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:15.080741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527cc84-5b85-4ba5-8c95-7ee73383fb2b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:15.081035 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527cc84-5b85-4ba5-8c95-7ee73383fb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:15.108221 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0527cc84-5b85-4ba5-8c95-7ee73383fb2b None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:15.109469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0527cc84-5b85-4ba5-8c95-7ee73383fb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:15.135185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1115/2228] 10.222.0.45 () {58 vars in 967 bytes} [Fri Aug 26 18:26:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:15.154050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffe260-c8e1-4684-b22b-3948aaf15220 service swift] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:15.172973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffe260-c8e1-4684-b22b-3948aaf15220 service swift] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:15.182678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8222372-af17-4369-912a-73b70295ae9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:15.183948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8222372-af17-4369-912a-73b70295ae9d service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:15.185116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8222372-af17-4369-912a-73b70295ae9d service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:15.185563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8222372-af17-4369-912a-73b70295ae9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:15.200935 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8222372-af17-4369-912a-73b70295ae9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:15.203498 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8222372-af17-4369-912a-73b70295ae9d service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:15.219746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1114/2229] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:26:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:26:15.687433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b0154-1650-48d2-9f36-fe93e9d01dab None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:15.687979 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b0154-1650-48d2-9f36-fe93e9d01dab None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:15.687979 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b0154-1650-48d2-9f36-fe93e9d01dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:15.717255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b20b0154-1650-48d2-9f36-fe93e9d01dab None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:15.721289 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b20b0154-1650-48d2-9f36-fe93e9d01dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:15.729930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1116/2230] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:26:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:15.752266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8222372-af17-4369-912a-73b70295ae9d service swift] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:15.772875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8222372-af17-4369-912a-73b70295ae9d service swift] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:15.784898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e808948-df83-4c24-86fe-3f5bc97d0591 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:15.787887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e808948-df83-4c24-86fe-3f5bc97d0591 service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:15.788750 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e808948-df83-4c24-86fe-3f5bc97d0591 service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:15.789404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e808948-df83-4c24-86fe-3f5bc97d0591 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:15.807589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e808948-df83-4c24-86fe-3f5bc97d0591 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:15.809512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e808948-df83-4c24-86fe-3f5bc97d0591 service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:15.819746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1115/2231] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:26:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:26:16.481393 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d783-8824-4ef6-94d6-dcc485ec1557 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:16.481865 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d783-8824-4ef6-94d6-dcc485ec1557 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:16.482309 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d783-8824-4ef6-94d6-dcc485ec1557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:16.504048 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0fc0d783-8824-4ef6-94d6-dcc485ec1557 None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:16.505770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0fc0d783-8824-4ef6-94d6-dcc485ec1557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:16.514904 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1117/2232] 10.222.0.45 () {58 vars in 967 bytes} [Fri Aug 26 18:26:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:16.538964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e808948-df83-4c24-86fe-3f5bc97d0591 service swift] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:16.551512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e808948-df83-4c24-86fe-3f5bc97d0591 service swift] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:16.558136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44131715-e052-433a-96e0-c346fae0835b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:16.558777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44131715-e052-433a-96e0-c346fae0835b service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:16.559129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44131715-e052-433a-96e0-c346fae0835b service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:16.559508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44131715-e052-433a-96e0-c346fae0835b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:16.569099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44131715-e052-433a-96e0-c346fae0835b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:16.571363 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44131715-e052-433a-96e0-c346fae0835b service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:16.581778 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1116/2233] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:26:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:26:18.412849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70e190-7800-4ab8-bf78-afb86175c74b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:18.413352 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70e190-7800-4ab8-bf78-afb86175c74b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:18.413445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70e190-7800-4ab8-bf78-afb86175c74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:18.432496 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ce70e190-7800-4ab8-bf78-afb86175c74b None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:18.433737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ce70e190-7800-4ab8-bf78-afb86175c74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:18.441239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1118/2234] 10.222.0.45 () {58 vars in 967 bytes} [Fri Aug 26 18:26:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:18.454786 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44131715-e052-433a-96e0-c346fae0835b service swift] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:18.465685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44131715-e052-433a-96e0-c346fae0835b service swift] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:18.472074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5337cc-cf4d-409b-8c2b-d9ef78bc89c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:18.472700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5337cc-cf4d-409b-8c2b-d9ef78bc89c6 service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:18.472988 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5337cc-cf4d-409b-8c2b-d9ef78bc89c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:18.473266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5337cc-cf4d-409b-8c2b-d9ef78bc89c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:18.481581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5337cc-cf4d-409b-8c2b-d9ef78bc89c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:18.483216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5337cc-cf4d-409b-8c2b-d9ef78bc89c6 service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:18.491204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1117/2235] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:26:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:26:18.741889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70e190-7800-4ab8-bf78-afb86175c74b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:18.817730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70e190-7800-4ab8-bf78-afb86175c74b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:18.823929 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:18.824582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:18.824898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:18.825628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] PATH_INFO: `/v3/users/0c70c266fe3a46ebad73127c1f1e5c61` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:18.827045 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c70c266fe3a46ebad73127c1f1e5c61)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:18.829237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:18.882463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c70c266fe3a46ebad73127c1f1e5c61'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:18.883288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c70c266fe3a46ebad73127c1f1e5c61'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:18.896500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c70c266fe3a46ebad73127c1f1e5c61'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:18.906208 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c70c266fe3a46ebad73127c1f1e5c61'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:18.906986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c70c266fe3a46ebad73127c1f1e5c61'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:18.936354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1119/2236] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:26:18 2022] DELETE /identity/v3/users/0c70c266fe3a46ebad73127c1f1e5c61 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:26:18.938295 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d29d1-aa62-48cd-b05c-58b0e971b210 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:18.938908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d29d1-aa62-48cd-b05c-58b0e971b210 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:18.939196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d29d1-aa62-48cd-b05c-58b0e971b210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:18.958809 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-7c5d29d1-aa62-48cd-b05c-58b0e971b210 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:18.960067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7c5d29d1-aa62-48cd-b05c-58b0e971b210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:19.023848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1118/2237] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:19.034213 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:19.036600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:19.097278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:19.104103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fab106-5781-4298-b939-40d5c6ed571d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:19.108845 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2ed84-5a56-4970-b6f1-637257941a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:19.109633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2ed84-5a56-4970-b6f1-637257941a50 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:19.110167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2ed84-5a56-4970-b6f1-637257941a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:19.110444 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2ed84-5a56-4970-b6f1-637257941a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:19.119375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2ed84-5a56-4970-b6f1-637257941a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:19.120852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2ed84-5a56-4970-b6f1-637257941a50 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:19.130159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1120/2238] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:26:19.310103 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d29d1-aa62-48cd-b05c-58b0e971b210 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:19.311613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7c5d29d1-aa62-48cd-b05c-58b0e971b210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:19.326982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d29d1-aa62-48cd-b05c-58b0e971b210 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:19.332365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:19.333121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:19.333372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:19.333768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06 admin admin] PATH_INFO: `/v3/projects/1b7e87f26c6748f3a55767285de31cde` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:19.334994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7e87f26c6748f3a55767285de31cde)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:19.337069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:19.393840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7e87f26c6748f3a55767285de31cde', 'request_id': 'req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:19.408445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7e87f26c6748f3a55767285de31cde', 'request_id': 'req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:19.415892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7e87f26c6748f3a55767285de31cde', 'request_id': 'req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:19.428346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06 admin admin] The token cache is being invalidate because project 1b7e87f26c6748f3a55767285de31cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:26:19.428803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:19.429561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2e24b9c2-ec11-44d9-8ae6-404d7cf92a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:19.431543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1119/2239] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:26:19 2022] DELETE /identity/v3/projects/1b7e87f26c6748f3a55767285de31cde => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:26:20.284110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854013e4-c3fe-414e-a1b4-e1c871b9ca8b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:20.284674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854013e4-c3fe-414e-a1b4-e1c871b9ca8b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:20.284674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854013e4-c3fe-414e-a1b4-e1c871b9ca8b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:20.286060 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1121/2240] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:26:20.294894 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d543c-cd98-4855-99fb-1de6d775264c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:20.295375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d543c-cd98-4855-99fb-1de6d775264c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:20.295461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d543c-cd98-4855-99fb-1de6d775264c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:20.340565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d34d543c-cd98-4855-99fb-1de6d775264c None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:20.342521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d34d543c-cd98-4855-99fb-1de6d775264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:20.357413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:20.436546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1120/2241] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:26:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:20.458975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854013e4-c3fe-414e-a1b4-e1c871b9ca8b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:20.460693 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-854013e4-c3fe-414e-a1b4-e1c871b9ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:20.539991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854013e4-c3fe-414e-a1b4-e1c871b9ca8b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:20.543441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d543c-cd98-4855-99fb-1de6d775264c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:20.544120 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842238-52e1-4809-8f0e-cb11532dc625 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ee7b50c34742ce896a734f3ef34a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:20.544852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d34d543c-cd98-4855-99fb-1de6d775264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:20.545015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842238-52e1-4809-8f0e-cb11532dc625 service glance] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:20.545538 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842238-52e1-4809-8f0e-cb11532dc625 service glance] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:20.545908 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842238-52e1-4809-8f0e-cb11532dc625 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:20.557548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1842238-52e1-4809-8f0e-cb11532dc625 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:20.559075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1842238-52e1-4809-8f0e-cb11532dc625 service glance] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:20.570995 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1122/2242] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:26:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:26:20.621151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d543c-cd98-4855-99fb-1de6d775264c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:20.625390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7ffac-889c-43a5-a543-28d9013be704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:20.626363 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7ffac-889c-43a5-a543-28d9013be704 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:20.626649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7ffac-889c-43a5-a543-28d9013be704 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:20.626920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7ffac-889c-43a5-a543-28d9013be704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:20.629431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-68a7ffac-889c-43a5-a543-28d9013be704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:20.653734 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9a5cc-fc02-4681-aa50-2fb18faa6217 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:20.655225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9a5cc-fc02-4681-aa50-2fb18faa6217 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:20.655566 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9a5cc-fc02-4681-aa50-2fb18faa6217 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:20.657421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1123/2243] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:26:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:26:20.664054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eda6a-8a50-488c-96ad-c82e4573e04f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:20.664325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eda6a-8a50-488c-96ad-c82e4573e04f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:20.664600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eda6a-8a50-488c-96ad-c82e4573e04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:20.691741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7b3eda6a-8a50-488c-96ad-c82e4573e04f None None] MFA Rules not processed for user `78487667b3334cf09fed51b697cbf759`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:20.693344 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7b3eda6a-8a50-488c-96ad-c82e4573e04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:20.700317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1124/2244] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:26:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:20.706892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7ffac-889c-43a5-a543-28d9013be704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:20.708600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7ffac-889c-43a5-a543-28d9013be704 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:20.712755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eda6a-8a50-488c-96ad-c82e4573e04f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:20.722640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1121/2245] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:26:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:26:20.725398 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eda6a-8a50-488c-96ad-c82e4573e04f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:20.729721 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac140e0-8490-4927-89dc-e4bc202d4744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:20.730443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac140e0-8490-4927-89dc-e4bc202d4744 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:20.731353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac140e0-8490-4927-89dc-e4bc202d4744 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:20.732337 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac140e0-8490-4927-89dc-e4bc202d4744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:20.743927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac140e0-8490-4927-89dc-e4bc202d4744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:20.745763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac140e0-8490-4927-89dc-e4bc202d4744 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:20.757264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1125/2246] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:26:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:26:20.774346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7ffac-889c-43a5-a543-28d9013be704 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:20.779453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-68a7ffac-889c-43a5-a543-28d9013be704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:20.852924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7ffac-889c-43a5-a543-28d9013be704 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:20.853926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57be589-ef6a-40ab-a70f-1c6fea1ad319 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:20.854558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57be589-ef6a-40ab-a70f-1c6fea1ad319 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:20.854982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57be589-ef6a-40ab-a70f-1c6fea1ad319 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:20.856595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1126/2247] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 18:26:20.858166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:20.859033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:20.859379 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:20.859717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] PATH_INFO: `/v3/users/9b559d3676324d118771e07248aee539` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:20.861351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b559d3676324d118771e07248aee539)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:20.862731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11504248-c27f-49a1-b157-2b65b0a0ddc7 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:20.863168 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11504248-c27f-49a1-b157-2b65b0a0ddc7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:20.863297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:20.863696 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11504248-c27f-49a1-b157-2b65b0a0ddc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:20.865779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:20.888605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-11504248-c27f-49a1-b157-2b65b0a0ddc7 None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:20.890546 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-11504248-c27f-49a1-b157-2b65b0a0ddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:20.903337 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1127/2248] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:26:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:26:20.916615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11504248-c27f-49a1-b157-2b65b0a0ddc7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:20.917305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b559d3676324d118771e07248aee539'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:20.928215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11504248-c27f-49a1-b157-2b65b0a0ddc7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:20.930727 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b559d3676324d118771e07248aee539'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:20.931452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b559d3676324d118771e07248aee539'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:20.932526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ee977-b70c-4ba7-949d-62da7d5ec9d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:20.933161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee977-b70c-4ba7-949d-62da7d5ec9d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:20.933464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee977-b70c-4ba7-949d-62da7d5ec9d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:20.933703 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee977-b70c-4ba7-949d-62da7d5ec9d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:20.940491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b559d3676324d118771e07248aee539'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:20.946217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ee977-b70c-4ba7-949d-62da7d5ec9d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:20.947815 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ee977-b70c-4ba7-949d-62da7d5ec9d0 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:20.948674 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b559d3676324d118771e07248aee539'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:20.955751 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1122/2249] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:26:20 2022] DELETE /identity/v3/users/9b559d3676324d118771e07248aee539 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:26:20.960683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1128/2250] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:26:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:26:21.185945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:21.188221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:21.299516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcdd28-7600-4ce1-b1a7-fe3186c6949a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:21.305937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b7a08-c866-4efe-ba49-66cdc348e2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:21.306604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7a08-c866-4efe-ba49-66cdc348e2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:21.306887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7a08-c866-4efe-ba49-66cdc348e2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:21.307166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7a08-c866-4efe-ba49-66cdc348e2e8 admin admin] PATH_INFO: `/v3/projects/62a8ceb72d38430da081bf1a280ec13a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:21.308350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b7a08-c866-4efe-ba49-66cdc348e2e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a8ceb72d38430da081bf1a280ec13a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:21.310291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b7a08-c866-4efe-ba49-66cdc348e2e8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:21.361088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-114b7a08-c866-4efe-ba49-66cdc348e2e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a8ceb72d38430da081bf1a280ec13a', 'request_id': 'req-114b7a08-c866-4efe-ba49-66cdc348e2e8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:21.371996 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-114b7a08-c866-4efe-ba49-66cdc348e2e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a8ceb72d38430da081bf1a280ec13a', 'request_id': 'req-114b7a08-c866-4efe-ba49-66cdc348e2e8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:21.379487 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-114b7a08-c866-4efe-ba49-66cdc348e2e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a8ceb72d38430da081bf1a280ec13a', 'request_id': 'req-114b7a08-c866-4efe-ba49-66cdc348e2e8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:21.391082 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-114b7a08-c866-4efe-ba49-66cdc348e2e8 admin admin] The token cache is being invalidate because project 62a8ceb72d38430da081bf1a280ec13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:26:21.391379 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-114b7a08-c866-4efe-ba49-66cdc348e2e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:21.392885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-114b7a08-c866-4efe-ba49-66cdc348e2e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:21.395365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1123/2251] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:26:21 2022] DELETE /identity/v3/projects/62a8ceb72d38430da081bf1a280ec13a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:26:21.399978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb563e98-01ff-48ed-816a-3ce65f99a643 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:21.400541 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb563e98-01ff-48ed-816a-3ce65f99a643 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:21.400541 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb563e98-01ff-48ed-816a-3ce65f99a643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:21.422405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fb563e98-01ff-48ed-816a-3ce65f99a643 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:21.424534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fb563e98-01ff-48ed-816a-3ce65f99a643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:21.504105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1129/2252] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:26:21.512412 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90c1c-5ca4-48ca-8c07-7ae979124ded None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:21.512802 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90c1c-5ca4-48ca-8c07-7ae979124ded None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:21.513136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90c1c-5ca4-48ca-8c07-7ae979124ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:21.537922 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-23a90c1c-5ca4-48ca-8c07-7ae979124ded None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:21.540189 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-23a90c1c-5ca4-48ca-8c07-7ae979124ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:21.550205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1124/2253] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:21.555114 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb563e98-01ff-48ed-816a-3ce65f99a643 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:21.567820 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb563e98-01ff-48ed-816a-3ce65f99a643 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:21.572818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cceed-29ab-4fdd-a452-9eb4a3492848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:21.573438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cceed-29ab-4fdd-a452-9eb4a3492848 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:21.573719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cceed-29ab-4fdd-a452-9eb4a3492848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:21.573995 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cceed-29ab-4fdd-a452-9eb4a3492848 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:21.574654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cceed-29ab-4fdd-a452-9eb4a3492848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:26:21.574961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cceed-29ab-4fdd-a452-9eb4a3492848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:21.576593 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cceed-29ab-4fdd-a452-9eb4a3492848 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:21.589592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1130/2254] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:26:21.594995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a90c1c-5ca4-48ca-8c07-7ae979124ded None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:21.600362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:21.606287 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a90c1c-5ca4-48ca-8c07-7ae979124ded None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:21.614332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785d82b-aeb3-4eb7-84ea-752881c6aca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:21.615336 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785d82b-aeb3-4eb7-84ea-752881c6aca6 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:21.615979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785d82b-aeb3-4eb7-84ea-752881c6aca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:21.616641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785d82b-aeb3-4eb7-84ea-752881c6aca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:21.617370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785d82b-aeb3-4eb7-84ea-752881c6aca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:21.619462 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785d82b-aeb3-4eb7-84ea-752881c6aca6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:21.656042 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1125/2255] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:26:21 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:26:21.657772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cceed-29ab-4fdd-a452-9eb4a3492848 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:21.672805 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cceed-29ab-4fdd-a452-9eb4a3492848 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:21.713504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:21.735714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23582bb0-29b3-47bf-acb7-37ea2d06528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:21.736516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582bb0-29b3-47bf-acb7-37ea2d06528d admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:21.736855 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582bb0-29b3-47bf-acb7-37ea2d06528d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:21.737134 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582bb0-29b3-47bf-acb7-37ea2d06528d admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:21.737780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23582bb0-29b3-47bf-acb7-37ea2d06528d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:21.739719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23582bb0-29b3-47bf-acb7-37ea2d06528d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:21.768226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1131/2256] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:26:21 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:26:21.774447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785d82b-aeb3-4eb7-84ea-752881c6aca6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:21.785627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785d82b-aeb3-4eb7-84ea-752881c6aca6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:21.791279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74547743-d4df-43e6-a9fe-4bd4d56e253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:21.791892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74547743-d4df-43e6-a9fe-4bd4d56e253b admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:21.792171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74547743-d4df-43e6-a9fe-4bd4d56e253b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:21.792447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74547743-d4df-43e6-a9fe-4bd4d56e253b admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:21.793129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74547743-d4df-43e6-a9fe-4bd4d56e253b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:21.794875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74547743-d4df-43e6-a9fe-4bd4d56e253b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:21.805438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1126/2257] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:26:21.809548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23582bb0-29b3-47bf-acb7-37ea2d06528d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:21.819980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23582bb0-29b3-47bf-acb7-37ea2d06528d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:21.824743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dba35-48a3-4a38-841f-72b96cce5889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:21.825376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dba35-48a3-4a38-841f-72b96cce5889 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:21.825654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dba35-48a3-4a38-841f-72b96cce5889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:21.825910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dba35-48a3-4a38-841f-72b96cce5889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:21.826552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dba35-48a3-4a38-841f-72b96cce5889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:21.828228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dba35-48a3-4a38-841f-72b96cce5889 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:21.838633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1132/2258] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:26:21.842901 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74547743-d4df-43e6-a9fe-4bd4d56e253b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:21.852957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74547743-d4df-43e6-a9fe-4bd4d56e253b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:21.858318 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea68d1a-35d5-4505-a633-4ea035c39030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:21.859035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea68d1a-35d5-4505-a633-4ea035c39030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:21.859334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea68d1a-35d5-4505-a633-4ea035c39030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:21.859591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea68d1a-35d5-4505-a633-4ea035c39030 admin admin] PATH_INFO: `/v3/projects/b9ee9534ab004db9b5de6ab28aee6f4d/users/c70d09c0d8ae461bbb412ce587dac55f/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:21.874909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea68d1a-35d5-4505-a633-4ea035c39030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ee9534ab004db9b5de6ab28aee6f4d, user_id=c70d09c0d8ae461bbb412ce587dac55f, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:21.877581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea68d1a-35d5-4505-a633-4ea035c39030 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:21.891425 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1127/2259] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:26:21 2022] PUT /identity/v3/projects/b9ee9534ab004db9b5de6ab28aee6f4d/users/c70d09c0d8ae461bbb412ce587dac55f/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:26:21.902581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df828-be16-4be6-8f5b-00232ccd296e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:21.903025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df828-be16-4be6-8f5b-00232ccd296e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:21.903314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df828-be16-4be6-8f5b-00232ccd296e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:21.932563 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d38df828-be16-4be6-8f5b-00232ccd296e None None] MFA Rules not processed for user `c70d09c0d8ae461bbb412ce587dac55f`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:21.933862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d38df828-be16-4be6-8f5b-00232ccd296e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:22.006625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1133/2260] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:22.018140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea68d1a-35d5-4505-a633-4ea035c39030 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:22.020402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cea68d1a-35d5-4505-a633-4ea035c39030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:22.089757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea68d1a-35d5-4505-a633-4ea035c39030 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:22.093732 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc68a2-dd43-4d55-a871-37c9ebad0f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:22.094360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc68a2-dd43-4d55-a871-37c9ebad0f88 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:22.094644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc68a2-dd43-4d55-a871-37c9ebad0f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:22.094920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc68a2-dd43-4d55-a871-37c9ebad0f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:22.104100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc68a2-dd43-4d55-a871-37c9ebad0f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:22.105744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc68a2-dd43-4d55-a871-37c9ebad0f88 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:22.116232 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1128/2261] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:26:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:26:23.847834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7eec1-7529-4767-9352-e00e1d0b55e5 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:23.848683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7eec1-7529-4767-9352-e00e1d0b55e5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:23.848978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7eec1-7529-4767-9352-e00e1d0b55e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:23.869447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c0a7eec1-7529-4767-9352-e00e1d0b55e5 None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:23.870702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c0a7eec1-7529-4767-9352-e00e1d0b55e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:23.930606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1134/2262] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:26:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:23.944654 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc68a2-dd43-4d55-a871-37c9ebad0f88 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:23.946183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-34cc68a2-dd43-4d55-a871-37c9ebad0f88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:24.026126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc68a2-dd43-4d55-a871-37c9ebad0f88 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:24.031735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55801545-1d7a-477c-8884-d4afd73f2655 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:24.032352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55801545-1d7a-477c-8884-d4afd73f2655 service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:24.032649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55801545-1d7a-477c-8884-d4afd73f2655 service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:24.032957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55801545-1d7a-477c-8884-d4afd73f2655 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:24.042088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55801545-1d7a-477c-8884-d4afd73f2655 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:24.043691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55801545-1d7a-477c-8884-d4afd73f2655 service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:24.052105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1129/2263] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:26:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:26:24.779284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7eec1-7529-4767-9352-e00e1d0b55e5 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:24.832949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:24.846414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7eec1-7529-4767-9352-e00e1d0b55e5 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:24.851099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:24.851768 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:24.852143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:24.852483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] PATH_INFO: `/v3/users/c70d09c0d8ae461bbb412ce587dac55f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:24.853723 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70d09c0d8ae461bbb412ce587dac55f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:24.855772 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:24.906984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70d09c0d8ae461bbb412ce587dac55f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:24.907649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70d09c0d8ae461bbb412ce587dac55f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:24.915755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70d09c0d8ae461bbb412ce587dac55f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:24.922998 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70d09c0d8ae461bbb412ce587dac55f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:24.923637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70d09c0d8ae461bbb412ce587dac55f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:24.941313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1135/2264] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:26:24 2022] DELETE /identity/v3/users/c70d09c0d8ae461bbb412ce587dac55f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:26:24.945881 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43c5cd-bca7-411f-93e9-01601b148ce0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:24.946364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43c5cd-bca7-411f-93e9-01601b148ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:24.946457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43c5cd-bca7-411f-93e9-01601b148ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:24.967123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2c43c5cd-bca7-411f-93e9-01601b148ce0 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:24.968443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2c43c5cd-bca7-411f-93e9-01601b148ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:25.003094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:25.039005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1130/2265] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:25.049737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:25.051345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:25.119871 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeba21-869f-4bd3-94af-4accdcfb212a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:25.124122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed610-00f3-431b-a297-18b0f6449aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:25.124785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed610-00f3-431b-a297-18b0f6449aee service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:25.125228 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed610-00f3-431b-a297-18b0f6449aee service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:25.125498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed610-00f3-431b-a297-18b0f6449aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:25.135592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed610-00f3-431b-a297-18b0f6449aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:25.137868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed610-00f3-431b-a297-18b0f6449aee service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:25.156934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1136/2266] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:26:25.540503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43c5cd-bca7-411f-93e9-01601b148ce0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:25.542190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2c43c5cd-bca7-411f-93e9-01601b148ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:25.562055 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43c5cd-bca7-411f-93e9-01601b148ce0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:25.571005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4aef40-77ed-430f-b75e-765203e34758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:25.571640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4aef40-77ed-430f-b75e-765203e34758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:25.571923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4aef40-77ed-430f-b75e-765203e34758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:25.572198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4aef40-77ed-430f-b75e-765203e34758 admin admin] PATH_INFO: `/v3/projects/b9ee9534ab004db9b5de6ab28aee6f4d` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:25.573408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4aef40-77ed-430f-b75e-765203e34758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ee9534ab004db9b5de6ab28aee6f4d)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:25.575359 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4aef40-77ed-430f-b75e-765203e34758 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:25.661215 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-df4aef40-77ed-430f-b75e-765203e34758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ee9534ab004db9b5de6ab28aee6f4d', 'request_id': 'req-df4aef40-77ed-430f-b75e-765203e34758'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:25.672696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-df4aef40-77ed-430f-b75e-765203e34758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ee9534ab004db9b5de6ab28aee6f4d', 'request_id': 'req-df4aef40-77ed-430f-b75e-765203e34758'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:25.693754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-df4aef40-77ed-430f-b75e-765203e34758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ee9534ab004db9b5de6ab28aee6f4d', 'request_id': 'req-df4aef40-77ed-430f-b75e-765203e34758'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:25.708873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-df4aef40-77ed-430f-b75e-765203e34758 admin admin] The token cache is being invalidate because project b9ee9534ab004db9b5de6ab28aee6f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:26:25.709510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-df4aef40-77ed-430f-b75e-765203e34758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:25.711739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-df4aef40-77ed-430f-b75e-765203e34758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:26:25.721773 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1131/2267] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:26:25 2022] DELETE /identity/v3/projects/b9ee9534ab004db9b5de6ab28aee6f4d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:26:25.726519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae5d6-ef04-474c-9517-b60a5474a440 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:25.726798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae5d6-ef04-474c-9517-b60a5474a440 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:25.727125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae5d6-ef04-474c-9517-b60a5474a440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:25.760803 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-07bae5d6-ef04-474c-9517-b60a5474a440 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:25.762181 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-07bae5d6-ef04-474c-9517-b60a5474a440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:25.854357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1137/2268] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:25.862046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40921ce7-7856-4820-8280-7622d9e5eef6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:25.862340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40921ce7-7856-4820-8280-7622d9e5eef6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:25.862623 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40921ce7-7856-4820-8280-7622d9e5eef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:25.884648 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-40921ce7-7856-4820-8280-7622d9e5eef6 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:25.885994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-40921ce7-7856-4820-8280-7622d9e5eef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:25.894592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1132/2269] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:25.899493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bae5d6-ef04-474c-9517-b60a5474a440 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:25.931777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bae5d6-ef04-474c-9517-b60a5474a440 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:25.937793 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2cfb5-e5c3-41a1-81c7-77d689d7953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:25.938614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2cfb5-e5c3-41a1-81c7-77d689d7953d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:25.939297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2cfb5-e5c3-41a1-81c7-77d689d7953d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:25.939735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2cfb5-e5c3-41a1-81c7-77d689d7953d admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:25.940557 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2cfb5-e5c3-41a1-81c7-77d689d7953d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:26:25.941119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2cfb5-e5c3-41a1-81c7-77d689d7953d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:25.944299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2cfb5-e5c3-41a1-81c7-77d689d7953d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:25.965082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1138/2270] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:26:25.965882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40921ce7-7856-4820-8280-7622d9e5eef6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:25.976361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40921ce7-7856-4820-8280-7622d9e5eef6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:25.985504 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd627e9-12f1-4dba-b503-14ed796f0609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:25.986270 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd627e9-12f1-4dba-b503-14ed796f0609 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:25.986775 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd627e9-12f1-4dba-b503-14ed796f0609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:25.987290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd627e9-12f1-4dba-b503-14ed796f0609 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:25.988008 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd627e9-12f1-4dba-b503-14ed796f0609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:25.990088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd627e9-12f1-4dba-b503-14ed796f0609 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:26.029138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1133/2271] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:26:25 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:26:26.033268 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2cfb5-e5c3-41a1-81c7-77d689d7953d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:26.044072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:26.051191 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2cfb5-e5c3-41a1-81c7-77d689d7953d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:26.136950 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf6838-dc19-4768-b05e-df69361c1021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:26.137610 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf6838-dc19-4768-b05e-df69361c1021 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:26.137962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf6838-dc19-4768-b05e-df69361c1021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:26.138445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf6838-dc19-4768-b05e-df69361c1021 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:26.139180 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf6838-dc19-4768-b05e-df69361c1021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:26.141644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf6838-dc19-4768-b05e-df69361c1021 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:26.167440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1139/2272] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:26:26 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:26:26.169497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd627e9-12f1-4dba-b503-14ed796f0609 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:26.181837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd627e9-12f1-4dba-b503-14ed796f0609 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:26.187649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c878f-77f2-4b47-88b2-792585a38be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:26.188700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c878f-77f2-4b47-88b2-792585a38be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:26.189011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c878f-77f2-4b47-88b2-792585a38be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:26.189286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c878f-77f2-4b47-88b2-792585a38be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:26.189937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c878f-77f2-4b47-88b2-792585a38be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:26.191567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c878f-77f2-4b47-88b2-792585a38be9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:26.203997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1134/2273] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:26:26.208642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf6838-dc19-4768-b05e-df69361c1021 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:26.220116 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf6838-dc19-4768-b05e-df69361c1021 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:26.224997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e7f5b-2276-44bb-bef7-99fea86fafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:26.225646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e7f5b-2276-44bb-bef7-99fea86fafca admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:26.225922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e7f5b-2276-44bb-bef7-99fea86fafca admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:26.226210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e7f5b-2276-44bb-bef7-99fea86fafca admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:26.226867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e7f5b-2276-44bb-bef7-99fea86fafca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:26.228604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e7f5b-2276-44bb-bef7-99fea86fafca admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:26.241402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1140/2274] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:26:26.245774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c878f-77f2-4b47-88b2-792585a38be9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:26.258181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c878f-77f2-4b47-88b2-792585a38be9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:26.263811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dc3ff-3a4c-4122-a151-8eb293833679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:26.264855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dc3ff-3a4c-4122-a151-8eb293833679 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:26.265143 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dc3ff-3a4c-4122-a151-8eb293833679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:26.265510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dc3ff-3a4c-4122-a151-8eb293833679 admin admin] PATH_INFO: `/v3/projects/e19db2164fb9439c8b079f2baf661b40/users/6a8b301eeb0c4cbda40494e57ba78e52/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:26.284328 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629dc3ff-3a4c-4122-a151-8eb293833679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19db2164fb9439c8b079f2baf661b40, user_id=6a8b301eeb0c4cbda40494e57ba78e52, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:26.287570 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629dc3ff-3a4c-4122-a151-8eb293833679 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:26.304759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1135/2275] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:26:26 2022] PUT /identity/v3/projects/e19db2164fb9439c8b079f2baf661b40/users/6a8b301eeb0c4cbda40494e57ba78e52/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:26:26.309949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4bf60-6dea-47ff-a207-c1e7953d774a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:26.310264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4bf60-6dea-47ff-a207-c1e7953d774a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:26.310537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4bf60-6dea-47ff-a207-c1e7953d774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:26.331632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-88f4bf60-6dea-47ff-a207-c1e7953d774a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:26.332930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-88f4bf60-6dea-47ff-a207-c1e7953d774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:26.409141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1141/2276] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:26:26.419294 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dc3ff-3a4c-4122-a151-8eb293833679 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:26.421100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-629dc3ff-3a4c-4122-a151-8eb293833679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:26.508423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dc3ff-3a4c-4122-a151-8eb293833679 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:26.512266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9e96a-9c06-4985-a2d2-04253dba41ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:26.512941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9e96a-9c06-4985-a2d2-04253dba41ff service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:26.513219 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9e96a-9c06-4985-a2d2-04253dba41ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:26.513501 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9e96a-9c06-4985-a2d2-04253dba41ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:26.537566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9e96a-9c06-4985-a2d2-04253dba41ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:26.539042 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9e96a-9c06-4985-a2d2-04253dba41ff service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:26.544754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:26.550290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1136/2277] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:26:27.289582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5149d4-3b12-4e2c-a063-a39991d12344 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:27.290167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5149d4-3b12-4e2c-a063-a39991d12344 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:27.290167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5149d4-3b12-4e2c-a063-a39991d12344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:27.319717 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7f5149d4-3b12-4e2c-a063-a39991d12344 None None] MFA Rules not processed for user `6a8b301eeb0c4cbda40494e57ba78e52`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:27.321237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7f5149d4-3b12-4e2c-a063-a39991d12344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:27.398130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1142/2278] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:26:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:27.410000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9e96a-9c06-4985-a2d2-04253dba41ff service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:27.411511 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4cb9e96a-9c06-4985-a2d2-04253dba41ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:27.474058 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9e96a-9c06-4985-a2d2-04253dba41ff service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:27.479011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef45087-a365-4d29-9360-dde854ca0bef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:27.479968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef45087-a365-4d29-9360-dde854ca0bef service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:27.480314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef45087-a365-4d29-9360-dde854ca0bef service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:27.480664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef45087-a365-4d29-9360-dde854ca0bef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:27.494113 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef45087-a365-4d29-9360-dde854ca0bef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:27.496022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef45087-a365-4d29-9360-dde854ca0bef service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:27.518032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1137/2279] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:26:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:26:29.034030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5aadb1-aa95-4464-973b-3cf47d151686 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:29.034677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5aadb1-aa95-4464-973b-3cf47d151686 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:29.034677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5aadb1-aa95-4464-973b-3cf47d151686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:29.055284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7a5aadb1-aa95-4464-973b-3cf47d151686 None None] MFA Rules not processed for user `6a8b301eeb0c4cbda40494e57ba78e52`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:29.056519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7a5aadb1-aa95-4464-973b-3cf47d151686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:29.064150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1143/2280] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:26:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:37.508332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=26 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:39.050149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:44.566463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8280503-e305-47d6-aa75-899ef7636469 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:44.566952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8280503-e305-47d6-aa75-899ef7636469 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:44.567062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8280503-e305-47d6-aa75-899ef7636469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:44.587722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d8280503-e305-47d6-aa75-899ef7636469 None None] MFA Rules not processed for user `a1be02f9e7fd4bdabc05ec48e2a35f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:44.589263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d8280503-e305-47d6-aa75-899ef7636469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:44.648559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1138/2281] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:26:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:46.645934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5aadb1-aa95-4464-973b-3cf47d151686 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:46.648521 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7a5aadb1-aa95-4464-973b-3cf47d151686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:46.742793 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5aadb1-aa95-4464-973b-3cf47d151686 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:46.749990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9511e6-ec7f-4546-820d-9240c6970ae7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9eef8921de43f18245f47559f3fa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:46.751215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9511e6-ec7f-4546-820d-9240c6970ae7 service placement] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:46.751596 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9511e6-ec7f-4546-820d-9240c6970ae7 service placement] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:46.751845 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9511e6-ec7f-4546-820d-9240c6970ae7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:46.753843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ca9511e6-ec7f-4546-820d-9240c6970ae7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:46.766742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9511e6-ec7f-4546-820d-9240c6970ae7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:46.768429 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9511e6-ec7f-4546-820d-9240c6970ae7 service placement] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:46.779594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1144/2282] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:26:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:26:48.731811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54a56e-89ad-4e7f-b49d-888d7f4d73e2 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:48.732858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54a56e-89ad-4e7f-b49d-888d7f4d73e2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:48.733399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54a56e-89ad-4e7f-b49d-888d7f4d73e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:48.756539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ac54a56e-89ad-4e7f-b49d-888d7f4d73e2 None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:26:48.757846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ac54a56e-89ad-4e7f-b49d-888d7f4d73e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:48.816397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1139/2283] 10.222.0.45 () {58 vars in 967 bytes} [Fri Aug 26 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:26:48.829437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9511e6-ec7f-4546-820d-9240c6970ae7 service placement] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:26:48.831174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ca9511e6-ec7f-4546-820d-9240c6970ae7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:26:48.905504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9511e6-ec7f-4546-820d-9240c6970ae7 service placement] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:26:48.911065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78e828-2769-487f-bf1f-00bebcb57a3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:26:48.911682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78e828-2769-487f-bf1f-00bebcb57a3d service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:26:48.911962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78e828-2769-487f-bf1f-00bebcb57a3d service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:26:48.912235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78e828-2769-487f-bf1f-00bebcb57a3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:26:48.920955 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78e828-2769-487f-bf1f-00bebcb57a3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:26:48.922788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78e828-2769-487f-bf1f-00bebcb57a3d service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:26:48.930944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1145/2284] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:26:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:26:58.809825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=50 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:58.927938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=64 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:27:36.472106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3d5b2-3021-4c1f-9f44-0d2bd74c094c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:27:36.472695 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3d5b2-3021-4c1f-9f44-0d2bd74c094c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:27:36.472695 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3d5b2-3021-4c1f-9f44-0d2bd74c094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:27:36.496757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f6a3d5b2-3021-4c1f-9f44-0d2bd74c094c None None] MFA Rules not processed for user `c78657cb0d4144cfaf0a7be1e3388ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:27:36.498763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f6a3d5b2-3021-4c1f-9f44-0d2bd74c094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:27:36.566285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1140/2285] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:27:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:27:46.559002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=25 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:27:52.569517 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917b73c-2c41-46ae-97fc-38af0aa920f5 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:27:52.570053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917b73c-2c41-46ae-97fc-38af0aa920f5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:27:52.570053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917b73c-2c41-46ae-97fc-38af0aa920f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:27:52.593217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2917b73c-2c41-46ae-97fc-38af0aa920f5 None None] MFA Rules not processed for user `6a8b301eeb0c4cbda40494e57ba78e52`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:27:52.594340 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2917b73c-2c41-46ae-97fc-38af0aa920f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:27:52.604077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1146/2286] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:27:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:28:02.586798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:03.348211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdc1aa-bd6a-453e-8f2f-b0d12a94b9ec None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:28:03.348814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdc1aa-bd6a-453e-8f2f-b0d12a94b9ec None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:28:03.348814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdc1aa-bd6a-453e-8f2f-b0d12a94b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:28:03.369121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d8cdc1aa-bd6a-453e-8f2f-b0d12a94b9ec None None] MFA Rules not processed for user `cde02839effc4354a4fd7e82c1dc8e26`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:28:03.370264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d8cdc1aa-bd6a-453e-8f2f-b0d12a94b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:03.429501 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1141/2287] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:28:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:28:12.242812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ee120-1976-47e3-a6ba-c974c54d2ff7 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:28:12.243334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ee120-1976-47e3-a6ba-c974c54d2ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:28:12.243430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ee120-1976-47e3-a6ba-c974c54d2ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:28:12.263682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c19ee120-1976-47e3-a6ba-c974c54d2ff7 None None] MFA Rules not processed for user `a1be02f9e7fd4bdabc05ec48e2a35f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:28:12.265337 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c19ee120-1976-47e3-a6ba-c974c54d2ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:12.273282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1147/2288] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:28:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:28:13.420603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=25 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:22.258411 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:27.549745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdc1aa-bd6a-453e-8f2f-b0d12a94b9ec None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:28:27.560523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdc1aa-bd6a-453e-8f2f-b0d12a94b9ec None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:28:27.565273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840f58a-1e7b-4918-be60-f8fbead0cf99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:28:27.565893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840f58a-1e7b-4918-be60-f8fbead0cf99 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:28:27.566160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840f58a-1e7b-4918-be60-f8fbead0cf99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:28:27.566427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840f58a-1e7b-4918-be60-f8fbead0cf99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:28:27.568375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b840f58a-1e7b-4918-be60-f8fbead0cf99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:27.654585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840f58a-1e7b-4918-be60-f8fbead0cf99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:28:27.655784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840f58a-1e7b-4918-be60-f8fbead0cf99 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:28:27.669505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1142/2289] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:28:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:28:29.234812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ee120-1976-47e3-a6ba-c974c54d2ff7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:28:29.236382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c19ee120-1976-47e3-a6ba-c974c54d2ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:29.250614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ee120-1976-47e3-a6ba-c974c54d2ff7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:28:29.255293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b4b7f-4ade-4e8f-95b5-45b000ebd180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:28:29.256234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4b7f-4ade-4e8f-95b5-45b000ebd180 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:28:29.256510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4b7f-4ade-4e8f-95b5-45b000ebd180 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:28:29.260429 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4b7f-4ade-4e8f-95b5-45b000ebd180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:28:29.260429 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-715b4b7f-4ade-4e8f-95b5-45b000ebd180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:29.275739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b4b7f-4ade-4e8f-95b5-45b000ebd180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:28:29.278079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b4b7f-4ade-4e8f-95b5-45b000ebd180 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:28:29.294910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1148/2290] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:28:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:28:30.108514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07a835-e002-44de-8c4b-27139594165a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:28:30.109011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07a835-e002-44de-8c4b-27139594165a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:28:30.109264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07a835-e002-44de-8c4b-27139594165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:28:30.132405 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3c07a835-e002-44de-8c4b-27139594165a None None] MFA Rules not processed for user `85158030e4904eab877dc5da3a6bbd33`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:28:30.133824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3c07a835-e002-44de-8c4b-27139594165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:30.204888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1143/2291] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:28:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:28:39.287470 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:40.190256 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=59 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:40.343711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b4b7f-4ade-4e8f-95b5-45b000ebd180 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:28:40.356968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b4b7f-4ade-4e8f-95b5-45b000ebd180 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:28:40.361451 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f717977-789d-48ea-92cc-50e159eaa0e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:28:40.362225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f717977-789d-48ea-92cc-50e159eaa0e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:28:40.362569 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f717977-789d-48ea-92cc-50e159eaa0e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:28:40.362914 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f717977-789d-48ea-92cc-50e159eaa0e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:28:40.365107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1f717977-789d-48ea-92cc-50e159eaa0e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:40.382119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f717977-789d-48ea-92cc-50e159eaa0e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:28:40.383180 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f717977-789d-48ea-92cc-50e159eaa0e6 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:28:40.394408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1149/2292] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:28:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:28:46.019622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07a835-e002-44de-8c4b-27139594165a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:28:46.021173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3c07a835-e002-44de-8c4b-27139594165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:46.038185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07a835-e002-44de-8c4b-27139594165a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:28:46.044273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb107691-07dd-4ba2-beee-3b6bd5f63b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:28:46.044920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107691-07dd-4ba2-beee-3b6bd5f63b82 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:28:46.045198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107691-07dd-4ba2-beee-3b6bd5f63b82 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:28:46.045464 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107691-07dd-4ba2-beee-3b6bd5f63b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:28:46.047261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bb107691-07dd-4ba2-beee-3b6bd5f63b82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:46.063413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb107691-07dd-4ba2-beee-3b6bd5f63b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:28:46.065213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb107691-07dd-4ba2-beee-3b6bd5f63b82 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:28:46.075632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1144/2293] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:28:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:28:49.101676 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f717977-789d-48ea-92cc-50e159eaa0e6 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:28:49.112826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f717977-789d-48ea-92cc-50e159eaa0e6 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:28:49.116501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dfa07-44d9-438c-96ce-b59871719805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:28:49.117600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dfa07-44d9-438c-96ce-b59871719805 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:28:49.118089 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dfa07-44d9-438c-96ce-b59871719805 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:28:49.118576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dfa07-44d9-438c-96ce-b59871719805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:28:49.120608 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-012dfa07-44d9-438c-96ce-b59871719805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:49.132487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dfa07-44d9-438c-96ce-b59871719805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:28:49.134341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dfa07-44d9-438c-96ce-b59871719805 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:28:49.145979 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1150/2294] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:28:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:28:54.527457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f94212-8607-442f-8d6e-84cb7129c1d1 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:28:54.528007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f94212-8607-442f-8d6e-84cb7129c1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:28:54.528007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f94212-8607-442f-8d6e-84cb7129c1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:28:54.547969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-19f94212-8607-442f-8d6e-84cb7129c1d1 None None] MFA Rules not processed for user `deb80cf02c84476182960a91d69b6da1`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:28:54.549333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-19f94212-8607-442f-8d6e-84cb7129c1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:54.613795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1145/2295] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:28:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:28:54.990514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dfa07-44d9-438c-96ce-b59871719805 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:28:55.002608 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dfa07-44d9-438c-96ce-b59871719805 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:28:55.008246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9c8f-014b-4fbb-8453-45fc101d295b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:28:55.009118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9c8f-014b-4fbb-8453-45fc101d295b service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:28:55.009255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9c8f-014b-4fbb-8453-45fc101d295b service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:28:55.009812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9c8f-014b-4fbb-8453-45fc101d295b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:28:55.011260 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d5ca9c8f-014b-4fbb-8453-45fc101d295b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:55.034807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9c8f-014b-4fbb-8453-45fc101d295b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:28:55.034807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9c8f-014b-4fbb-8453-45fc101d295b service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:28:55.034807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1151/2296] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:28:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:28:55.578387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f94212-8607-442f-8d6e-84cb7129c1d1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:28:55.590752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f94212-8607-442f-8d6e-84cb7129c1d1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:28:55.597979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a5f91-cc46-4882-97e9-3df438800926 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9eef8921de43f18245f47559f3fa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:28:55.598613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a5f91-cc46-4882-97e9-3df438800926 service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:28:55.598893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a5f91-cc46-4882-97e9-3df438800926 service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:28:55.599166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a5f91-cc46-4882-97e9-3df438800926 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:28:55.601006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-df2a5f91-cc46-4882-97e9-3df438800926 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:28:55.613283 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a5f91-cc46-4882-97e9-3df438800926 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:28:55.615051 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a5f91-cc46-4882-97e9-3df438800926 service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:28:55.626084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1146/2297] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:28:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:01.040992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9c8f-014b-4fbb-8453-45fc101d295b service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:01.052261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9c8f-014b-4fbb-8453-45fc101d295b service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:01.063235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993cdba-86bf-4614-9693-733eef345dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:01.063866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993cdba-86bf-4614-9693-733eef345dcb service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:01.064149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993cdba-86bf-4614-9693-733eef345dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:01.064421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993cdba-86bf-4614-9693-733eef345dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:01.066239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b993cdba-86bf-4614-9693-733eef345dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:01.080106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993cdba-86bf-4614-9693-733eef345dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:01.087909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993cdba-86bf-4614-9693-733eef345dcb service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:01.092165 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1152/2298] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:01.803126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a5f91-cc46-4882-97e9-3df438800926 service placement] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:01.805297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-df2a5f91-cc46-4882-97e9-3df438800926 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:01.824416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a5f91-cc46-4882-97e9-3df438800926 service placement] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:01.832210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95618df-e09c-4c2d-a0d5-71d003480e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:01.832210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95618df-e09c-4c2d-a0d5-71d003480e7a service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:01.832210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95618df-e09c-4c2d-a0d5-71d003480e7a service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:01.832210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95618df-e09c-4c2d-a0d5-71d003480e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:01.834535 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f95618df-e09c-4c2d-a0d5-71d003480e7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:01.848030 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95618df-e09c-4c2d-a0d5-71d003480e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:01.849710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95618df-e09c-4c2d-a0d5-71d003480e7a service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:01.861495 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1147/2299] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:03.913274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993cdba-86bf-4614-9693-733eef345dcb service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:03.924935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993cdba-86bf-4614-9693-733eef345dcb service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:03.930761 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:03.931641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:03.932068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:03.932868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] PATH_INFO: `/v3/users/6a8b301eeb0c4cbda40494e57ba78e52` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:03.934609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8b301eeb0c4cbda40494e57ba78e52)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:03.936889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:04.025451 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8b301eeb0c4cbda40494e57ba78e52'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:04.026686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8b301eeb0c4cbda40494e57ba78e52'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:04.038026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8b301eeb0c4cbda40494e57ba78e52'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:04.050107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8b301eeb0c4cbda40494e57ba78e52'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:04.051080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8b301eeb0c4cbda40494e57ba78e52'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:04.079589 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1153/2300] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:29:03 2022] DELETE /identity/v3/users/6a8b301eeb0c4cbda40494e57ba78e52 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:04.501407 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95618df-e09c-4c2d-a0d5-71d003480e7a service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:04.513639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95618df-e09c-4c2d-a0d5-71d003480e7a service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:04.598378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:04.598993 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:04.599220 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:04.599685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] PATH_INFO: `/v3/projects/e19db2164fb9439c8b079f2baf661b40` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:04.601007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19db2164fb9439c8b079f2baf661b40)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:04.604155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:04.669247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19db2164fb9439c8b079f2baf661b40', 'request_id': 'req-b7a59013-c266-4fde-81ef-208e91c5fdc5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:04.680542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19db2164fb9439c8b079f2baf661b40', 'request_id': 'req-b7a59013-c266-4fde-81ef-208e91c5fdc5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:04.689423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19db2164fb9439c8b079f2baf661b40', 'request_id': 'req-b7a59013-c266-4fde-81ef-208e91c5fdc5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:04.695378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:04.709651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] The token cache is being invalidate because project e19db2164fb9439c8b079f2baf661b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:29:04.710134 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:04.711135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:04.712689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1148/2301] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:29:04 2022] DELETE /identity/v3/projects/e19db2164fb9439c8b079f2baf661b40 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:04.904038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:04.911903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:04.942988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d528c2-a115-416b-a175-59936d89450e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:05.015990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1f9f4-c045-46ca-a1ab-81ead85926d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:05.016677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1f9f4-c045-46ca-a1ab-81ead85926d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:05.016982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1f9f4-c045-46ca-a1ab-81ead85926d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:05.017259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1f9f4-c045-46ca-a1ab-81ead85926d3 admin admin] PATH_INFO: `/v3/users/c78657cb0d4144cfaf0a7be1e3388ed0` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:05.018562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1f9f4-c045-46ca-a1ab-81ead85926d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78657cb0d4144cfaf0a7be1e3388ed0)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:05.020577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1f9f4-c045-46ca-a1ab-81ead85926d3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:05.049978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:05.079291 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e0d1f9f4-c045-46ca-a1ab-81ead85926d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78657cb0d4144cfaf0a7be1e3388ed0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:05.079954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e0d1f9f4-c045-46ca-a1ab-81ead85926d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78657cb0d4144cfaf0a7be1e3388ed0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:05.090671 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e0d1f9f4-c045-46ca-a1ab-81ead85926d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78657cb0d4144cfaf0a7be1e3388ed0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:05.098168 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e0d1f9f4-c045-46ca-a1ab-81ead85926d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78657cb0d4144cfaf0a7be1e3388ed0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:05.098858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e0d1f9f4-c045-46ca-a1ab-81ead85926d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78657cb0d4144cfaf0a7be1e3388ed0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:05.118742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1154/2302] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:29:04 2022] DELETE /identity/v3/users/c78657cb0d4144cfaf0a7be1e3388ed0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:05.351196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:05.352878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:05.366707 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a59013-c266-4fde-81ef-208e91c5fdc5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:05.426660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c924938-bcf5-4797-99d7-9204e284cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:05.427308 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924938-bcf5-4797-99d7-9204e284cd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:05.427596 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924938-bcf5-4797-99d7-9204e284cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:05.427873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924938-bcf5-4797-99d7-9204e284cd40 admin admin] PATH_INFO: `/v3/projects/1a8356be55fb4b19a95da8b77c6e2f9a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:05.429063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c924938-bcf5-4797-99d7-9204e284cd40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8356be55fb4b19a95da8b77c6e2f9a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:05.430985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c924938-bcf5-4797-99d7-9204e284cd40 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:05.483583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9c924938-bcf5-4797-99d7-9204e284cd40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8356be55fb4b19a95da8b77c6e2f9a', 'request_id': 'req-9c924938-bcf5-4797-99d7-9204e284cd40'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:05.495123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9c924938-bcf5-4797-99d7-9204e284cd40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8356be55fb4b19a95da8b77c6e2f9a', 'request_id': 'req-9c924938-bcf5-4797-99d7-9204e284cd40'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:05.502532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9c924938-bcf5-4797-99d7-9204e284cd40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8356be55fb4b19a95da8b77c6e2f9a', 'request_id': 'req-9c924938-bcf5-4797-99d7-9204e284cd40'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:05.517746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9c924938-bcf5-4797-99d7-9204e284cd40 admin admin] The token cache is being invalidate because project 1a8356be55fb4b19a95da8b77c6e2f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:29:05.518019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9c924938-bcf5-4797-99d7-9204e284cd40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:05.518956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9c924938-bcf5-4797-99d7-9204e284cd40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:05.520589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1149/2303] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:29:05 2022] DELETE /identity/v3/projects/1a8356be55fb4b19a95da8b77c6e2f9a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:05.531940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80333b-383b-4de3-80a2-22890494e45b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:05.532314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80333b-383b-4de3-80a2-22890494e45b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:05.532663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80333b-383b-4de3-80a2-22890494e45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:05.554408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6b80333b-383b-4de3-80a2-22890494e45b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:05.555839 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6b80333b-383b-4de3-80a2-22890494e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:05.618163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1155/2304] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:05.626348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79102e4-772d-4e37-adb1-04371eceba8a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:05.626632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79102e4-772d-4e37-adb1-04371eceba8a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:05.626895 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79102e4-772d-4e37-adb1-04371eceba8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:05.648534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b79102e4-772d-4e37-adb1-04371eceba8a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:05.649863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b79102e4-772d-4e37-adb1-04371eceba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:05.659165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1150/2305] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:05.663765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80333b-383b-4de3-80a2-22890494e45b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:05.674349 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80333b-383b-4de3-80a2-22890494e45b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:05.682485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c263350-79ca-4d7a-aace-9d935b36a42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:05.683107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c263350-79ca-4d7a-aace-9d935b36a42e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:05.683389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c263350-79ca-4d7a-aace-9d935b36a42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:05.683666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c263350-79ca-4d7a-aace-9d935b36a42e admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:05.684326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c263350-79ca-4d7a-aace-9d935b36a42e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:29:05.684633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c263350-79ca-4d7a-aace-9d935b36a42e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:05.686335 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c263350-79ca-4d7a-aace-9d935b36a42e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:05.700157 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1156/2306] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:29:05.704923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79102e4-772d-4e37-adb1-04371eceba8a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:05.714430 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79102e4-772d-4e37-adb1-04371eceba8a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:05.719573 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8185a7-07b1-4b8e-bd56-5d663b41f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:05.720284 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8185a7-07b1-4b8e-bd56-5d663b41f9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:05.720661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8185a7-07b1-4b8e-bd56-5d663b41f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:05.721022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8185a7-07b1-4b8e-bd56-5d663b41f9d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:05.721663 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8185a7-07b1-4b8e-bd56-5d663b41f9d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:05.723727 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8185a7-07b1-4b8e-bd56-5d663b41f9d4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:05.753072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1151/2307] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:29:05 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:05.757639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c263350-79ca-4d7a-aace-9d935b36a42e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:05.768681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c263350-79ca-4d7a-aace-9d935b36a42e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:05.836508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35732cf-1645-4b49-94c3-27c97d56a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:05.837183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35732cf-1645-4b49-94c3-27c97d56a934 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:05.837460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35732cf-1645-4b49-94c3-27c97d56a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:05.837730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35732cf-1645-4b49-94c3-27c97d56a934 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:05.838387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35732cf-1645-4b49-94c3-27c97d56a934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:05.840334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35732cf-1645-4b49-94c3-27c97d56a934 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:05.866773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1157/2308] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:29:05 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:29:05.871684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8185a7-07b1-4b8e-bd56-5d663b41f9d4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:05.882846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8185a7-07b1-4b8e-bd56-5d663b41f9d4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:05.889780 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a36f6-f76a-43b9-a7c9-78d61f5434c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:05.890550 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a36f6-f76a-43b9-a7c9-78d61f5434c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:05.890828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a36f6-f76a-43b9-a7c9-78d61f5434c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:05.891118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a36f6-f76a-43b9-a7c9-78d61f5434c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:05.891995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a36f6-f76a-43b9-a7c9-78d61f5434c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:05.894249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a36f6-f76a-43b9-a7c9-78d61f5434c2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:05.907244 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1152/2309] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:05.911915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35732cf-1645-4b49-94c3-27c97d56a934 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:05.924547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35732cf-1645-4b49-94c3-27c97d56a934 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:05.931644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852472e7-99e6-4323-92bf-9466a9cbb993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:05.932588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852472e7-99e6-4323-92bf-9466a9cbb993 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:05.933003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852472e7-99e6-4323-92bf-9466a9cbb993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:05.933308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852472e7-99e6-4323-92bf-9466a9cbb993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:05.933967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852472e7-99e6-4323-92bf-9466a9cbb993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:05.936288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852472e7-99e6-4323-92bf-9466a9cbb993 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:05.950221 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1158/2310] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:05.954769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a36f6-f76a-43b9-a7c9-78d61f5434c2 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:05.966000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a36f6-f76a-43b9-a7c9-78d61f5434c2 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:05.971785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb75338-dd6d-4142-9e35-ed7bcadc4155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:05.972473 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb75338-dd6d-4142-9e35-ed7bcadc4155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:05.972777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb75338-dd6d-4142-9e35-ed7bcadc4155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:05.973087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb75338-dd6d-4142-9e35-ed7bcadc4155 admin admin] PATH_INFO: `/v3/projects/5f98244b9b5a4fa5b4305a5c9119ecb2/users/07d257ca55504822bac98c8f65863490/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:05.990529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb75338-dd6d-4142-9e35-ed7bcadc4155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f98244b9b5a4fa5b4305a5c9119ecb2, user_id=07d257ca55504822bac98c8f65863490, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:05.993927 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb75338-dd6d-4142-9e35-ed7bcadc4155 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:06.010179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1153/2311] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:05 2022] PUT /identity/v3/projects/5f98244b9b5a4fa5b4305a5c9119ecb2/users/07d257ca55504822bac98c8f65863490/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:06.022649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7a4a-f5e6-49cc-9513-288004987e81 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:06.022918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7a4a-f5e6-49cc-9513-288004987e81 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:06.023176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7a4a-f5e6-49cc-9513-288004987e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:06.032572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:06.057053 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-82de7a4a-f5e6-49cc-9513-288004987e81 None None] MFA Rules not processed for user `07d257ca55504822bac98c8f65863490`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:06.058519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-82de7a4a-f5e6-49cc-9513-288004987e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:06.134495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1159/2312] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:06.139365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb75338-dd6d-4142-9e35-ed7bcadc4155 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:06.167397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:06.208895 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb75338-dd6d-4142-9e35-ed7bcadc4155 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:06.214903 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27424bcf-3740-4633-9af7-fa48c5da5c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:06.215522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27424bcf-3740-4633-9af7-fa48c5da5c64 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:06.215836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27424bcf-3740-4633-9af7-fa48c5da5c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:06.216116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27424bcf-3740-4633-9af7-fa48c5da5c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:06.216788 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27424bcf-3740-4633-9af7-fa48c5da5c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:06.218708 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27424bcf-3740-4633-9af7-fa48c5da5c64 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:06.251080 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1154/2313] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:29:06 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:06.255906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de7a4a-f5e6-49cc-9513-288004987e81 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:06.267554 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de7a4a-f5e6-49cc-9513-288004987e81 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:06.330055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8eb1f-a501-4968-8688-ee9af23b9209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:06.330719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8eb1f-a501-4968-8688-ee9af23b9209 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:06.331111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8eb1f-a501-4968-8688-ee9af23b9209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:06.331386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8eb1f-a501-4968-8688-ee9af23b9209 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:06.332146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8eb1f-a501-4968-8688-ee9af23b9209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:06.334188 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8eb1f-a501-4968-8688-ee9af23b9209 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:06.360313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1160/2314] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:29:06 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:06.364707 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27424bcf-3740-4633-9af7-fa48c5da5c64 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:06.375811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27424bcf-3740-4633-9af7-fa48c5da5c64 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:06.380891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2c723-45ef-4255-bd59-1652897ed032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:06.381553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2c723-45ef-4255-bd59-1652897ed032 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:06.381838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2c723-45ef-4255-bd59-1652897ed032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:06.382111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2c723-45ef-4255-bd59-1652897ed032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:06.382792 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2c723-45ef-4255-bd59-1652897ed032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:06.384411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2c723-45ef-4255-bd59-1652897ed032 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:06.400836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1155/2315] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:29:06.401793 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8eb1f-a501-4968-8688-ee9af23b9209 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:06.413764 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8eb1f-a501-4968-8688-ee9af23b9209 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:06.419360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc62cc3-cd9f-4745-a8eb-61d0871384c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:06.420089 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc62cc3-cd9f-4745-a8eb-61d0871384c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:06.420354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc62cc3-cd9f-4745-a8eb-61d0871384c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:06.420619 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc62cc3-cd9f-4745-a8eb-61d0871384c1 admin admin] PATH_INFO: `/v3/projects/4fa2951f365e483281a61d24ed4bca0a/users/fffa8df36b7446f0b5cf164d2dbf979a/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:06.438685 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc62cc3-cd9f-4745-a8eb-61d0871384c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa2951f365e483281a61d24ed4bca0a, user_id=fffa8df36b7446f0b5cf164d2dbf979a, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:06.441578 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc62cc3-cd9f-4745-a8eb-61d0871384c1 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:06.457230 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1161/2316] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:06 2022] PUT /identity/v3/projects/4fa2951f365e483281a61d24ed4bca0a/users/fffa8df36b7446f0b5cf164d2dbf979a/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:29:06.461273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2c723-45ef-4255-bd59-1652897ed032 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:06.471653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2c723-45ef-4255-bd59-1652897ed032 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:06.531023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9532c-06ce-421a-a188-5db7ebebad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:06.531724 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9532c-06ce-421a-a188-5db7ebebad23 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:06.531936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9532c-06ce-421a-a188-5db7ebebad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:06.532205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9532c-06ce-421a-a188-5db7ebebad23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:06.532883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9532c-06ce-421a-a188-5db7ebebad23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:06.534485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9532c-06ce-421a-a188-5db7ebebad23 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:06.546084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1156/2317] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:06.550592 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc62cc3-cd9f-4745-a8eb-61d0871384c1 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:06.568850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc62cc3-cd9f-4745-a8eb-61d0871384c1 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:06.574175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ace77-4024-4bab-b4e9-c1c89440c62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:06.574822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ace77-4024-4bab-b4e9-c1c89440c62b admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:06.575095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ace77-4024-4bab-b4e9-c1c89440c62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:06.575366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ace77-4024-4bab-b4e9-c1c89440c62b admin admin] PATH_INFO: `/v3/projects/4fa2951f365e483281a61d24ed4bca0a/users/fffa8df36b7446f0b5cf164d2dbf979a/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:06.577464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ace77-4024-4bab-b4e9-c1c89440c62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa2951f365e483281a61d24ed4bca0a, user_id=fffa8df36b7446f0b5cf164d2dbf979a, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:06.580161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ace77-4024-4bab-b4e9-c1c89440c62b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:06.592453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1162/2318] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:06 2022] PUT /identity/v3/projects/4fa2951f365e483281a61d24ed4bca0a/users/fffa8df36b7446f0b5cf164d2dbf979a/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:06.603808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac36384-0126-43d7-8e27-a668dd9a64f0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:06.604121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac36384-0126-43d7-8e27-a668dd9a64f0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:06.604463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac36384-0126-43d7-8e27-a668dd9a64f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:06.640776 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-bac36384-0126-43d7-8e27-a668dd9a64f0 None None] MFA Rules not processed for user `fffa8df36b7446f0b5cf164d2dbf979a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:06.641895 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bac36384-0126-43d7-8e27-a668dd9a64f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:06.716951 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1157/2319] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:06.730849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ace77-4024-4bab-b4e9-c1c89440c62b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:06.732935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b55ace77-4024-4bab-b4e9-c1c89440c62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:06.791681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:06.797746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ace77-4024-4bab-b4e9-c1c89440c62b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:06.802384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b6d7b-6a29-4d71-8c46-f20ec1add9a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:06.803060 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b6d7b-6a29-4d71-8c46-f20ec1add9a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:06.803305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b6d7b-6a29-4d71-8c46-f20ec1add9a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:06.803565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b6d7b-6a29-4d71-8c46-f20ec1add9a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:06.813927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b6d7b-6a29-4d71-8c46-f20ec1add9a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:06.815576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b6d7b-6a29-4d71-8c46-f20ec1add9a0 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:06.825406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1163/2320] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:07.281248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac36384-0126-43d7-8e27-a668dd9a64f0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:07.301610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:07.348126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac36384-0126-43d7-8e27-a668dd9a64f0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:07.353434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:07.354113 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:07.354395 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:07.354668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] PATH_INFO: `/v3/users/07d257ca55504822bac98c8f65863490` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:07.355921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d257ca55504822bac98c8f65863490)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:07.357960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:07.406872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d257ca55504822bac98c8f65863490'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:07.420211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d257ca55504822bac98c8f65863490'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:07.420996 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d257ca55504822bac98c8f65863490'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:07.428173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d257ca55504822bac98c8f65863490'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:07.438316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d257ca55504822bac98c8f65863490'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:07.445466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1158/2321] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:29:07 2022] DELETE /identity/v3/users/07d257ca55504822bac98c8f65863490 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:07.450933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae76ee-4388-4cdb-8150-2e8b887b9815 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:07.451458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae76ee-4388-4cdb-8150-2e8b887b9815 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:07.451458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae76ee-4388-4cdb-8150-2e8b887b9815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:07.472420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7eae76ee-4388-4cdb-8150-2e8b887b9815 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:07.473710 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7eae76ee-4388-4cdb-8150-2e8b887b9815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:07.546897 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1164/2322] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:07.557731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:07.559436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:07.621014 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b926ed6-1a81-424b-b175-618977ac4c68 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:07.625466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ecee4-a6fb-4720-a41b-dfe09de08d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:07.626245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ecee4-a6fb-4720-a41b-dfe09de08d5e service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:07.626629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ecee4-a6fb-4720-a41b-dfe09de08d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:07.626975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ecee4-a6fb-4720-a41b-dfe09de08d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:07.639484 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ecee4-a6fb-4720-a41b-dfe09de08d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:07.641515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ecee4-a6fb-4720-a41b-dfe09de08d5e service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:07.654958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1159/2323] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:07.852550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae76ee-4388-4cdb-8150-2e8b887b9815 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:07.854249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7eae76ee-4388-4cdb-8150-2e8b887b9815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:07.941380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae76ee-4388-4cdb-8150-2e8b887b9815 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:07.943120 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ecee4-a6fb-4720-a41b-dfe09de08d5e service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:07.945045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5c2ecee4-a6fb-4720-a41b-dfe09de08d5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:07.945703 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069213c-2b30-4de4-a71d-929b0dd0c12b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:07.946365 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069213c-2b30-4de4-a71d-929b0dd0c12b service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:07.946617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069213c-2b30-4de4-a71d-929b0dd0c12b service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:07.946918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069213c-2b30-4de4-a71d-929b0dd0c12b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:07.949607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8069213c-2b30-4de4-a71d-929b0dd0c12b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:07.975203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ecee4-a6fb-4720-a41b-dfe09de08d5e service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:07.980978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:07.981664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:07.981944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:07.982343 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] PATH_INFO: `/v3/projects/5f98244b9b5a4fa5b4305a5c9119ecb2` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:07.983508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f98244b9b5a4fa5b4305a5c9119ecb2)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:07.985492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:08.017335 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069213c-2b30-4de4-a71d-929b0dd0c12b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:08.018992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069213c-2b30-4de4-a71d-929b0dd0c12b service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:08.029571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1165/2324] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:08.032300 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:08.044268 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f98244b9b5a4fa5b4305a5c9119ecb2', 'request_id': 'req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.053530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f98244b9b5a4fa5b4305a5c9119ecb2', 'request_id': 'req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.060669 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f98244b9b5a4fa5b4305a5c9119ecb2', 'request_id': 'req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.074912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] The token cache is being invalidate because project 5f98244b9b5a4fa5b4305a5c9119ecb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:29:08.075296 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.076019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.077659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1160/2325] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:29:07 2022] DELETE /identity/v3/projects/5f98244b9b5a4fa5b4305a5c9119ecb2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:08.084165 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069213c-2b30-4de4-a71d-929b0dd0c12b service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:08.097964 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069213c-2b30-4de4-a71d-929b0dd0c12b service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:08.122831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:08.157894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ce91d-d85d-49c8-afbe-14855963934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:08.158600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ce91d-d85d-49c8-afbe-14855963934a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:08.158880 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ce91d-d85d-49c8-afbe-14855963934a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:08.159149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ce91d-d85d-49c8-afbe-14855963934a admin admin] PATH_INFO: `/v3/users/fffa8df36b7446f0b5cf164d2dbf979a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:08.160448 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ce91d-d85d-49c8-afbe-14855963934a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fffa8df36b7446f0b5cf164d2dbf979a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:08.162408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ce91d-d85d-49c8-afbe-14855963934a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:08.217722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3d9ce91d-d85d-49c8-afbe-14855963934a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fffa8df36b7446f0b5cf164d2dbf979a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.218685 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3d9ce91d-d85d-49c8-afbe-14855963934a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fffa8df36b7446f0b5cf164d2dbf979a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.226951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3d9ce91d-d85d-49c8-afbe-14855963934a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fffa8df36b7446f0b5cf164d2dbf979a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.234742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3d9ce91d-d85d-49c8-afbe-14855963934a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fffa8df36b7446f0b5cf164d2dbf979a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.235482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3d9ce91d-d85d-49c8-afbe-14855963934a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fffa8df36b7446f0b5cf164d2dbf979a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.259788 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1166/2326] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:29:08 2022] DELETE /identity/v3/users/fffa8df36b7446f0b5cf164d2dbf979a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:08.594543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:08.596235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:08.610583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418ec7f-ba9a-4fbb-b23f-7527351e0fa0 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:08.692796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a21b10-5207-40f2-8420-b21ce12c0323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:08.693436 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a21b10-5207-40f2-8420-b21ce12c0323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:08.693729 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a21b10-5207-40f2-8420-b21ce12c0323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:08.694000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a21b10-5207-40f2-8420-b21ce12c0323 admin admin] PATH_INFO: `/v3/projects/4fa2951f365e483281a61d24ed4bca0a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:08.695275 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a21b10-5207-40f2-8420-b21ce12c0323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa2951f365e483281a61d24ed4bca0a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:08.697251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a21b10-5207-40f2-8420-b21ce12c0323 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:08.761713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d1a21b10-5207-40f2-8420-b21ce12c0323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa2951f365e483281a61d24ed4bca0a', 'request_id': 'req-d1a21b10-5207-40f2-8420-b21ce12c0323'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.773695 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d1a21b10-5207-40f2-8420-b21ce12c0323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa2951f365e483281a61d24ed4bca0a', 'request_id': 'req-d1a21b10-5207-40f2-8420-b21ce12c0323'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.782835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d1a21b10-5207-40f2-8420-b21ce12c0323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa2951f365e483281a61d24ed4bca0a', 'request_id': 'req-d1a21b10-5207-40f2-8420-b21ce12c0323'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.795199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d1a21b10-5207-40f2-8420-b21ce12c0323 admin admin] The token cache is being invalidate because project 4fa2951f365e483281a61d24ed4bca0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:29:08.795468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d1a21b10-5207-40f2-8420-b21ce12c0323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.796226 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d1a21b10-5207-40f2-8420-b21ce12c0323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:08.798109 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1161/2327] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:29:08 2022] DELETE /identity/v3/projects/4fa2951f365e483281a61d24ed4bca0a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:08.803098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165a200-af42-49a2-b804-b90a2fcbaf48 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:08.805066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165a200-af42-49a2-b804-b90a2fcbaf48 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:08.805066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165a200-af42-49a2-b804-b90a2fcbaf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:08.826829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b165a200-af42-49a2-b804-b90a2fcbaf48 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:08.828123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b165a200-af42-49a2-b804-b90a2fcbaf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:08.897844 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1167/2328] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:08.906373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8edbb3-be51-4963-93db-1ca3da0e8de8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:08.906683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8edbb3-be51-4963-93db-1ca3da0e8de8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:08.906975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8edbb3-be51-4963-93db-1ca3da0e8de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:08.927643 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fc8edbb3-be51-4963-93db-1ca3da0e8de8 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:08.929818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fc8edbb3-be51-4963-93db-1ca3da0e8de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:08.937905 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1162/2329] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:08.942967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165a200-af42-49a2-b804-b90a2fcbaf48 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:08.953467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165a200-af42-49a2-b804-b90a2fcbaf48 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:08.961246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2862fa-b91b-4726-a75b-9cbd45e1857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:08.961863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2862fa-b91b-4726-a75b-9cbd45e1857a admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:08.962146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2862fa-b91b-4726-a75b-9cbd45e1857a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:08.962450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2862fa-b91b-4726-a75b-9cbd45e1857a admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:08.963110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2862fa-b91b-4726-a75b-9cbd45e1857a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:29:08.963414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2862fa-b91b-4726-a75b-9cbd45e1857a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:08.965171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2862fa-b91b-4726-a75b-9cbd45e1857a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:08.978306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1168/2330] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:29:08.983144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8edbb3-be51-4963-93db-1ca3da0e8de8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:08.995796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8edbb3-be51-4963-93db-1ca3da0e8de8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:09.002832 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53ccc9-d014-45dc-83e0-74b904fa238a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:09.003554 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53ccc9-d014-45dc-83e0-74b904fa238a admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.003847 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53ccc9-d014-45dc-83e0-74b904fa238a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.004124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53ccc9-d014-45dc-83e0-74b904fa238a admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.004812 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53ccc9-d014-45dc-83e0-74b904fa238a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:09.006775 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53ccc9-d014-45dc-83e0-74b904fa238a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:09.040429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1163/2331] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:29:08 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:09.044946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2862fa-b91b-4726-a75b-9cbd45e1857a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:09.057193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2862fa-b91b-4726-a75b-9cbd45e1857a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:09.091196 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:09.124478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a91f06-67f9-4805-af57-46f85f8f14fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:09.125128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a91f06-67f9-4805-af57-46f85f8f14fc admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.125571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a91f06-67f9-4805-af57-46f85f8f14fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.125878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a91f06-67f9-4805-af57-46f85f8f14fc admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.126523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a91f06-67f9-4805-af57-46f85f8f14fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:09.128452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a91f06-67f9-4805-af57-46f85f8f14fc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:09.153960 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1169/2332] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:29:09 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:09.159849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53ccc9-d014-45dc-83e0-74b904fa238a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:09.172838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53ccc9-d014-45dc-83e0-74b904fa238a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:09.180333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceeb72-f205-416e-b4c3-e90c26e5626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:09.181045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceeb72-f205-416e-b4c3-e90c26e5626d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.181319 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceeb72-f205-416e-b4c3-e90c26e5626d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.181585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceeb72-f205-416e-b4c3-e90c26e5626d admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.182240 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ceeb72-f205-416e-b4c3-e90c26e5626d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:09.183848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ceeb72-f205-416e-b4c3-e90c26e5626d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:09.195138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1164/2333] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:29:09.200343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a91f06-67f9-4805-af57-46f85f8f14fc admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:09.213242 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a91f06-67f9-4805-af57-46f85f8f14fc admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:09.218909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a575a6e-19ed-4cd3-aab2-6e44bfdaedde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:09.219527 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a575a6e-19ed-4cd3-aab2-6e44bfdaedde admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.219797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a575a6e-19ed-4cd3-aab2-6e44bfdaedde admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.220061 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a575a6e-19ed-4cd3-aab2-6e44bfdaedde admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.220697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a575a6e-19ed-4cd3-aab2-6e44bfdaedde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:09.222454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a575a6e-19ed-4cd3-aab2-6e44bfdaedde admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:09.233623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1170/2334] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:09.238384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceeb72-f205-416e-b4c3-e90c26e5626d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:09.249047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceeb72-f205-416e-b4c3-e90c26e5626d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:09.255943 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7176e-050a-46e2-9461-9d03b2d6540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:09.256622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7176e-050a-46e2-9461-9d03b2d6540c admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.256928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7176e-050a-46e2-9461-9d03b2d6540c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.257198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7176e-050a-46e2-9461-9d03b2d6540c admin admin] PATH_INFO: `/v3/projects/8dd05c40add34bfa90e6eb426135a386/users/f6e38095a3fa48878d7d777beebeb660/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.270232 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:09.276186 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7176e-050a-46e2-9461-9d03b2d6540c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd05c40add34bfa90e6eb426135a386, user_id=f6e38095a3fa48878d7d777beebeb660, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:09.281029 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7176e-050a-46e2-9461-9d03b2d6540c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:09.305131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1165/2335] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:09 2022] PUT /identity/v3/projects/8dd05c40add34bfa90e6eb426135a386/users/f6e38095a3fa48878d7d777beebeb660/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:29:09.317562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fa35b-dc91-46b0-954d-5ff3f8ab3a99 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.317845 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fa35b-dc91-46b0-954d-5ff3f8ab3a99 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.318118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fa35b-dc91-46b0-954d-5ff3f8ab3a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.348247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-482fa35b-dc91-46b0-954d-5ff3f8ab3a99 None None] MFA Rules not processed for user `f6e38095a3fa48878d7d777beebeb660`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:09.349668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-482fa35b-dc91-46b0-954d-5ff3f8ab3a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:09.430722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1171/2336] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:09.441187 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7176e-050a-46e2-9461-9d03b2d6540c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:09.513647 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7176e-050a-46e2-9461-9d03b2d6540c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:09.520389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263a1d6-7645-4849-a51f-6a54d47a8140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:09.521493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263a1d6-7645-4849-a51f-6a54d47a8140 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.521891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263a1d6-7645-4849-a51f-6a54d47a8140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.522284 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263a1d6-7645-4849-a51f-6a54d47a8140 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.523359 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263a1d6-7645-4849-a51f-6a54d47a8140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:09.526911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263a1d6-7645-4849-a51f-6a54d47a8140 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:09.566512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1166/2337] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:29:09 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:09.570846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fa35b-dc91-46b0-954d-5ff3f8ab3a99 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:09.582399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fa35b-dc91-46b0-954d-5ff3f8ab3a99 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:09.649779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ec8fe-e74d-4860-9186-8147eb851723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:09.650399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ec8fe-e74d-4860-9186-8147eb851723 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.650673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ec8fe-e74d-4860-9186-8147eb851723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.650943 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ec8fe-e74d-4860-9186-8147eb851723 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.651908 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ec8fe-e74d-4860-9186-8147eb851723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:09.653928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ec8fe-e74d-4860-9186-8147eb851723 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:09.680093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1172/2338] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:29:09 2022] POST /identity/v3/users => generated 302 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:09.684545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263a1d6-7645-4849-a51f-6a54d47a8140 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:09.695949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263a1d6-7645-4849-a51f-6a54d47a8140 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:09.701624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a0553-e04d-4b55-a6cf-0d76f5b9641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:09.702250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a0553-e04d-4b55-a6cf-0d76f5b9641a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.702531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a0553-e04d-4b55-a6cf-0d76f5b9641a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.702801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a0553-e04d-4b55-a6cf-0d76f5b9641a admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.703517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a0553-e04d-4b55-a6cf-0d76f5b9641a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:09.705186 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a0553-e04d-4b55-a6cf-0d76f5b9641a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:09.716913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1167/2339] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:09.721323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ec8fe-e74d-4860-9186-8147eb851723 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:09.740635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ec8fe-e74d-4860-9186-8147eb851723 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:09.745759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195048ef-280e-40ad-ae4c-908e32d61311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:09.746801 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195048ef-280e-40ad-ae4c-908e32d61311 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.747258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195048ef-280e-40ad-ae4c-908e32d61311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.747675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195048ef-280e-40ad-ae4c-908e32d61311 admin admin] PATH_INFO: `/v3/projects/46ea8c8111e04c64beada7b6114e10d0/users/dea861358def433fac95ead0ecfe5c41/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.764966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195048ef-280e-40ad-ae4c-908e32d61311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ea8c8111e04c64beada7b6114e10d0, user_id=dea861358def433fac95ead0ecfe5c41, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:09.767642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195048ef-280e-40ad-ae4c-908e32d61311 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:09.783888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1173/2340] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:09 2022] PUT /identity/v3/projects/46ea8c8111e04c64beada7b6114e10d0/users/dea861358def433fac95ead0ecfe5c41/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:09.788246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a0553-e04d-4b55-a6cf-0d76f5b9641a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:09.798696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a0553-e04d-4b55-a6cf-0d76f5b9641a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:09.868517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a66916-a58f-4409-bc67-f6452351a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:09.868767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a66916-a58f-4409-bc67-f6452351a154 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.868879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a66916-a58f-4409-bc67-f6452351a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.869148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a66916-a58f-4409-bc67-f6452351a154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.869801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a66916-a58f-4409-bc67-f6452351a154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:09.871447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a66916-a58f-4409-bc67-f6452351a154 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:09.881941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1168/2341] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:09.886610 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195048ef-280e-40ad-ae4c-908e32d61311 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:09.904397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195048ef-280e-40ad-ae4c-908e32d61311 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:09.910853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a58e37-b55b-41c2-8abe-d7b386e92afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:09.912917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a58e37-b55b-41c2-8abe-d7b386e92afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.912917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a58e37-b55b-41c2-8abe-d7b386e92afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.912917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a58e37-b55b-41c2-8abe-d7b386e92afe admin admin] PATH_INFO: `/v3/projects/46ea8c8111e04c64beada7b6114e10d0/users/dea861358def433fac95ead0ecfe5c41/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.914341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a58e37-b55b-41c2-8abe-d7b386e92afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ea8c8111e04c64beada7b6114e10d0, user_id=dea861358def433fac95ead0ecfe5c41, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:09.917981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a58e37-b55b-41c2-8abe-d7b386e92afe admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:09.921451 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:09.932876 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1174/2342] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:09 2022] PUT /identity/v3/projects/46ea8c8111e04c64beada7b6114e10d0/users/dea861358def433fac95ead0ecfe5c41/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:29:09.944452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881288f9-4b83-4430-b53b-02b8e255463f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:09.944452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881288f9-4b83-4430-b53b-02b8e255463f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:09.944452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881288f9-4b83-4430-b53b-02b8e255463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:09.975639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-881288f9-4b83-4430-b53b-02b8e255463f None None] MFA Rules not processed for user `dea861358def433fac95ead0ecfe5c41`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:09.976952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-881288f9-4b83-4430-b53b-02b8e255463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:10.035318 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:10.061268 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1169/2343] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:10.077672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a58e37-b55b-41c2-8abe-d7b386e92afe admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:10.079670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-86a58e37-b55b-41c2-8abe-d7b386e92afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:10.149808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a58e37-b55b-41c2-8abe-d7b386e92afe admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:10.154660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a46d6d-f62f-4c52-90f4-3d1a8bc38c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:10.155310 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a46d6d-f62f-4c52-90f4-3d1a8bc38c11 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:10.155591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a46d6d-f62f-4c52-90f4-3d1a8bc38c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:10.155867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a46d6d-f62f-4c52-90f4-3d1a8bc38c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:10.166319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a46d6d-f62f-4c52-90f4-3d1a8bc38c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:10.168109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a46d6d-f62f-4c52-90f4-3d1a8bc38c11 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:10.179025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1175/2344] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:10.227704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881288f9-4b83-4430-b53b-02b8e255463f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:10.229416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-881288f9-4b83-4430-b53b-02b8e255463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:10.244399 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881288f9-4b83-4430-b53b-02b8e255463f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:10.248290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aaaeb-d16a-4b68-9e09-d49a16362f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:10.248937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aaaeb-d16a-4b68-9e09-d49a16362f10 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:10.249211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aaaeb-d16a-4b68-9e09-d49a16362f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:10.249477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aaaeb-d16a-4b68-9e09-d49a16362f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:10.312403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aaaeb-d16a-4b68-9e09-d49a16362f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:10.314018 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aaaeb-d16a-4b68-9e09-d49a16362f10 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:10.323513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1170/2345] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:10 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:13.789889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a46d6d-f62f-4c52-90f4-3d1a8bc38c11 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:13.855145 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a46d6d-f62f-4c52-90f4-3d1a8bc38c11 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:13.860356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:13.861011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:13.861566 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:13.861566 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] PATH_INFO: `/v3/users/f6e38095a3fa48878d7d777beebeb660` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:13.862691 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e38095a3fa48878d7d777beebeb660)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:13.864827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:13.914923 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e38095a3fa48878d7d777beebeb660'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:13.915692 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e38095a3fa48878d7d777beebeb660'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:13.926588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e38095a3fa48878d7d777beebeb660'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:13.934378 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e38095a3fa48878d7d777beebeb660'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:13.935153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e38095a3fa48878d7d777beebeb660'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:13.953856 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1176/2346] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:29:13 2022] DELETE /identity/v3/users/f6e38095a3fa48878d7d777beebeb660 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:13.958762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99961920-ba18-4017-b686-967cd5e17537 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:13.959252 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99961920-ba18-4017-b686-967cd5e17537 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:13.959345 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99961920-ba18-4017-b686-967cd5e17537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:13.981305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-99961920-ba18-4017-b686-967cd5e17537 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:13.982533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-99961920-ba18-4017-b686-967cd5e17537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:14.057402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1171/2347] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:14.067347 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:14.068751 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:14.087321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:14.130037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a89bb-f201-4063-9fa6-b750b74d56bd admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:14.133899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be6bd8-67b2-472b-9069-80f29c0a01fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:14.134521 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be6bd8-67b2-472b-9069-80f29c0a01fb service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:14.134786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be6bd8-67b2-472b-9069-80f29c0a01fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:14.135075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be6bd8-67b2-472b-9069-80f29c0a01fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:14.145201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be6bd8-67b2-472b-9069-80f29c0a01fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:14.146590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be6bd8-67b2-472b-9069-80f29c0a01fb service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:14.156693 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1177/2348] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:14.440424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99961920-ba18-4017-b686-967cd5e17537 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:14.442032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-99961920-ba18-4017-b686-967cd5e17537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:14.456088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99961920-ba18-4017-b686-967cd5e17537 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:14.460940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:14.461599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:14.461878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:14.462146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] PATH_INFO: `/v3/projects/8dd05c40add34bfa90e6eb426135a386` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:14.463289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd05c40add34bfa90e6eb426135a386)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:14.465627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:14.524325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd05c40add34bfa90e6eb426135a386', 'request_id': 'req-8c6607e8-4345-4f45-be43-713eb95e80eb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:14.534552 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd05c40add34bfa90e6eb426135a386', 'request_id': 'req-8c6607e8-4345-4f45-be43-713eb95e80eb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:14.545372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd05c40add34bfa90e6eb426135a386', 'request_id': 'req-8c6607e8-4345-4f45-be43-713eb95e80eb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:14.556511 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] The token cache is being invalidate because project 8dd05c40add34bfa90e6eb426135a386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:29:14.556908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:14.557514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:14.559172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1172/2349] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:29:14 2022] DELETE /identity/v3/projects/8dd05c40add34bfa90e6eb426135a386 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:14.563353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be6bd8-67b2-472b-9069-80f29c0a01fb service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:14.574455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be6bd8-67b2-472b-9069-80f29c0a01fb service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:14.640375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c899368-9ca5-47e7-9fee-0d426f2fbeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:14.641094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c899368-9ca5-47e7-9fee-0d426f2fbeb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:14.641371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c899368-9ca5-47e7-9fee-0d426f2fbeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:14.641644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c899368-9ca5-47e7-9fee-0d426f2fbeb5 admin admin] PATH_INFO: `/v3/users/dea861358def433fac95ead0ecfe5c41` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:14.642892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c899368-9ca5-47e7-9fee-0d426f2fbeb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea861358def433fac95ead0ecfe5c41)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:14.644912 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c899368-9ca5-47e7-9fee-0d426f2fbeb5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:14.699809 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1c899368-9ca5-47e7-9fee-0d426f2fbeb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea861358def433fac95ead0ecfe5c41'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:14.700552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1c899368-9ca5-47e7-9fee-0d426f2fbeb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea861358def433fac95ead0ecfe5c41'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:14.710047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1c899368-9ca5-47e7-9fee-0d426f2fbeb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea861358def433fac95ead0ecfe5c41'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:14.718072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1c899368-9ca5-47e7-9fee-0d426f2fbeb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea861358def433fac95ead0ecfe5c41'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:14.718749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1c899368-9ca5-47e7-9fee-0d426f2fbeb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea861358def433fac95ead0ecfe5c41'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:14.737063 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1178/2350] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:29:14 2022] DELETE /identity/v3/users/dea861358def433fac95ead0ecfe5c41 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:15.058432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:15.060068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:15.074706 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6607e8-4345-4f45-be43-713eb95e80eb admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:15.080406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:15.149700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d752a72-2086-44a8-b630-2cf92f697184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:15.150348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d752a72-2086-44a8-b630-2cf92f697184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:15.150599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d752a72-2086-44a8-b630-2cf92f697184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:15.150874 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d752a72-2086-44a8-b630-2cf92f697184 admin admin] PATH_INFO: `/v3/projects/46ea8c8111e04c64beada7b6114e10d0` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:15.152363 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d752a72-2086-44a8-b630-2cf92f697184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ea8c8111e04c64beada7b6114e10d0)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:15.154335 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d752a72-2086-44a8-b630-2cf92f697184 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:15.215248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d752a72-2086-44a8-b630-2cf92f697184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ea8c8111e04c64beada7b6114e10d0', 'request_id': 'req-1d752a72-2086-44a8-b630-2cf92f697184'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:15.224771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d752a72-2086-44a8-b630-2cf92f697184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ea8c8111e04c64beada7b6114e10d0', 'request_id': 'req-1d752a72-2086-44a8-b630-2cf92f697184'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:15.234990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d752a72-2086-44a8-b630-2cf92f697184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ea8c8111e04c64beada7b6114e10d0', 'request_id': 'req-1d752a72-2086-44a8-b630-2cf92f697184'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:15.249868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d752a72-2086-44a8-b630-2cf92f697184 admin admin] The token cache is being invalidate because project 46ea8c8111e04c64beada7b6114e10d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:29:15.250629 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d752a72-2086-44a8-b630-2cf92f697184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:15.251144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1d752a72-2086-44a8-b630-2cf92f697184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:15.256754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1173/2351] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:29:15 2022] DELETE /identity/v3/projects/46ea8c8111e04c64beada7b6114e10d0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:15.258284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088a58c-671e-4e32-bfab-87029c33d507 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:15.258750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088a58c-671e-4e32-bfab-87029c33d507 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:15.258847 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088a58c-671e-4e32-bfab-87029c33d507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:15.281043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d088a58c-671e-4e32-bfab-87029c33d507 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:15.282253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d088a58c-671e-4e32-bfab-87029c33d507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:15.323169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:15.368470 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1179/2352] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:29:15.376440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bdae6-b94c-4df5-9ad7-2b9f6a49d76b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:15.376740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bdae6-b94c-4df5-9ad7-2b9f6a49d76b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:15.377018 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bdae6-b94c-4df5-9ad7-2b9f6a49d76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:15.397474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2e1bdae6-b94c-4df5-9ad7-2b9f6a49d76b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:15.398918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2e1bdae6-b94c-4df5-9ad7-2b9f6a49d76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:15.407486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1174/2353] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:15.411999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088a58c-671e-4e32-bfab-87029c33d507 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:15.422224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088a58c-671e-4e32-bfab-87029c33d507 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:15.427360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac875f-7df4-4069-8db7-3ba26e893695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:15.427990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac875f-7df4-4069-8db7-3ba26e893695 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:15.428271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac875f-7df4-4069-8db7-3ba26e893695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:15.428540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac875f-7df4-4069-8db7-3ba26e893695 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:15.429249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac875f-7df4-4069-8db7-3ba26e893695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:29:15.429538 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac875f-7df4-4069-8db7-3ba26e893695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:15.431181 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac875f-7df4-4069-8db7-3ba26e893695 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:15.444738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1180/2354] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:29:15.448956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bdae6-b94c-4df5-9ad7-2b9f6a49d76b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:15.458623 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bdae6-b94c-4df5-9ad7-2b9f6a49d76b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:15.463712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14ace-8df6-48ea-8cf4-acedfe3f93af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:15.464336 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14ace-8df6-48ea-8cf4-acedfe3f93af admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:15.464613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14ace-8df6-48ea-8cf4-acedfe3f93af admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:15.464915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14ace-8df6-48ea-8cf4-acedfe3f93af admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:15.465585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be14ace-8df6-48ea-8cf4-acedfe3f93af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:15.467605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be14ace-8df6-48ea-8cf4-acedfe3f93af admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:15.498096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1175/2355] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:29:15 2022] POST /identity/v3/projects => generated 409 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:15.504440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac875f-7df4-4069-8db7-3ba26e893695 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:15.515631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac875f-7df4-4069-8db7-3ba26e893695 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:15.577316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98586c08-de2f-4a67-8dee-5051291d96f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:15.578016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98586c08-de2f-4a67-8dee-5051291d96f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:15.578355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98586c08-de2f-4a67-8dee-5051291d96f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:15.578709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98586c08-de2f-4a67-8dee-5051291d96f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:15.579428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98586c08-de2f-4a67-8dee-5051291d96f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:15.581519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98586c08-de2f-4a67-8dee-5051291d96f7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:15.610187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1181/2356] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:29:15 2022] POST /identity/v3/users => generated 305 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:15.611435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14ace-8df6-48ea-8cf4-acedfe3f93af admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:15.622871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14ace-8df6-48ea-8cf4-acedfe3f93af admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:15.627661 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c824a-5172-4322-82f9-e4fe3ec627e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:15.628287 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c824a-5172-4322-82f9-e4fe3ec627e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:15.628569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c824a-5172-4322-82f9-e4fe3ec627e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:15.629030 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c824a-5172-4322-82f9-e4fe3ec627e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:15.629799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c824a-5172-4322-82f9-e4fe3ec627e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:15.631441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c824a-5172-4322-82f9-e4fe3ec627e5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:15.645970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1176/2357] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:15.647146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98586c08-de2f-4a67-8dee-5051291d96f7 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:15.657951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98586c08-de2f-4a67-8dee-5051291d96f7 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:15.662804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5e9be-8d06-4563-b2cb-35af38d14a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:15.663446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5e9be-8d06-4563-b2cb-35af38d14a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:15.663721 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5e9be-8d06-4563-b2cb-35af38d14a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:15.663988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5e9be-8d06-4563-b2cb-35af38d14a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:15.664647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5e9be-8d06-4563-b2cb-35af38d14a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:15.666373 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5e9be-8d06-4563-b2cb-35af38d14a3e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:15.677908 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1182/2358] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:15.682662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c824a-5172-4322-82f9-e4fe3ec627e5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:15.694116 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c824a-5172-4322-82f9-e4fe3ec627e5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:15.700595 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc7d17-e683-4aa7-909c-fcc1c41a031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:15.701677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc7d17-e683-4aa7-909c-fcc1c41a031c admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:15.702032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc7d17-e683-4aa7-909c-fcc1c41a031c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:15.702365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc7d17-e683-4aa7-909c-fcc1c41a031c admin admin] PATH_INFO: `/v3/projects/991a0a5e31164261b5294d1f91c7e034/users/a9f8ad5ebb194697ae297d7d97d3fef2/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:15.719759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc7d17-e683-4aa7-909c-fcc1c41a031c admin admin] RBAC: Authorizing `identity:create_grant(project_id=991a0a5e31164261b5294d1f91c7e034, user_id=a9f8ad5ebb194697ae297d7d97d3fef2, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:15.722515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc7d17-e683-4aa7-909c-fcc1c41a031c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:15.737917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1177/2359] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:15 2022] PUT /identity/v3/projects/991a0a5e31164261b5294d1f91c7e034/users/a9f8ad5ebb194697ae297d7d97d3fef2/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:29:15.750069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd622ea-83da-4988-9ba9-70dd54f6b5f0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:15.750356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd622ea-83da-4988-9ba9-70dd54f6b5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:15.750642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd622ea-83da-4988-9ba9-70dd54f6b5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:15.782144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fcd622ea-83da-4988-9ba9-70dd54f6b5f0 None None] MFA Rules not processed for user `a9f8ad5ebb194697ae297d7d97d3fef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:15.783410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fcd622ea-83da-4988-9ba9-70dd54f6b5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:15.856536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1183/2360] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:15 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:15.861303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc7d17-e683-4aa7-909c-fcc1c41a031c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:15.899731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:15.932154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc7d17-e683-4aa7-909c-fcc1c41a031c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:15.936978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7a89f-830d-4990-a38f-6f5eafd96f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:15.937722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7a89f-830d-4990-a38f-6f5eafd96f65 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:15.938008 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7a89f-830d-4990-a38f-6f5eafd96f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:15.938386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7a89f-830d-4990-a38f-6f5eafd96f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:15.939444 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7a89f-830d-4990-a38f-6f5eafd96f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:15.943121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7a89f-830d-4990-a38f-6f5eafd96f65 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:15.991500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1178/2361] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:29:15 2022] POST /identity/v3/projects => generated 407 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:15.995827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd622ea-83da-4988-9ba9-70dd54f6b5f0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:16.011525 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd622ea-83da-4988-9ba9-70dd54f6b5f0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:16.045530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:16.075038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d112713-f3dc-4281-82f9-2b9ab4913493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:16.075830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d112713-f3dc-4281-82f9-2b9ab4913493 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:16.076243 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d112713-f3dc-4281-82f9-2b9ab4913493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:16.076521 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d112713-f3dc-4281-82f9-2b9ab4913493 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:16.077237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d112713-f3dc-4281-82f9-2b9ab4913493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:16.079243 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d112713-f3dc-4281-82f9-2b9ab4913493 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:16.102081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1184/2362] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:29:15 2022] POST /identity/v3/users => generated 310 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:16.106649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7a89f-830d-4990-a38f-6f5eafd96f65 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:16.117681 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7a89f-830d-4990-a38f-6f5eafd96f65 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:16.123777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35099c-eab8-4cbe-ae3c-f218bebd5291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:16.124428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35099c-eab8-4cbe-ae3c-f218bebd5291 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:16.124735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35099c-eab8-4cbe-ae3c-f218bebd5291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:16.125029 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35099c-eab8-4cbe-ae3c-f218bebd5291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:16.125697 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35099c-eab8-4cbe-ae3c-f218bebd5291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:16.127352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35099c-eab8-4cbe-ae3c-f218bebd5291 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:16.139098 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1179/2363] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:16.143447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d112713-f3dc-4281-82f9-2b9ab4913493 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:16.155120 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d112713-f3dc-4281-82f9-2b9ab4913493 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:16.162333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccfea9-8a92-4a05-aea0-0f231f63b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:16.163050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccfea9-8a92-4a05-aea0-0f231f63b055 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:16.163329 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccfea9-8a92-4a05-aea0-0f231f63b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:16.163601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccfea9-8a92-4a05-aea0-0f231f63b055 admin admin] PATH_INFO: `/v3/projects/ff0454f003d64aba91bbb7936b868f91/users/2d43ce3a817343e39bec3f11fa2b2d0c/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:16.179741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccfea9-8a92-4a05-aea0-0f231f63b055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0454f003d64aba91bbb7936b868f91, user_id=2d43ce3a817343e39bec3f11fa2b2d0c, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:16.182476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccfea9-8a92-4a05-aea0-0f231f63b055 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:16.197639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1185/2364] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:16 2022] PUT /identity/v3/projects/ff0454f003d64aba91bbb7936b868f91/users/2d43ce3a817343e39bec3f11fa2b2d0c/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:16.202062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35099c-eab8-4cbe-ae3c-f218bebd5291 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:16.213835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35099c-eab8-4cbe-ae3c-f218bebd5291 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:16.278489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a42f9-7cd5-413d-b4b4-9a07fff6793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:16.279130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a42f9-7cd5-413d-b4b4-9a07fff6793f admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:16.279409 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a42f9-7cd5-413d-b4b4-9a07fff6793f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:16.279683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a42f9-7cd5-413d-b4b4-9a07fff6793f admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:16.280360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a42f9-7cd5-413d-b4b4-9a07fff6793f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:16.282087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a42f9-7cd5-413d-b4b4-9a07fff6793f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:16.296745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1180/2365] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:29:16.297984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccfea9-8a92-4a05-aea0-0f231f63b055 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:16.309245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccfea9-8a92-4a05-aea0-0f231f63b055 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:16.314383 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c15fc-5016-4a46-9cb3-87b1a9cb8c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:16.315104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c15fc-5016-4a46-9cb3-87b1a9cb8c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:16.315394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c15fc-5016-4a46-9cb3-87b1a9cb8c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:16.315667 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c15fc-5016-4a46-9cb3-87b1a9cb8c62 admin admin] PATH_INFO: `/v3/projects/ff0454f003d64aba91bbb7936b868f91/users/2d43ce3a817343e39bec3f11fa2b2d0c/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:16.317821 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c15fc-5016-4a46-9cb3-87b1a9cb8c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0454f003d64aba91bbb7936b868f91, user_id=2d43ce3a817343e39bec3f11fa2b2d0c, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:16.320603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c15fc-5016-4a46-9cb3-87b1a9cb8c62 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:16.332455 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1186/2366] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:16 2022] PUT /identity/v3/projects/ff0454f003d64aba91bbb7936b868f91/users/2d43ce3a817343e39bec3f11fa2b2d0c/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:16.343624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cedf4-3b7a-4eda-8b43-53f9b536789b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:16.343864 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cedf4-3b7a-4eda-8b43-53f9b536789b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:16.344173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cedf4-3b7a-4eda-8b43-53f9b536789b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:16.378912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8b2cedf4-3b7a-4eda-8b43-53f9b536789b None None] MFA Rules not processed for user `2d43ce3a817343e39bec3f11fa2b2d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:16.380303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8b2cedf4-3b7a-4eda-8b43-53f9b536789b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:16.457400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1181/2367] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:16 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:16.468813 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c15fc-5016-4a46-9cb3-87b1a9cb8c62 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:16.470816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e42c15fc-5016-4a46-9cb3-87b1a9cb8c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:16.538247 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c15fc-5016-4a46-9cb3-87b1a9cb8c62 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:16.552428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26bada-ed3c-435e-91f6-7f519b3c8cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:16.553114 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26bada-ed3c-435e-91f6-7f519b3c8cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:16.553518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26bada-ed3c-435e-91f6-7f519b3c8cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:16.553800 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26bada-ed3c-435e-91f6-7f519b3c8cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:16.566202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26bada-ed3c-435e-91f6-7f519b3c8cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:16.568448 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26bada-ed3c-435e-91f6-7f519b3c8cc3 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:16.579356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1187/2368] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:16 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:16.752538 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cedf4-3b7a-4eda-8b43-53f9b536789b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:16.762722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cedf4-3b7a-4eda-8b43-53f9b536789b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:16.766896 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387daffe-679e-468d-b0e0-abed3dd8862d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:16.767605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387daffe-679e-468d-b0e0-abed3dd8862d service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:16.767953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387daffe-679e-468d-b0e0-abed3dd8862d service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:16.768295 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387daffe-679e-468d-b0e0-abed3dd8862d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:16.924752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:16.957438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387daffe-679e-468d-b0e0-abed3dd8862d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:16.958949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387daffe-679e-468d-b0e0-abed3dd8862d service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:16.968024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1182/2369] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:16 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:17.073332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26bada-ed3c-435e-91f6-7f519b3c8cc3 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:17.074925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-df26bada-ed3c-435e-91f6-7f519b3c8cc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:17.163639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26bada-ed3c-435e-91f6-7f519b3c8cc3 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:17.170002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88748f56-9529-48e3-b197-b84395524cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:17.170983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748f56-9529-48e3-b197-b84395524cc6 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:17.171305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748f56-9529-48e3-b197-b84395524cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:17.171615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748f56-9529-48e3-b197-b84395524cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:17.178119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-88748f56-9529-48e3-b197-b84395524cc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:17.193852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88748f56-9529-48e3-b197-b84395524cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:17.195707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88748f56-9529-48e3-b197-b84395524cc6 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:17.207781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1188/2370] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:24.408900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387daffe-679e-468d-b0e0-abed3dd8862d service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:24.479217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387daffe-679e-468d-b0e0-abed3dd8862d service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:24.484596 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:24.485267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:24.485547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:24.485815 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] PATH_INFO: `/v3/users/a9f8ad5ebb194697ae297d7d97d3fef2` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:24.487038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f8ad5ebb194697ae297d7d97d3fef2)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:24.488995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:24.542523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f8ad5ebb194697ae297d7d97d3fef2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:24.554711 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f8ad5ebb194697ae297d7d97d3fef2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:24.555398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f8ad5ebb194697ae297d7d97d3fef2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:24.562467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f8ad5ebb194697ae297d7d97d3fef2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:24.572973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f8ad5ebb194697ae297d7d97d3fef2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:24.579431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1183/2371] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:29:24 2022] DELETE /identity/v3/users/a9f8ad5ebb194697ae297d7d97d3fef2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:24.585226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ce149-fb61-4fe7-b26d-63195720d64f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:24.585782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ce149-fb61-4fe7-b26d-63195720d64f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:24.586055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ce149-fb61-4fe7-b26d-63195720d64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:24.612654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b30ce149-fb61-4fe7-b26d-63195720d64f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:24.614449 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b30ce149-fb61-4fe7-b26d-63195720d64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:24.626549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:24.693903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1189/2372] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:24.704411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:24.706290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:24.765028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:24.770929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecbe95-f3bd-4fd8-9514-77caa18bc264 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:24.775670 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575207a-b4f5-4308-bdc1-2f68be810fe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:24.776292 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575207a-b4f5-4308-bdc1-2f68be810fe8 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:24.776573 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575207a-b4f5-4308-bdc1-2f68be810fe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:24.776888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575207a-b4f5-4308-bdc1-2f68be810fe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:24.787583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575207a-b4f5-4308-bdc1-2f68be810fe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:24.789064 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575207a-b4f5-4308-bdc1-2f68be810fe8 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:24.798468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1184/2373] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:25.098549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ce149-fb61-4fe7-b26d-63195720d64f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:25.100378 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b30ce149-fb61-4fe7-b26d-63195720d64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:25.114015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ce149-fb61-4fe7-b26d-63195720d64f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:25.118984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:25.119777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:25.120124 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:25.120758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] PATH_INFO: `/v3/projects/991a0a5e31164261b5294d1f91c7e034` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:25.122036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991a0a5e31164261b5294d1f91c7e034)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:25.123987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:25.173571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991a0a5e31164261b5294d1f91c7e034', 'request_id': 'req-32a34de3-ab21-420e-a2f3-8a2cc537bd61'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.179241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991a0a5e31164261b5294d1f91c7e034', 'request_id': 'req-32a34de3-ab21-420e-a2f3-8a2cc537bd61'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.186323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991a0a5e31164261b5294d1f91c7e034', 'request_id': 'req-32a34de3-ab21-420e-a2f3-8a2cc537bd61'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.200170 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] The token cache is being invalidate because project 991a0a5e31164261b5294d1f91c7e034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:29:25.200464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.201318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.203013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1190/2374] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:29:25 2022] DELETE /identity/v3/projects/991a0a5e31164261b5294d1f91c7e034 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:25.207389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575207a-b4f5-4308-bdc1-2f68be810fe8 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:25.223007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575207a-b4f5-4308-bdc1-2f68be810fe8 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:25.284777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc2a12-c138-4f6b-9ce7-1e48e467e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:25.285357 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc2a12-c138-4f6b-9ce7-1e48e467e72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:25.285683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc2a12-c138-4f6b-9ce7-1e48e467e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:25.285950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc2a12-c138-4f6b-9ce7-1e48e467e72f admin admin] PATH_INFO: `/v3/users/2d43ce3a817343e39bec3f11fa2b2d0c` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:25.287175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc2a12-c138-4f6b-9ce7-1e48e467e72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d43ce3a817343e39bec3f11fa2b2d0c)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:25.289201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc2a12-c138-4f6b-9ce7-1e48e467e72f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:25.348503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1acc2a12-c138-4f6b-9ce7-1e48e467e72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d43ce3a817343e39bec3f11fa2b2d0c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.363084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1acc2a12-c138-4f6b-9ce7-1e48e467e72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d43ce3a817343e39bec3f11fa2b2d0c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.363868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1acc2a12-c138-4f6b-9ce7-1e48e467e72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d43ce3a817343e39bec3f11fa2b2d0c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.371524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1acc2a12-c138-4f6b-9ce7-1e48e467e72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d43ce3a817343e39bec3f11fa2b2d0c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.381319 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1acc2a12-c138-4f6b-9ce7-1e48e467e72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d43ce3a817343e39bec3f11fa2b2d0c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.388980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1185/2375] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:29:25 2022] DELETE /identity/v3/users/2d43ce3a817343e39bec3f11fa2b2d0c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:25.674895 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:25.676452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:25.691124 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a34de3-ab21-420e-a2f3-8a2cc537bd61 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:25.758757 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:25.759402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:25.759669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:25.759945 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95 admin admin] PATH_INFO: `/v3/projects/ff0454f003d64aba91bbb7936b868f91` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:25.761178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0454f003d64aba91bbb7936b868f91)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:25.763138 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:25.810941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:25.820402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0454f003d64aba91bbb7936b868f91', 'request_id': 'req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.828956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0454f003d64aba91bbb7936b868f91', 'request_id': 'req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.836395 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0454f003d64aba91bbb7936b868f91', 'request_id': 'req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.850585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95 admin admin] The token cache is being invalidate because project ff0454f003d64aba91bbb7936b868f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:29:25.850874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.851551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a81c34e5-d071-4ac8-bdf4-3a35cd23ee95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:25.853152 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1191/2376] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:29:25 2022] DELETE /identity/v3/projects/ff0454f003d64aba91bbb7936b868f91 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:25.858842 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18121adb-6aa9-4dd9-9872-681ea9a86c26 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:25.859604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18121adb-6aa9-4dd9-9872-681ea9a86c26 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:25.859904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18121adb-6aa9-4dd9-9872-681ea9a86c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:25.887955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-18121adb-6aa9-4dd9-9872-681ea9a86c26 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:25.890069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-18121adb-6aa9-4dd9-9872-681ea9a86c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:25.973429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1186/2377] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:25.982986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc788-8e2f-4ab3-9b62-2ade729dd15e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:25.983217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc788-8e2f-4ab3-9b62-2ade729dd15e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:25.983516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc788-8e2f-4ab3-9b62-2ade729dd15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.012996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8d6bc788-8e2f-4ab3-9b62-2ade729dd15e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:26.014415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8d6bc788-8e2f-4ab3-9b62-2ade729dd15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:26.025017 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1192/2378] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:26.029638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18121adb-6aa9-4dd9-9872-681ea9a86c26 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:26.043914 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18121adb-6aa9-4dd9-9872-681ea9a86c26 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:26.049947 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b7fd9-d802-482e-9b02-ff718757494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:26.050677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b7fd9-d802-482e-9b02-ff718757494f admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.051014 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b7fd9-d802-482e-9b02-ff718757494f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.051323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b7fd9-d802-482e-9b02-ff718757494f admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.052441 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b7fd9-d802-482e-9b02-ff718757494f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:29:26.052871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b7fd9-d802-482e-9b02-ff718757494f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:26.054651 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b7fd9-d802-482e-9b02-ff718757494f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:26.058215 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:26.073616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1187/2379] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:29:26.075074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bc788-8e2f-4ab3-9b62-2ade729dd15e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:26.086109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bc788-8e2f-4ab3-9b62-2ade729dd15e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:26.091856 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e05f64-f534-4a92-bc6b-9085fecb20fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:26.092512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e05f64-f534-4a92-bc6b-9085fecb20fd admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.092851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e05f64-f534-4a92-bc6b-9085fecb20fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.093125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e05f64-f534-4a92-bc6b-9085fecb20fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.093763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e05f64-f534-4a92-bc6b-9085fecb20fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:26.095743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e05f64-f534-4a92-bc6b-9085fecb20fd admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:26.128770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1193/2380] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:29:26 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:26.133347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b7fd9-d802-482e-9b02-ff718757494f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:26.151346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b7fd9-d802-482e-9b02-ff718757494f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:26.217386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fb9a6-60b9-4264-9fe6-410034fd1d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:26.218016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fb9a6-60b9-4264-9fe6-410034fd1d3f admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.218299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fb9a6-60b9-4264-9fe6-410034fd1d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.218585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fb9a6-60b9-4264-9fe6-410034fd1d3f admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.219219 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fb9a6-60b9-4264-9fe6-410034fd1d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:26.221177 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fb9a6-60b9-4264-9fe6-410034fd1d3f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:26.243641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1188/2381] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:29:26 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:26.247673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e05f64-f534-4a92-bc6b-9085fecb20fd admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:26.261348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e05f64-f534-4a92-bc6b-9085fecb20fd admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:26.263654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae109b9a-8225-4b6e-871c-a3ae24939e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:26.264296 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae109b9a-8225-4b6e-871c-a3ae24939e21 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.264682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae109b9a-8225-4b6e-871c-a3ae24939e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.264960 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae109b9a-8225-4b6e-871c-a3ae24939e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.265550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae109b9a-8225-4b6e-871c-a3ae24939e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:26.267243 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae109b9a-8225-4b6e-871c-a3ae24939e21 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:26.278046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1194/2382] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:26.285099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fb9a6-60b9-4264-9fe6-410034fd1d3f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:26.295228 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fb9a6-60b9-4264-9fe6-410034fd1d3f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:26.300475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a3db5-aea6-4280-81bf-09429265a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:26.301165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a3db5-aea6-4280-81bf-09429265a891 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.301453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a3db5-aea6-4280-81bf-09429265a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.301728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a3db5-aea6-4280-81bf-09429265a891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.302425 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a3db5-aea6-4280-81bf-09429265a891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:26.304100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a3db5-aea6-4280-81bf-09429265a891 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:26.314352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1189/2383] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:26.318862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae109b9a-8225-4b6e-871c-a3ae24939e21 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:26.329610 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae109b9a-8225-4b6e-871c-a3ae24939e21 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:26.334525 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb0450-b497-49ad-89f4-0df2ad8a0749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:26.335178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb0450-b497-49ad-89f4-0df2ad8a0749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.335460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb0450-b497-49ad-89f4-0df2ad8a0749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.335735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb0450-b497-49ad-89f4-0df2ad8a0749 admin admin] PATH_INFO: `/v3/projects/5ad82e613d3d498d9f9b31ac814b748e/users/e9cec11ae5994ce28f4a16bab4321fb2/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.351440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb0450-b497-49ad-89f4-0df2ad8a0749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad82e613d3d498d9f9b31ac814b748e, user_id=e9cec11ae5994ce28f4a16bab4321fb2, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:26.354189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb0450-b497-49ad-89f4-0df2ad8a0749 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:26.368319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1195/2384] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:26 2022] PUT /identity/v3/projects/5ad82e613d3d498d9f9b31ac814b748e/users/e9cec11ae5994ce28f4a16bab4321fb2/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:26.379011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c82b16-2f70-44bc-b072-8226993c4846 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.379301 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c82b16-2f70-44bc-b072-8226993c4846 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.379569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c82b16-2f70-44bc-b072-8226993c4846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.411342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a5c82b16-2f70-44bc-b072-8226993c4846 None None] MFA Rules not processed for user `e9cec11ae5994ce28f4a16bab4321fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:26.412611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a5c82b16-2f70-44bc-b072-8226993c4846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:26.484525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1190/2385] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:26.489360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb0450-b497-49ad-89f4-0df2ad8a0749 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:26.553190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb0450-b497-49ad-89f4-0df2ad8a0749 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:26.558207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec7a75-6303-45ac-a2f1-1e3184132195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:26.558804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec7a75-6303-45ac-a2f1-1e3184132195 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.559084 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec7a75-6303-45ac-a2f1-1e3184132195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.559355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec7a75-6303-45ac-a2f1-1e3184132195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.559989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec7a75-6303-45ac-a2f1-1e3184132195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:26.561957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec7a75-6303-45ac-a2f1-1e3184132195 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:26.590113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1196/2386] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:29:26 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:26.594257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c82b16-2f70-44bc-b072-8226993c4846 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:26.604915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c82b16-2f70-44bc-b072-8226993c4846 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:26.662194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fd483-69e9-4114-a7d6-d9acbda37f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:26.663633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fd483-69e9-4114-a7d6-d9acbda37f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.664294 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fd483-69e9-4114-a7d6-d9acbda37f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.664577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fd483-69e9-4114-a7d6-d9acbda37f85 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.665255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fd483-69e9-4114-a7d6-d9acbda37f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:26.667182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fd483-69e9-4114-a7d6-d9acbda37f85 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:26.677539 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:26.692761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1191/2387] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:29:26 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:26.696830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec7a75-6303-45ac-a2f1-1e3184132195 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:26.707999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec7a75-6303-45ac-a2f1-1e3184132195 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:26.713550 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f0731-fa61-4480-98bc-65c5aca17d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:26.714294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f0731-fa61-4480-98bc-65c5aca17d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.714577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f0731-fa61-4480-98bc-65c5aca17d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.714852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f0731-fa61-4480-98bc-65c5aca17d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.715535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f0731-fa61-4480-98bc-65c5aca17d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:26.717372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f0731-fa61-4480-98bc-65c5aca17d10 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:26.729200 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1197/2388] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:26.733566 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fd483-69e9-4114-a7d6-d9acbda37f85 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:26.744329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fd483-69e9-4114-a7d6-d9acbda37f85 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:26.749646 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92776967-bb28-4dc1-86b2-263ce288b226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:26.750332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92776967-bb28-4dc1-86b2-263ce288b226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.750608 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92776967-bb28-4dc1-86b2-263ce288b226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.750876 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92776967-bb28-4dc1-86b2-263ce288b226 admin admin] PATH_INFO: `/v3/projects/5e72890cf8544ff99c620416f49dc248/users/0394e3de96794ad8b8d9bc831a367df1/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.767065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92776967-bb28-4dc1-86b2-263ce288b226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e72890cf8544ff99c620416f49dc248, user_id=0394e3de96794ad8b8d9bc831a367df1, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:26.769831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92776967-bb28-4dc1-86b2-263ce288b226 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:26.787169 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1192/2389] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:26 2022] PUT /identity/v3/projects/5e72890cf8544ff99c620416f49dc248/users/0394e3de96794ad8b8d9bc831a367df1/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:29:26.791697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f0731-fa61-4480-98bc-65c5aca17d10 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:26.801990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f0731-fa61-4480-98bc-65c5aca17d10 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:26.846892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:26.872704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c47931-0dfb-40e9-a035-8a870bf7a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:26.873447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c47931-0dfb-40e9-a035-8a870bf7a093 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.873727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c47931-0dfb-40e9-a035-8a870bf7a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.873999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c47931-0dfb-40e9-a035-8a870bf7a093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.874645 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c47931-0dfb-40e9-a035-8a870bf7a093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:26.876328 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c47931-0dfb-40e9-a035-8a870bf7a093 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:26.887042 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1198/2390] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:26.891766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92776967-bb28-4dc1-86b2-263ce288b226 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:26.903347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92776967-bb28-4dc1-86b2-263ce288b226 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:26.908522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312ed28-538a-420b-9d37-a78420ddc2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:26.909242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ed28-538a-420b-9d37-a78420ddc2df admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.909519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ed28-538a-420b-9d37-a78420ddc2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.909797 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ed28-538a-420b-9d37-a78420ddc2df admin admin] PATH_INFO: `/v3/projects/5e72890cf8544ff99c620416f49dc248/users/0394e3de96794ad8b8d9bc831a367df1/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.911820 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312ed28-538a-420b-9d37-a78420ddc2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e72890cf8544ff99c620416f49dc248, user_id=0394e3de96794ad8b8d9bc831a367df1, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:26.914608 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312ed28-538a-420b-9d37-a78420ddc2df admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:26.925619 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1193/2391] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:26 2022] PUT /identity/v3/projects/5e72890cf8544ff99c620416f49dc248/users/0394e3de96794ad8b8d9bc831a367df1/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:26.936649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee546989-719a-41bb-be1f-7e33aa692076 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:26.937061 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee546989-719a-41bb-be1f-7e33aa692076 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:26.937341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee546989-719a-41bb-be1f-7e33aa692076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:26.967863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ee546989-719a-41bb-be1f-7e33aa692076 None None] MFA Rules not processed for user `0394e3de96794ad8b8d9bc831a367df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:26.969201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ee546989-719a-41bb-be1f-7e33aa692076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:27.043018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1199/2392] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:27.055164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312ed28-538a-420b-9d37-a78420ddc2df admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:27.057216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4312ed28-538a-420b-9d37-a78420ddc2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:27.124073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312ed28-538a-420b-9d37-a78420ddc2df admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:27.129179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc6020-a73a-4476-ade2-22831ccdb4c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:27.130137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc6020-a73a-4476-ade2-22831ccdb4c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:27.130503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc6020-a73a-4476-ade2-22831ccdb4c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:27.130899 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc6020-a73a-4476-ade2-22831ccdb4c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:27.198851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc6020-a73a-4476-ade2-22831ccdb4c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:27.200416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc6020-a73a-4476-ade2-22831ccdb4c8 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:27.210954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1194/2393] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:29.994426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e2829-cff8-4e34-bbbf-5582f4faf63c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:29.995077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e2829-cff8-4e34-bbbf-5582f4faf63c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:29.995337 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e2829-cff8-4e34-bbbf-5582f4faf63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:30.017262 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-875e2829-cff8-4e34-bbbf-5582f4faf63c None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:30.018495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-875e2829-cff8-4e34-bbbf-5582f4faf63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:30.081220 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1200/2394] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:29:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:29:30.142855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc6020-a73a-4476-ade2-22831ccdb4c8 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:30.144283 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-49cc6020-a73a-4476-ade2-22831ccdb4c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:30.216994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc6020-a73a-4476-ade2-22831ccdb4c8 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:30.222145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d4e37-b017-495f-9bd5-fc063f3fa00a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:30.222838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d4e37-b017-495f-9bd5-fc063f3fa00a service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:30.223242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d4e37-b017-495f-9bd5-fc063f3fa00a service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:30.223518 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d4e37-b017-495f-9bd5-fc063f3fa00a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:30.232153 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d4e37-b017-495f-9bd5-fc063f3fa00a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:30.233855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d4e37-b017-495f-9bd5-fc063f3fa00a service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:30.239084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:30.243803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1195/2395] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:29:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:29:30.744361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e2829-cff8-4e34-bbbf-5582f4faf63c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:30.746482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-875e2829-cff8-4e34-bbbf-5582f4faf63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:30.907293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:30.914952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e2829-cff8-4e34-bbbf-5582f4faf63c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:30.923610 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c869f4-e910-41f4-a608-2526787237d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:30.924242 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c869f4-e910-41f4-a608-2526787237d9 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:30.924683 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c869f4-e910-41f4-a608-2526787237d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:30.925045 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c869f4-e910-41f4-a608-2526787237d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:30.934010 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f3c869f4-e910-41f4-a608-2526787237d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:30.949099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c869f4-e910-41f4-a608-2526787237d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:30.950894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c869f4-e910-41f4-a608-2526787237d9 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:30.972535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1201/2396] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:31.722499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d4e37-b017-495f-9bd5-fc063f3fa00a service swift] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:31.747118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d4e37-b017-495f-9bd5-fc063f3fa00a service swift] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:31.761739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ce8f1-9919-4de9-95dd-c261970416d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:31.762944 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ce8f1-9919-4de9-95dd-c261970416d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:31.763331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ce8f1-9919-4de9-95dd-c261970416d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:31.763708 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ce8f1-9919-4de9-95dd-c261970416d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:31.776588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ce8f1-9919-4de9-95dd-c261970416d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:31.783303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ce8f1-9919-4de9-95dd-c261970416d1 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:31.798933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1196/2397] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:37.029774 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c869f4-e910-41f4-a608-2526787237d9 service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:37.123121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c869f4-e910-41f4-a608-2526787237d9 service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:37.129863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:37.131314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:37.131846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:37.132326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] PATH_INFO: `/v3/users/e9cec11ae5994ce28f4a16bab4321fb2` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:37.133903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9cec11ae5994ce28f4a16bab4321fb2)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:37.136603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:37.225765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9cec11ae5994ce28f4a16bab4321fb2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:37.227087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9cec11ae5994ce28f4a16bab4321fb2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:37.237231 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9cec11ae5994ce28f4a16bab4321fb2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:37.253888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9cec11ae5994ce28f4a16bab4321fb2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:37.254636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9cec11ae5994ce28f4a16bab4321fb2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:37.276607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1202/2398] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:29:37 2022] DELETE /identity/v3/users/e9cec11ae5994ce28f4a16bab4321fb2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:37.281531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcf60a-c97e-4380-a50e-66549657aa87 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:37.282040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcf60a-c97e-4380-a50e-66549657aa87 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:37.282139 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcf60a-c97e-4380-a50e-66549657aa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:37.303070 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-45fcf60a-c97e-4380-a50e-66549657aa87 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:37.303867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-45fcf60a-c97e-4380-a50e-66549657aa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:37.414626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1197/2399] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:37.422388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:37.423882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:37.499865 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c4057-7f5e-47d1-84fa-1ef19501dbb2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:37.503843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf34db4-b0b7-49c0-bdd6-9960b9eb29da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:37.504471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf34db4-b0b7-49c0-bdd6-9960b9eb29da service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:37.504777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf34db4-b0b7-49c0-bdd6-9960b9eb29da service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:37.505051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf34db4-b0b7-49c0-bdd6-9960b9eb29da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:37.515963 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf34db4-b0b7-49c0-bdd6-9960b9eb29da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:37.517625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf34db4-b0b7-49c0-bdd6-9960b9eb29da service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:37.529510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1203/2400] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:29:38.127806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcf60a-c97e-4380-a50e-66549657aa87 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:38.130922 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-45fcf60a-c97e-4380-a50e-66549657aa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:38.147152 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcf60a-c97e-4380-a50e-66549657aa87 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:38.154615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:38.155515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:38.155964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:38.156392 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] PATH_INFO: `/v3/projects/5ad82e613d3d498d9f9b31ac814b748e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:38.157843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad82e613d3d498d9f9b31ac814b748e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:38.160434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:38.245213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad82e613d3d498d9f9b31ac814b748e', 'request_id': 'req-70930e5e-4025-4ab3-990c-d9dd489b2fd2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:38.260960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad82e613d3d498d9f9b31ac814b748e', 'request_id': 'req-70930e5e-4025-4ab3-990c-d9dd489b2fd2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:38.274010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad82e613d3d498d9f9b31ac814b748e', 'request_id': 'req-70930e5e-4025-4ab3-990c-d9dd489b2fd2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:38.294784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] The token cache is being invalidate because project 5ad82e613d3d498d9f9b31ac814b748e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:29:38.295397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:38.295745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:38.297609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1198/2401] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:29:38 2022] DELETE /identity/v3/projects/5ad82e613d3d498d9f9b31ac814b748e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:29:38.302118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf34db4-b0b7-49c0-bdd6-9960b9eb29da service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:38.315809 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf34db4-b0b7-49c0-bdd6-9960b9eb29da service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:38.327377 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:38.420178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e692b3-6266-4475-a352-7e9e0cd18c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:38.421080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e692b3-6266-4475-a352-7e9e0cd18c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:38.421456 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e692b3-6266-4475-a352-7e9e0cd18c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:38.422590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e692b3-6266-4475-a352-7e9e0cd18c27 admin admin] PATH_INFO: `/v3/users/0394e3de96794ad8b8d9bc831a367df1` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:38.424863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e692b3-6266-4475-a352-7e9e0cd18c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0394e3de96794ad8b8d9bc831a367df1)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:38.434024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e692b3-6266-4475-a352-7e9e0cd18c27 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:38.527189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b6e692b3-6266-4475-a352-7e9e0cd18c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0394e3de96794ad8b8d9bc831a367df1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:38.528786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b6e692b3-6266-4475-a352-7e9e0cd18c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0394e3de96794ad8b8d9bc831a367df1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:38.540147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b6e692b3-6266-4475-a352-7e9e0cd18c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0394e3de96794ad8b8d9bc831a367df1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:38.550601 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b6e692b3-6266-4475-a352-7e9e0cd18c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0394e3de96794ad8b8d9bc831a367df1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:38.552024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b6e692b3-6266-4475-a352-7e9e0cd18c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0394e3de96794ad8b8d9bc831a367df1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:38.584707 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1204/2402] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:29:38 2022] DELETE /identity/v3/users/0394e3de96794ad8b8d9bc831a367df1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:39.150028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:39.153150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:39.190609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70930e5e-4025-4ab3-990c-d9dd489b2fd2 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:39.328639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424ec63-1de9-4284-9ec9-eb034619365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:39.330029 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424ec63-1de9-4284-9ec9-eb034619365e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:39.332532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424ec63-1de9-4284-9ec9-eb034619365e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:39.333139 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424ec63-1de9-4284-9ec9-eb034619365e admin admin] PATH_INFO: `/v3/projects/5e72890cf8544ff99c620416f49dc248` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:39.335250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424ec63-1de9-4284-9ec9-eb034619365e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e72890cf8544ff99c620416f49dc248)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:39.337627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424ec63-1de9-4284-9ec9-eb034619365e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:39.353826 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:39.408982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a424ec63-1de9-4284-9ec9-eb034619365e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e72890cf8544ff99c620416f49dc248', 'request_id': 'req-a424ec63-1de9-4284-9ec9-eb034619365e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:39.422375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a424ec63-1de9-4284-9ec9-eb034619365e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e72890cf8544ff99c620416f49dc248', 'request_id': 'req-a424ec63-1de9-4284-9ec9-eb034619365e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:39.435381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a424ec63-1de9-4284-9ec9-eb034619365e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e72890cf8544ff99c620416f49dc248', 'request_id': 'req-a424ec63-1de9-4284-9ec9-eb034619365e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:39.449371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a424ec63-1de9-4284-9ec9-eb034619365e admin admin] The token cache is being invalidate because project 5e72890cf8544ff99c620416f49dc248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:29:39.449871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a424ec63-1de9-4284-9ec9-eb034619365e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:39.457824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a424ec63-1de9-4284-9ec9-eb034619365e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:29:39.467827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1199/2403] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:29:39 2022] DELETE /identity/v3/projects/5e72890cf8544ff99c620416f49dc248 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:39.469178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6f5cf-62fd-4c25-9d26-c027fc42d027 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:39.469762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6f5cf-62fd-4c25-9d26-c027fc42d027 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:39.469762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6f5cf-62fd-4c25-9d26-c027fc42d027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:39.494775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-82d6f5cf-62fd-4c25-9d26-c027fc42d027 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:39.496296 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-82d6f5cf-62fd-4c25-9d26-c027fc42d027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:39.624111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1205/2404] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:39.634392 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a095c-7bc0-4ee6-a930-add722dfcc68 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:39.634788 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a095c-7bc0-4ee6-a930-add722dfcc68 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:39.635192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a095c-7bc0-4ee6-a930-add722dfcc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:39.659904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-666a095c-7bc0-4ee6-a930-add722dfcc68 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:39.661434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-666a095c-7bc0-4ee6-a930-add722dfcc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:39.676171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1200/2405] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:39.681101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6f5cf-62fd-4c25-9d26-c027fc42d027 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:39.712117 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6f5cf-62fd-4c25-9d26-c027fc42d027 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:39.728479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6b61c-e2e5-4371-9912-bc4f052f6e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:39.728479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b61c-e2e5-4371-9912-bc4f052f6e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:39.728917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b61c-e2e5-4371-9912-bc4f052f6e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:39.729248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b61c-e2e5-4371-9912-bc4f052f6e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:39.730662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6b61c-e2e5-4371-9912-bc4f052f6e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:29:39.730662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6b61c-e2e5-4371-9912-bc4f052f6e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:39.732395 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6b61c-e2e5-4371-9912-bc4f052f6e87 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:39.760764 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1206/2406] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:29:39.764311 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a095c-7bc0-4ee6-a930-add722dfcc68 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:39.778332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a095c-7bc0-4ee6-a930-add722dfcc68 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:39.808761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515730a-f6e2-41a2-af84-965f2fdacee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:39.808761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515730a-f6e2-41a2-af84-965f2fdacee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:39.808761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515730a-f6e2-41a2-af84-965f2fdacee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:39.808761 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515730a-f6e2-41a2-af84-965f2fdacee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:39.809315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515730a-f6e2-41a2-af84-965f2fdacee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:39.809315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515730a-f6e2-41a2-af84-965f2fdacee9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:39.869649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1201/2407] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:29:39 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:39.874181 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6b61c-e2e5-4371-9912-bc4f052f6e87 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:39.897494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6b61c-e2e5-4371-9912-bc4f052f6e87 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:39.920777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:40.024640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258ac41-a52e-432c-a7fc-ff192e729a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:40.028641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258ac41-a52e-432c-a7fc-ff192e729a77 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:40.028641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258ac41-a52e-432c-a7fc-ff192e729a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:40.028641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258ac41-a52e-432c-a7fc-ff192e729a77 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:40.028641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258ac41-a52e-432c-a7fc-ff192e729a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:40.031257 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258ac41-a52e-432c-a7fc-ff192e729a77 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:40.066833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1207/2408] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:29:39 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:29:40.068286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515730a-f6e2-41a2-af84-965f2fdacee9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:40.089045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515730a-f6e2-41a2-af84-965f2fdacee9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:40.097480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3deee1-fe1a-411f-9e4b-677a769a9e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:40.098654 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3deee1-fe1a-411f-9e4b-677a769a9e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:40.099334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3deee1-fe1a-411f-9e4b-677a769a9e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:40.100020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3deee1-fe1a-411f-9e4b-677a769a9e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:40.100946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3deee1-fe1a-411f-9e4b-677a769a9e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:40.102907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3deee1-fe1a-411f-9e4b-677a769a9e05 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:40.114758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1202/2409] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:40.118735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258ac41-a52e-432c-a7fc-ff192e729a77 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:40.133585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258ac41-a52e-432c-a7fc-ff192e729a77 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:40.140924 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2240d4-0cc0-404b-b930-64159b7b417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:40.142909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2240d4-0cc0-404b-b930-64159b7b417b admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:40.143342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2240d4-0cc0-404b-b930-64159b7b417b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:40.144076 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2240d4-0cc0-404b-b930-64159b7b417b admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:40.144977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2240d4-0cc0-404b-b930-64159b7b417b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:40.147217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2240d4-0cc0-404b-b930-64159b7b417b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:40.163459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1208/2410] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:29:40.167478 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3deee1-fe1a-411f-9e4b-677a769a9e05 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:40.183530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3deee1-fe1a-411f-9e4b-677a769a9e05 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:40.192408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7bc58-70d5-42c1-8d64-40a2f792b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:40.193435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7bc58-70d5-42c1-8d64-40a2f792b174 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:40.193913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7bc58-70d5-42c1-8d64-40a2f792b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:40.194346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7bc58-70d5-42c1-8d64-40a2f792b174 admin admin] PATH_INFO: `/v3/projects/3c597e14d15c4b81bacb5dcd5692b04d/users/08a3e864242e426eb4fa4ce435644188/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:40.213394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7bc58-70d5-42c1-8d64-40a2f792b174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c597e14d15c4b81bacb5dcd5692b04d, user_id=08a3e864242e426eb4fa4ce435644188, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:40.216413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7bc58-70d5-42c1-8d64-40a2f792b174 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:40.243616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1203/2411] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:29:40 2022] PUT /identity/v3/projects/3c597e14d15c4b81bacb5dcd5692b04d/users/08a3e864242e426eb4fa4ce435644188/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:29:40.255483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9862f7-539e-4388-bdef-8b7a30e015fc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:40.255956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9862f7-539e-4388-bdef-8b7a30e015fc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:40.256441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9862f7-539e-4388-bdef-8b7a30e015fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:40.311341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0e9862f7-539e-4388-bdef-8b7a30e015fc None None] MFA Rules not processed for user `08a3e864242e426eb4fa4ce435644188`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:40.313381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0e9862f7-539e-4388-bdef-8b7a30e015fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:40.343381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0b388-74dd-4308-834e-448594425f26 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:40.344016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0b388-74dd-4308-834e-448594425f26 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:40.344016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0b388-74dd-4308-834e-448594425f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:40.373666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1eb0b388-74dd-4308-834e-448594425f26 None None] MFA Rules not processed for user `a1be02f9e7fd4bdabc05ec48e2a35f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:40.387316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1eb0b388-74dd-4308-834e-448594425f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:40.458612 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1209/2412] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:40.471528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9862f7-539e-4388-bdef-8b7a30e015fc None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:40.473740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0e9862f7-539e-4388-bdef-8b7a30e015fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:40.495975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1204/2413] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:29:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:40.593349 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9862f7-539e-4388-bdef-8b7a30e015fc None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:40.598494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef37b45-857b-4d6e-9424-c5c6b755941d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:40.599396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef37b45-857b-4d6e-9424-c5c6b755941d service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:40.599678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef37b45-857b-4d6e-9424-c5c6b755941d service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:40.599947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef37b45-857b-4d6e-9424-c5c6b755941d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:40.616739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef37b45-857b-4d6e-9424-c5c6b755941d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:40.618287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef37b45-857b-4d6e-9424-c5c6b755941d service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:40.630375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1210/2414] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:29:40.871673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0b388-74dd-4308-834e-448594425f26 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:40.873490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1eb0b388-74dd-4308-834e-448594425f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:40.935776 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:40.961973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0b388-74dd-4308-834e-448594425f26 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:40.966403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04b1f1-23de-4ba9-92bc-b5b905a6fe89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:40.967222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04b1f1-23de-4ba9-92bc-b5b905a6fe89 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:40.967533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04b1f1-23de-4ba9-92bc-b5b905a6fe89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:40.968000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04b1f1-23de-4ba9-92bc-b5b905a6fe89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:40.970372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2d04b1f1-23de-4ba9-92bc-b5b905a6fe89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:40.982684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04b1f1-23de-4ba9-92bc-b5b905a6fe89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:40.985089 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04b1f1-23de-4ba9-92bc-b5b905a6fe89 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:41.006123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1205/2415] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:46.386375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87673-b104-4c65-8502-d24d683a62c0 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:46.386946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87673-b104-4c65-8502-d24d683a62c0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:46.386946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87673-b104-4c65-8502-d24d683a62c0 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:46.388293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1211/2416] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:29:46.394796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591a454-35ed-4504-a599-e720682e0b85 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:46.395286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591a454-35ed-4504-a599-e720682e0b85 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:46.395385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591a454-35ed-4504-a599-e720682e0b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:46.416965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9591a454-35ed-4504-a599-e720682e0b85 None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:46.418367 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9591a454-35ed-4504-a599-e720682e0b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:46.489764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1206/2417] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:29:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:29:46.505372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af87673-b104-4c65-8502-d24d683a62c0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:46.505372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6af87673-b104-4c65-8502-d24d683a62c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:46.539404 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:46.567543 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af87673-b104-4c65-8502-d24d683a62c0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:46.571505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194aa0b2-1408-470f-9554-d1f2ab376ae8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ee7b50c34742ce896a734f3ef34a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:46.572123 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aa0b2-1408-470f-9554-d1f2ab376ae8 service glance] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:46.572403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aa0b2-1408-470f-9554-d1f2ab376ae8 service glance] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:46.572677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aa0b2-1408-470f-9554-d1f2ab376ae8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:46.582966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194aa0b2-1408-470f-9554-d1f2ab376ae8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:46.584429 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194aa0b2-1408-470f-9554-d1f2ab376ae8 service glance] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:46.595201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1212/2418] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:46.670020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38b5c5-0ae2-45d8-980d-32f90aece984 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:46.670314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38b5c5-0ae2-45d8-980d-32f90aece984 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:46.670593 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38b5c5-0ae2-45d8-980d-32f90aece984 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:46.672133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1207/2419] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:29:46.676983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51e078-7df1-475d-9867-ce527cbccec9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:46.677354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51e078-7df1-475d-9867-ce527cbccec9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:46.677708 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51e078-7df1-475d-9867-ce527cbccec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:46.699079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-cb51e078-7df1-475d-9867-ce527cbccec9 None None] MFA Rules not processed for user `78487667b3334cf09fed51b697cbf759`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:46.700781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cb51e078-7df1-475d-9867-ce527cbccec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:46.720294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1213/2420] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:29:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:46.735615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38b5c5-0ae2-45d8-980d-32f90aece984 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:46.748469 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38b5c5-0ae2-45d8-980d-32f90aece984 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:46.753588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c81250-6e44-4d6a-af7f-ac64533ad84e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:46.754561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c81250-6e44-4d6a-af7f-ac64533ad84e service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:46.754928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c81250-6e44-4d6a-af7f-ac64533ad84e service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:46.755291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c81250-6e44-4d6a-af7f-ac64533ad84e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:46.765772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c81250-6e44-4d6a-af7f-ac64533ad84e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:46.767361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c81250-6e44-4d6a-af7f-ac64533ad84e service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:46.790404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1208/2421] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:46.874186 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be9e7a-85d3-4d88-89e7-27c117d14367 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:46.874495 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be9e7a-85d3-4d88-89e7-27c117d14367 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:46.874775 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be9e7a-85d3-4d88-89e7-27c117d14367 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:46.876245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1214/2422] 10.222.0.45 () {54 vars in 921 bytes} [Fri Aug 26 18:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 18:29:46.882057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bf8b3-6422-410c-ac5a-888bbcbbb395 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:46.882342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bf8b3-6422-410c-ac5a-888bbcbbb395 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:46.882617 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bf8b3-6422-410c-ac5a-888bbcbbb395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:46.902672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-831bf8b3-6422-410c-ac5a-888bbcbbb395 None None] MFA Rules not processed for user `3791df34c6e442aaabd90d7f5c2f3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:46.904258 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-831bf8b3-6422-410c-ac5a-888bbcbbb395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:46.913998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1209/2423] 10.222.0.45 () {58 vars in 1018 bytes} [Fri Aug 26 18:29:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:29:46.924903 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be9e7a-85d3-4d88-89e7-27c117d14367 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:46.937942 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be9e7a-85d3-4d88-89e7-27c117d14367 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:46.942046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657caadb-4d1c-4bdf-8768-da751a268805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:46.942722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657caadb-4d1c-4bdf-8768-da751a268805 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:46.943003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657caadb-4d1c-4bdf-8768-da751a268805 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:46.943274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657caadb-4d1c-4bdf-8768-da751a268805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:46.954530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657caadb-4d1c-4bdf-8768-da751a268805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:46.956029 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657caadb-4d1c-4bdf-8768-da751a268805 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:46.968125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1215/2424] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:29:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:29:51.591003 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdda6bf-7ee6-4db8-964a-1e4051fc15f6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:51.591514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdda6bf-7ee6-4db8-964a-1e4051fc15f6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:51.591622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdda6bf-7ee6-4db8-964a-1e4051fc15f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:51.613107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cbdda6bf-7ee6-4db8-964a-1e4051fc15f6 None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:29:51.614375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cbdda6bf-7ee6-4db8-964a-1e4051fc15f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:51.675427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1210/2425] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:29:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:29:51.688328 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657caadb-4d1c-4bdf-8768-da751a268805 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:29:51.689710 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-657caadb-4d1c-4bdf-8768-da751a268805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:29:51.769673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657caadb-4d1c-4bdf-8768-da751a268805 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:29:51.776178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195fc94-0f96-479a-9211-635395161430 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:29:51.776887 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195fc94-0f96-479a-9211-635395161430 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:29:51.777140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195fc94-0f96-479a-9211-635395161430 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:29:51.777435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195fc94-0f96-479a-9211-635395161430 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:29:51.787046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195fc94-0f96-479a-9211-635395161430 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:29:51.788814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195fc94-0f96-479a-9211-635395161430 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:29:51.797858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1216/2426] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:29:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:30:00.443491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdda6bf-7ee6-4db8-964a-1e4051fc15f6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:00.445111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cbdda6bf-7ee6-4db8-964a-1e4051fc15f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:00.461810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdda6bf-7ee6-4db8-964a-1e4051fc15f6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:00.469471 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afc7d9-e451-4b21-8075-34582d7d1c56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:00.470161 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afc7d9-e451-4b21-8075-34582d7d1c56 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:00.470452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afc7d9-e451-4b21-8075-34582d7d1c56 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:00.470762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afc7d9-e451-4b21-8075-34582d7d1c56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:00.473093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-00afc7d9-e451-4b21-8075-34582d7d1c56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:00.485974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afc7d9-e451-4b21-8075-34582d7d1c56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:00.491174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afc7d9-e451-4b21-8075-34582d7d1c56 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:00.497738 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1211/2427] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:01.794727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=54 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:07.341342 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101881-5caf-458e-ace9-1fbfada3d38d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:07.342039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101881-5caf-458e-ace9-1fbfada3d38d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:07.342039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101881-5caf-458e-ace9-1fbfada3d38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:07.365674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f2101881-5caf-458e-ace9-1fbfada3d38d None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:07.367130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f2101881-5caf-458e-ace9-1fbfada3d38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:07.388894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1217/2428] 10.222.0.45 () {58 vars in 967 bytes} [Fri Aug 26 18:30:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:07.403516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afc7d9-e451-4b21-8075-34582d7d1c56 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:07.419813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afc7d9-e451-4b21-8075-34582d7d1c56 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:07.425052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b3650-37f8-4f4f-8227-effafb3942a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:07.425674 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b3650-37f8-4f4f-8227-effafb3942a2 service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:07.425980 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b3650-37f8-4f4f-8227-effafb3942a2 service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:07.426256 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b3650-37f8-4f4f-8227-effafb3942a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:07.434718 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b3650-37f8-4f4f-8227-effafb3942a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:07.436338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b3650-37f8-4f4f-8227-effafb3942a2 service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:07.444290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1212/2429] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:30:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:30:17.358882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:17.441305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=84 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:17.775723 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101881-5caf-458e-ace9-1fbfada3d38d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:17.841747 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101881-5caf-458e-ace9-1fbfada3d38d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:17.846901 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:17.847545 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:17.847823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:17.848092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] PATH_INFO: `/v3/users/08a3e864242e426eb4fa4ce435644188` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:17.849309 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a3e864242e426eb4fa4ce435644188)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:17.851391 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:17.905435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a3e864242e426eb4fa4ce435644188'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:17.906153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a3e864242e426eb4fa4ce435644188'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:17.914457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a3e864242e426eb4fa4ce435644188'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:17.921832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a3e864242e426eb4fa4ce435644188'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:17.922480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a3e864242e426eb4fa4ce435644188'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:17.939474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1218/2430] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:30:17 2022] DELETE /identity/v3/users/08a3e864242e426eb4fa4ce435644188 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:17.944652 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846a178-4887-43e6-8aee-022afe0cac23 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:17.945042 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846a178-4887-43e6-8aee-022afe0cac23 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:17.946912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846a178-4887-43e6-8aee-022afe0cac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:17.966942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4846a178-4887-43e6-8aee-022afe0cac23 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:17.968203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4846a178-4887-43e6-8aee-022afe0cac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:18.030099 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1213/2431] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:18.041182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:18.043753 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:18.105224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ad35e-5a00-41a0-839f-526bf1e42435 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:18.109110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6a381-41db-4ae3-89b7-c36fe129c5f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:18.109730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6a381-41db-4ae3-89b7-c36fe129c5f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:18.110008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6a381-41db-4ae3-89b7-c36fe129c5f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:18.110278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6a381-41db-4ae3-89b7-c36fe129c5f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:18.119791 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6a381-41db-4ae3-89b7-c36fe129c5f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:18.121302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6a381-41db-4ae3-89b7-c36fe129c5f4 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:18.135572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1219/2432] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:18.423642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846a178-4887-43e6-8aee-022afe0cac23 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:18.425230 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4846a178-4887-43e6-8aee-022afe0cac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:18.444691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846a178-4887-43e6-8aee-022afe0cac23 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:18.451203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec970579-78f2-44ca-8b17-2546d6d6cddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:18.452239 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec970579-78f2-44ca-8b17-2546d6d6cddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:18.452514 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec970579-78f2-44ca-8b17-2546d6d6cddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:18.452807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec970579-78f2-44ca-8b17-2546d6d6cddd admin admin] PATH_INFO: `/v3/projects/3c597e14d15c4b81bacb5dcd5692b04d` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:18.454053 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec970579-78f2-44ca-8b17-2546d6d6cddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c597e14d15c4b81bacb5dcd5692b04d)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:18.456156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec970579-78f2-44ca-8b17-2546d6d6cddd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:18.505521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ec970579-78f2-44ca-8b17-2546d6d6cddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c597e14d15c4b81bacb5dcd5692b04d', 'request_id': 'req-ec970579-78f2-44ca-8b17-2546d6d6cddd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:18.515957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ec970579-78f2-44ca-8b17-2546d6d6cddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c597e14d15c4b81bacb5dcd5692b04d', 'request_id': 'req-ec970579-78f2-44ca-8b17-2546d6d6cddd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:18.525833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ec970579-78f2-44ca-8b17-2546d6d6cddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c597e14d15c4b81bacb5dcd5692b04d', 'request_id': 'req-ec970579-78f2-44ca-8b17-2546d6d6cddd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:18.536900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ec970579-78f2-44ca-8b17-2546d6d6cddd admin admin] The token cache is being invalidate because project 3c597e14d15c4b81bacb5dcd5692b04d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:30:18.537126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ec970579-78f2-44ca-8b17-2546d6d6cddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:18.537844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ec970579-78f2-44ca-8b17-2546d6d6cddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:18.539471 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1214/2433] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:30:18 2022] DELETE /identity/v3/projects/3c597e14d15c4b81bacb5dcd5692b04d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:18.545682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f080d3e-d4da-49fd-b0d4-65ab088870d6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:18.546159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f080d3e-d4da-49fd-b0d4-65ab088870d6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:18.546275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f080d3e-d4da-49fd-b0d4-65ab088870d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:18.574972 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0f080d3e-d4da-49fd-b0d4-65ab088870d6 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:18.576241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0f080d3e-d4da-49fd-b0d4-65ab088870d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:18.598020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:18.654156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1220/2434] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:18.725333 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe74afa-4301-45f6-8eb9-bbea1b50413c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:18.725576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe74afa-4301-45f6-8eb9-bbea1b50413c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:18.725872 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe74afa-4301-45f6-8eb9-bbea1b50413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:18.748413 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-5fe74afa-4301-45f6-8eb9-bbea1b50413c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:18.749792 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5fe74afa-4301-45f6-8eb9-bbea1b50413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:18.759140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1215/2435] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:18.764134 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f080d3e-d4da-49fd-b0d4-65ab088870d6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:18.778467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f080d3e-d4da-49fd-b0d4-65ab088870d6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:18.783688 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950d2a6-e397-4b45-b499-66a16c53df25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:18.784296 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950d2a6-e397-4b45-b499-66a16c53df25 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:18.784576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950d2a6-e397-4b45-b499-66a16c53df25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:18.784874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950d2a6-e397-4b45-b499-66a16c53df25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:18.785547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950d2a6-e397-4b45-b499-66a16c53df25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:30:18.785852 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950d2a6-e397-4b45-b499-66a16c53df25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:18.787536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950d2a6-e397-4b45-b499-66a16c53df25 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:18.799493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1221/2436] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:30:18.803954 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe74afa-4301-45f6-8eb9-bbea1b50413c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:18.813805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe74afa-4301-45f6-8eb9-bbea1b50413c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:18.819735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0244c9-20ec-4664-ab27-361ce54b717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:18.820344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0244c9-20ec-4664-ab27-361ce54b717a admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:18.820623 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0244c9-20ec-4664-ab27-361ce54b717a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:18.820919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0244c9-20ec-4664-ab27-361ce54b717a admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:18.821560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0244c9-20ec-4664-ab27-361ce54b717a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:18.823493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0244c9-20ec-4664-ab27-361ce54b717a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:18.852823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1216/2437] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:30:18 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:18.857559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950d2a6-e397-4b45-b499-66a16c53df25 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:18.868320 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950d2a6-e397-4b45-b499-66a16c53df25 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:18.925369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45023f-5774-43e5-95c4-74d1e77b2d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:18.925986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45023f-5774-43e5-95c4-74d1e77b2d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:18.926271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45023f-5774-43e5-95c4-74d1e77b2d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:18.926553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45023f-5774-43e5-95c4-74d1e77b2d2b admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:18.927194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45023f-5774-43e5-95c4-74d1e77b2d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:18.929197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45023f-5774-43e5-95c4-74d1e77b2d2b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:18.957013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1222/2438] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:30:18 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:18.958323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0244c9-20ec-4664-ab27-361ce54b717a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:18.970076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0244c9-20ec-4664-ab27-361ce54b717a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:18.975735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff2226-1294-4fac-9b27-3207579d6c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:18.976411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff2226-1294-4fac-9b27-3207579d6c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:18.976731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff2226-1294-4fac-9b27-3207579d6c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:18.977002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff2226-1294-4fac-9b27-3207579d6c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:18.977681 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff2226-1294-4fac-9b27-3207579d6c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:18.979351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff2226-1294-4fac-9b27-3207579d6c68 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:18.992506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1217/2439] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:18.995475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45023f-5774-43e5-95c4-74d1e77b2d2b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:19.006020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45023f-5774-43e5-95c4-74d1e77b2d2b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:19.010989 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821dc73-e217-4cc5-831f-eb315a011efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:19.011913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821dc73-e217-4cc5-831f-eb315a011efa admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:19.012208 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821dc73-e217-4cc5-831f-eb315a011efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:19.012542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821dc73-e217-4cc5-831f-eb315a011efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:19.013380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821dc73-e217-4cc5-831f-eb315a011efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:19.015231 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821dc73-e217-4cc5-831f-eb315a011efa admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:19.026676 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1223/2440] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:19.033633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff2226-1294-4fac-9b27-3207579d6c68 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:19.043212 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff2226-1294-4fac-9b27-3207579d6c68 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:19.048151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58e1c9-c42f-41a0-8b16-f1e9d974840f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:19.048842 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58e1c9-c42f-41a0-8b16-f1e9d974840f admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:19.049125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58e1c9-c42f-41a0-8b16-f1e9d974840f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:19.049402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58e1c9-c42f-41a0-8b16-f1e9d974840f admin admin] PATH_INFO: `/v3/projects/aec8ef49868442b2b6f437b083855f18/users/8514a74e122f43b3b76b2611c6eeabbc/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:19.063955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58e1c9-c42f-41a0-8b16-f1e9d974840f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec8ef49868442b2b6f437b083855f18, user_id=8514a74e122f43b3b76b2611c6eeabbc, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:19.066666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58e1c9-c42f-41a0-8b16-f1e9d974840f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:19.083987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1218/2441] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:19 2022] PUT /identity/v3/projects/aec8ef49868442b2b6f437b083855f18/users/8514a74e122f43b3b76b2611c6eeabbc/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:30:19.095346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d519810-5ad6-417c-8ef8-517d15f77c18 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:19.095608 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d519810-5ad6-417c-8ef8-517d15f77c18 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:19.096058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d519810-5ad6-417c-8ef8-517d15f77c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:19.127923 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6d519810-5ad6-417c-8ef8-517d15f77c18 None None] MFA Rules not processed for user `8514a74e122f43b3b76b2611c6eeabbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:19.129226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6d519810-5ad6-417c-8ef8-517d15f77c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:19.196094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1224/2442] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:30:19.207326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58e1c9-c42f-41a0-8b16-f1e9d974840f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:19.209453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7d58e1c9-c42f-41a0-8b16-f1e9d974840f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:19.231829 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:19.268916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58e1c9-c42f-41a0-8b16-f1e9d974840f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:19.272820 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342f6a5-76da-4856-a600-c8f6570c02d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:19.273433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f6a5-76da-4856-a600-c8f6570c02d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:19.273710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f6a5-76da-4856-a600-c8f6570c02d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:19.273985 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f6a5-76da-4856-a600-c8f6570c02d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:19.283269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342f6a5-76da-4856-a600-c8f6570c02d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:19.284756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342f6a5-76da-4856-a600-c8f6570c02d2 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:19.294154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1219/2443] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:20.261112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d519810-5ad6-417c-8ef8-517d15f77c18 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:20.262669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6d519810-5ad6-417c-8ef8-517d15f77c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:20.284656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:20.322714 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d519810-5ad6-417c-8ef8-517d15f77c18 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:20.327201 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50f96c-da0a-440e-afc1-3b3726050f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:20.327947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50f96c-da0a-440e-afc1-3b3726050f34 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:20.328238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50f96c-da0a-440e-afc1-3b3726050f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:20.328510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50f96c-da0a-440e-afc1-3b3726050f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:20.330501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-dc50f96c-da0a-440e-afc1-3b3726050f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:20.394617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50f96c-da0a-440e-afc1-3b3726050f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:20.396046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50f96c-da0a-440e-afc1-3b3726050f34 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:20.406848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1225/2444] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:23.425509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342f6a5-76da-4856-a600-c8f6570c02d2 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:23.427692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d342f6a5-76da-4856-a600-c8f6570c02d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:23.508199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50f96c-da0a-440e-afc1-3b3726050f34 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:23.509752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-dc50f96c-da0a-440e-afc1-3b3726050f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:23.524132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50f96c-da0a-440e-afc1-3b3726050f34 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:23.529108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e302-7e49-4732-bba2-f5d92ec35ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:23.529320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342f6a5-76da-4856-a600-c8f6570c02d2 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:23.530397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e302-7e49-4732-bba2-f5d92ec35ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:23.530676 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e302-7e49-4732-bba2-f5d92ec35ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:23.531103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e302-7e49-4732-bba2-f5d92ec35ad2 admin admin] PATH_INFO: `/v3/users/85158030e4904eab877dc5da3a6bbd33` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:23.532541 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7e302-7e49-4732-bba2-f5d92ec35ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85158030e4904eab877dc5da3a6bbd33)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:23.534631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7e302-7e49-4732-bba2-f5d92ec35ad2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:23.547068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43def4-6640-45d3-b8cc-3b526f9d4f2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9eef8921de43f18245f47559f3fa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:23.547878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43def4-6640-45d3-b8cc-3b526f9d4f2f service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:23.547989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43def4-6640-45d3-b8cc-3b526f9d4f2f service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:23.548231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43def4-6640-45d3-b8cc-3b526f9d4f2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:23.551548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cf43def4-6640-45d3-b8cc-3b526f9d4f2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:23.565649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43def4-6640-45d3-b8cc-3b526f9d4f2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:23.568046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43def4-6640-45d3-b8cc-3b526f9d4f2f service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:23.580808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1220/2445] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:23.629372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ddc7e302-7e49-4732-bba2-f5d92ec35ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85158030e4904eab877dc5da3a6bbd33'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:23.630897 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ddc7e302-7e49-4732-bba2-f5d92ec35ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85158030e4904eab877dc5da3a6bbd33'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:23.640617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ddc7e302-7e49-4732-bba2-f5d92ec35ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85158030e4904eab877dc5da3a6bbd33'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:23.651092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ddc7e302-7e49-4732-bba2-f5d92ec35ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85158030e4904eab877dc5da3a6bbd33'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:23.652039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ddc7e302-7e49-4732-bba2-f5d92ec35ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85158030e4904eab877dc5da3a6bbd33'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:23.670224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1226/2446] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:30:23 2022] DELETE /identity/v3/users/85158030e4904eab877dc5da3a6bbd33 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:30:23.851814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43def4-6640-45d3-b8cc-3b526f9d4f2f service placement] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:23.866924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43def4-6640-45d3-b8cc-3b526f9d4f2f service placement] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:23.937371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:23.938104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:23.938614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:23.938878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec admin admin] PATH_INFO: `/v3/projects/dd848c03af214b948ab01dee79cb7c34` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:23.940082 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd848c03af214b948ab01dee79cb7c34)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:23.942064 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:23.994880 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd848c03af214b948ab01dee79cb7c34', 'request_id': 'req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:23.998809 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:24.002801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd848c03af214b948ab01dee79cb7c34', 'request_id': 'req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:24.010686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd848c03af214b948ab01dee79cb7c34', 'request_id': 'req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:24.024294 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec admin admin] The token cache is being invalidate because project dd848c03af214b948ab01dee79cb7c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:30:24.024767 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:24.025433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-28fb1797-6d2f-4178-a0fe-8005ddbdb1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:24.027574 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1221/2447] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:30:23 2022] DELETE /identity/v3/projects/dd848c03af214b948ab01dee79cb7c34 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:24.033654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670ceea-ee5d-45b1-93d2-0a179580d7c3 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:24.034005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670ceea-ee5d-45b1-93d2-0a179580d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:24.034333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670ceea-ee5d-45b1-93d2-0a179580d7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:24.058154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3670ceea-ee5d-45b1-93d2-0a179580d7c3 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:24.059829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3670ceea-ee5d-45b1-93d2-0a179580d7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:24.099202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:24.127135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1227/2448] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:24.135510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5d71-556c-429f-8bb3-567ff2266ef1 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:24.135793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5d71-556c-429f-8bb3-567ff2266ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:24.136068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5d71-556c-429f-8bb3-567ff2266ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:24.156263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b14e5d71-556c-429f-8bb3-567ff2266ef1 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:24.157494 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b14e5d71-556c-429f-8bb3-567ff2266ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:24.167375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1222/2449] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:24.176426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670ceea-ee5d-45b1-93d2-0a179580d7c3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:24.186701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670ceea-ee5d-45b1-93d2-0a179580d7c3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:24.192126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd631-a726-417c-90cb-b797af61f7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:24.192754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd631-a726-417c-90cb-b797af61f7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:24.193039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd631-a726-417c-90cb-b797af61f7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:24.193312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd631-a726-417c-90cb-b797af61f7a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:24.193968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cd631-a726-417c-90cb-b797af61f7a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:30:24.194274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cd631-a726-417c-90cb-b797af61f7a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:24.195923 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cd631-a726-417c-90cb-b797af61f7a5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:24.208372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1228/2450] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:30:24.213043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e5d71-556c-429f-8bb3-567ff2266ef1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:24.223021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e5d71-556c-429f-8bb3-567ff2266ef1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:24.228189 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36777b-e7cd-4bd8-a82a-1cc348e6bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:24.228848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36777b-e7cd-4bd8-a82a-1cc348e6bed3 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:24.229127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36777b-e7cd-4bd8-a82a-1cc348e6bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:24.229397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36777b-e7cd-4bd8-a82a-1cc348e6bed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:24.230026 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36777b-e7cd-4bd8-a82a-1cc348e6bed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:24.231925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36777b-e7cd-4bd8-a82a-1cc348e6bed3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:24.263299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1223/2451] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:30:24 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:24.267371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd631-a726-417c-90cb-b797af61f7a5 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:24.278235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd631-a726-417c-90cb-b797af61f7a5 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:24.338563 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc102da2-3597-4b6d-92ba-7a7f908a3260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:24.339181 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc102da2-3597-4b6d-92ba-7a7f908a3260 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:24.339461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc102da2-3597-4b6d-92ba-7a7f908a3260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:24.339733 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc102da2-3597-4b6d-92ba-7a7f908a3260 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:24.340363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc102da2-3597-4b6d-92ba-7a7f908a3260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:24.342369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc102da2-3597-4b6d-92ba-7a7f908a3260 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:24.364130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1229/2452] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:30:24 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:24.368303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36777b-e7cd-4bd8-a82a-1cc348e6bed3 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:24.378973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36777b-e7cd-4bd8-a82a-1cc348e6bed3 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:24.384071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1849251-4945-41ab-8705-99d0448ee52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:24.384683 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1849251-4945-41ab-8705-99d0448ee52d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:24.384990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1849251-4945-41ab-8705-99d0448ee52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:24.385292 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1849251-4945-41ab-8705-99d0448ee52d admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:24.385970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1849251-4945-41ab-8705-99d0448ee52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:24.387563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1849251-4945-41ab-8705-99d0448ee52d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:24.398710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1224/2453] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:24.402988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc102da2-3597-4b6d-92ba-7a7f908a3260 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:24.413544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc102da2-3597-4b6d-92ba-7a7f908a3260 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:24.419226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8867d-de48-4967-a491-463a92a45129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:24.419833 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8867d-de48-4967-a491-463a92a45129 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:24.420112 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8867d-de48-4967-a491-463a92a45129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:24.420384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8867d-de48-4967-a491-463a92a45129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:24.421125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8867d-de48-4967-a491-463a92a45129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:24.422746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8867d-de48-4967-a491-463a92a45129 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:24.433681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1230/2454] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:30:24.437785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1849251-4945-41ab-8705-99d0448ee52d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:24.450118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1849251-4945-41ab-8705-99d0448ee52d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:24.456753 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3e013-b75f-45de-b1b6-36b5dc9b2a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:24.457510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e013-b75f-45de-b1b6-36b5dc9b2a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:24.457919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e013-b75f-45de-b1b6-36b5dc9b2a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:24.458257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e013-b75f-45de-b1b6-36b5dc9b2a94 admin admin] PATH_INFO: `/v3/projects/aaa06d8e3851479ba8e6b2ef15c883c4/users/22529049cd2c49d982442d09b5420803/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:24.484068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3e013-b75f-45de-b1b6-36b5dc9b2a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa06d8e3851479ba8e6b2ef15c883c4, user_id=22529049cd2c49d982442d09b5420803, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:24.486742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3e013-b75f-45de-b1b6-36b5dc9b2a94 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:24.503793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1225/2455] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:24 2022] PUT /identity/v3/projects/aaa06d8e3851479ba8e6b2ef15c883c4/users/22529049cd2c49d982442d09b5420803/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:30:24.518024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3925d-3208-41e8-ba00-f1a1fa064d87 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:24.518490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3925d-3208-41e8-ba00-f1a1fa064d87 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:24.518579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3925d-3208-41e8-ba00-f1a1fa064d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:24.554576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-acd3925d-3208-41e8-ba00-f1a1fa064d87 None None] MFA Rules not processed for user `22529049cd2c49d982442d09b5420803`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:24.556147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-acd3925d-3208-41e8-ba00-f1a1fa064d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:24.638469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1231/2456] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:24.650477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3e013-b75f-45de-b1b6-36b5dc9b2a94 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:24.652899 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-76d3e013-b75f-45de-b1b6-36b5dc9b2a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:24.717782 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3e013-b75f-45de-b1b6-36b5dc9b2a94 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:24.721716 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4eace-971c-4a96-8fad-1add54ea89e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:24.722354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4eace-971c-4a96-8fad-1add54ea89e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:24.722631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4eace-971c-4a96-8fad-1add54ea89e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:24.722897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4eace-971c-4a96-8fad-1add54ea89e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:24.732213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4eace-971c-4a96-8fad-1add54ea89e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:24.733818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4eace-971c-4a96-8fad-1add54ea89e0 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:24.753229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1226/2457] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:29.716118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3925d-3208-41e8-ba00-f1a1fa064d87 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:29.717764 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-acd3925d-3208-41e8-ba00-f1a1fa064d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:29.765967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:29.796827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3925d-3208-41e8-ba00-f1a1fa064d87 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:29.802061 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:29.802704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:29.802978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:29.803355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] PATH_INFO: `/v3/users/8514a74e122f43b3b76b2611c6eeabbc` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:29.804474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8514a74e122f43b3b76b2611c6eeabbc)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:29.806625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:29.858230 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8514a74e122f43b3b76b2611c6eeabbc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:29.859094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8514a74e122f43b3b76b2611c6eeabbc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:29.875389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8514a74e122f43b3b76b2611c6eeabbc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:29.885523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8514a74e122f43b3b76b2611c6eeabbc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:29.886232 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8514a74e122f43b3b76b2611c6eeabbc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:29.905508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1232/2458] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:30:29 2022] DELETE /identity/v3/users/8514a74e122f43b3b76b2611c6eeabbc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:29.912762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82560ad-3c0f-435c-a9cb-31a95786c10b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:29.912762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82560ad-3c0f-435c-a9cb-31a95786c10b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:29.912762 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82560ad-3c0f-435c-a9cb-31a95786c10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:29.933704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d82560ad-3c0f-435c-a9cb-31a95786c10b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:29.934445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d82560ad-3c0f-435c-a9cb-31a95786c10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:30.013808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1227/2459] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:30:30.026037 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:30.027561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:30.093069 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e2c41-1981-4948-8f8e-fe28caa2a586 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:30.096940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368a7d8-1732-4570-8c82-1b30969a6136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:30.097631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368a7d8-1732-4570-8c82-1b30969a6136 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:30.098005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368a7d8-1732-4570-8c82-1b30969a6136 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:30.098285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368a7d8-1732-4570-8c82-1b30969a6136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:30.108502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368a7d8-1732-4570-8c82-1b30969a6136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:30.110260 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368a7d8-1732-4570-8c82-1b30969a6136 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:30.122080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1233/2460] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:30.406357 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82560ad-3c0f-435c-a9cb-31a95786c10b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:30.408320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d82560ad-3c0f-435c-a9cb-31a95786c10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:30.423188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82560ad-3c0f-435c-a9cb-31a95786c10b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:30.428237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8d34c-6437-4c00-a441-211b773d65e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:30.429047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8d34c-6437-4c00-a441-211b773d65e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:30.429459 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8d34c-6437-4c00-a441-211b773d65e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:30.429732 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8d34c-6437-4c00-a441-211b773d65e8 admin admin] PATH_INFO: `/v3/projects/aec8ef49868442b2b6f437b083855f18` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:30.430890 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8d34c-6437-4c00-a441-211b773d65e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec8ef49868442b2b6f437b083855f18)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:30.433058 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8d34c-6437-4c00-a441-211b773d65e8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:30.452177 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:30.487534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-31d8d34c-6437-4c00-a441-211b773d65e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec8ef49868442b2b6f437b083855f18', 'request_id': 'req-31d8d34c-6437-4c00-a441-211b773d65e8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:30.496252 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-31d8d34c-6437-4c00-a441-211b773d65e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec8ef49868442b2b6f437b083855f18', 'request_id': 'req-31d8d34c-6437-4c00-a441-211b773d65e8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:30.503213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-31d8d34c-6437-4c00-a441-211b773d65e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec8ef49868442b2b6f437b083855f18', 'request_id': 'req-31d8d34c-6437-4c00-a441-211b773d65e8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:30.518314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-31d8d34c-6437-4c00-a441-211b773d65e8 admin admin] The token cache is being invalidate because project aec8ef49868442b2b6f437b083855f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:30:30.518709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-31d8d34c-6437-4c00-a441-211b773d65e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:30.519420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-31d8d34c-6437-4c00-a441-211b773d65e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:30.521427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1228/2461] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:30:30 2022] DELETE /identity/v3/projects/aec8ef49868442b2b6f437b083855f18 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:30.526368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d4d89-66af-4972-9100-fd3ca46d71bd None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:30.526654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d4d89-66af-4972-9100-fd3ca46d71bd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:30.526925 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d4d89-66af-4972-9100-fd3ca46d71bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:30.552280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1f2d4d89-66af-4972-9100-fd3ca46d71bd None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:30.553564 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1f2d4d89-66af-4972-9100-fd3ca46d71bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:30.606516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:30.616769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1234/2462] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:30:30.626090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7f655-dea7-4794-8505-d3b79725a4d9 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:30.626457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7f655-dea7-4794-8505-d3b79725a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:30.626803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7f655-dea7-4794-8505-d3b79725a4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:30.647293 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-06b7f655-dea7-4794-8505-d3b79725a4d9 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:30.648523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-06b7f655-dea7-4794-8505-d3b79725a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:30.657804 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1229/2463] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:30.662250 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d4d89-66af-4972-9100-fd3ca46d71bd None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:30.674245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d4d89-66af-4972-9100-fd3ca46d71bd None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:30.679324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75113a75-f6ce-4369-a282-9d069d47df10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:30.679943 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75113a75-f6ce-4369-a282-9d069d47df10 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:30.680237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75113a75-f6ce-4369-a282-9d069d47df10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:30.680504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75113a75-f6ce-4369-a282-9d069d47df10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:30.681244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75113a75-f6ce-4369-a282-9d069d47df10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:30:30.681545 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75113a75-f6ce-4369-a282-9d069d47df10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:30.683284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75113a75-f6ce-4369-a282-9d069d47df10 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:30.696655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1235/2464] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:30:30.701164 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7f655-dea7-4794-8505-d3b79725a4d9 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:30.710924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7f655-dea7-4794-8505-d3b79725a4d9 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:30.716071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2aa22-4148-4b84-9fba-76d88216f7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:30.716708 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2aa22-4148-4b84-9fba-76d88216f7fc admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:30.717125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2aa22-4148-4b84-9fba-76d88216f7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:30.717428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2aa22-4148-4b84-9fba-76d88216f7fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:30.718172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2aa22-4148-4b84-9fba-76d88216f7fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:30.720195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2aa22-4148-4b84-9fba-76d88216f7fc admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:30.749594 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1230/2465] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:30:30 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:30.753796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75113a75-f6ce-4369-a282-9d069d47df10 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:30.764301 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75113a75-f6ce-4369-a282-9d069d47df10 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:30.832549 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0b800-7f24-4263-b022-253573d048c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:30.833194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0b800-7f24-4263-b022-253573d048c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:30.833472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0b800-7f24-4263-b022-253573d048c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:30.833743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0b800-7f24-4263-b022-253573d048c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:30.834379 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0b800-7f24-4263-b022-253573d048c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:30.836327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0b800-7f24-4263-b022-253573d048c4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:30.858197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1236/2466] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:30:30 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:30.862509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2aa22-4148-4b84-9fba-76d88216f7fc admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:30.873060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2aa22-4148-4b84-9fba-76d88216f7fc admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:30.877822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06b1b6-a5b2-4075-957e-357d849c8693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:30.878430 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06b1b6-a5b2-4075-957e-357d849c8693 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:30.878782 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06b1b6-a5b2-4075-957e-357d849c8693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:30.878977 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06b1b6-a5b2-4075-957e-357d849c8693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:30.879710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06b1b6-a5b2-4075-957e-357d849c8693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:30.881377 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06b1b6-a5b2-4075-957e-357d849c8693 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:30.891768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1231/2467] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:30.895763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0b800-7f24-4263-b022-253573d048c4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:30.907887 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0b800-7f24-4263-b022-253573d048c4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:30.913361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea35b28-c54c-4470-9c14-3bf6fe0856b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:30.914014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea35b28-c54c-4470-9c14-3bf6fe0856b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:30.914294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea35b28-c54c-4470-9c14-3bf6fe0856b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:30.914561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea35b28-c54c-4470-9c14-3bf6fe0856b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:30.915213 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea35b28-c54c-4470-9c14-3bf6fe0856b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:30.916888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea35b28-c54c-4470-9c14-3bf6fe0856b4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:30.928644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1237/2468] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:30:30.933011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06b1b6-a5b2-4075-957e-357d849c8693 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:30.943613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06b1b6-a5b2-4075-957e-357d849c8693 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:30.949357 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad398d-aa9f-42fa-a850-50f1ec97acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:30.950024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad398d-aa9f-42fa-a850-50f1ec97acf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:30.950314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad398d-aa9f-42fa-a850-50f1ec97acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:30.951438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad398d-aa9f-42fa-a850-50f1ec97acf9 admin admin] PATH_INFO: `/v3/projects/2023d6404889439f8034ea56372395c1/users/fd0921be36eb4388a8e3098f5fba3ee7/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:30.967370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad398d-aa9f-42fa-a850-50f1ec97acf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2023d6404889439f8034ea56372395c1, user_id=fd0921be36eb4388a8e3098f5fba3ee7, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:30.970170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad398d-aa9f-42fa-a850-50f1ec97acf9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:30.984363 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1232/2469] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:30 2022] PUT /identity/v3/projects/2023d6404889439f8034ea56372395c1/users/fd0921be36eb4388a8e3098f5fba3ee7/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:30.989485 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b042a7-8c44-413a-ade2-20f0033482ea None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:30.989771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b042a7-8c44-413a-ade2-20f0033482ea None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:30.990046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b042a7-8c44-413a-ade2-20f0033482ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:31.009774 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d4b042a7-8c44-413a-ade2-20f0033482ea None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:31.011026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d4b042a7-8c44-413a-ade2-20f0033482ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:31.081680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1238/2470] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:31.091783 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad398d-aa9f-42fa-a850-50f1ec97acf9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:31.094025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cbad398d-aa9f-42fa-a850-50f1ec97acf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:31.163391 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad398d-aa9f-42fa-a850-50f1ec97acf9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:31.167362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fcad8-e68f-47e4-8cf1-e93b5d49e578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:31.167984 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fcad8-e68f-47e4-8cf1-e93b5d49e578 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:31.168807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fcad8-e68f-47e4-8cf1-e93b5d49e578 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:31.168807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fcad8-e68f-47e4-8cf1-e93b5d49e578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:31.181414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fcad8-e68f-47e4-8cf1-e93b5d49e578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:31.182170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fcad8-e68f-47e4-8cf1-e93b5d49e578 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:31.192212 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1233/2471] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:33.420646 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b042a7-8c44-413a-ade2-20f0033482ea None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:33.424500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d4b042a7-8c44-413a-ade2-20f0033482ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:33.438710 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b042a7-8c44-413a-ade2-20f0033482ea None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:33.444576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:33.445457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:33.445745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:33.446071 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] PATH_INFO: `/v3/users/22529049cd2c49d982442d09b5420803` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:33.447330 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22529049cd2c49d982442d09b5420803)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:33.451185 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:33.539171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22529049cd2c49d982442d09b5420803'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:33.540699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22529049cd2c49d982442d09b5420803'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:33.551689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22529049cd2c49d982442d09b5420803'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:33.558947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:33.572225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22529049cd2c49d982442d09b5420803'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:33.573603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22529049cd2c49d982442d09b5420803'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:33.609879 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1239/2472] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:30:33 2022] DELETE /identity/v3/users/22529049cd2c49d982442d09b5420803 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:33.615215 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def44af0-4831-4d36-a4ea-ad31207261e2 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:33.615706 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def44af0-4831-4d36-a4ea-ad31207261e2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:33.615806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def44af0-4831-4d36-a4ea-ad31207261e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:33.644411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-def44af0-4831-4d36-a4ea-ad31207261e2 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:33.645697 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-def44af0-4831-4d36-a4ea-ad31207261e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:33.696068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:33.743488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1234/2473] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:33.771018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:33.772615 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:33.868162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba32e60-a3ea-400c-bc14-e29e642980c6 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:33.873197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3592a-b69f-4b70-92e3-856e229a950a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:33.876401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3592a-b69f-4b70-92e3-856e229a950a service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:33.876401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3592a-b69f-4b70-92e3-856e229a950a service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:33.876401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3592a-b69f-4b70-92e3-856e229a950a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:33.909279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3592a-b69f-4b70-92e3-856e229a950a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:33.911021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3592a-b69f-4b70-92e3-856e229a950a service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:33.939512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1240/2474] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:34.420531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def44af0-4831-4d36-a4ea-ad31207261e2 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:34.422808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-def44af0-4831-4d36-a4ea-ad31207261e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:34.438024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def44af0-4831-4d36-a4ea-ad31207261e2 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:34.453635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05496497-9658-4937-80fb-0c6074cd1eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:34.454306 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05496497-9658-4937-80fb-0c6074cd1eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:34.456380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05496497-9658-4937-80fb-0c6074cd1eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:34.456380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05496497-9658-4937-80fb-0c6074cd1eef admin admin] PATH_INFO: `/v3/projects/aaa06d8e3851479ba8e6b2ef15c883c4` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:34.456380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05496497-9658-4937-80fb-0c6074cd1eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa06d8e3851479ba8e6b2ef15c883c4)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:34.458091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05496497-9658-4937-80fb-0c6074cd1eef admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:34.529801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-05496497-9658-4937-80fb-0c6074cd1eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa06d8e3851479ba8e6b2ef15c883c4', 'request_id': 'req-05496497-9658-4937-80fb-0c6074cd1eef'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:34.545090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-05496497-9658-4937-80fb-0c6074cd1eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa06d8e3851479ba8e6b2ef15c883c4', 'request_id': 'req-05496497-9658-4937-80fb-0c6074cd1eef'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:34.552601 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-05496497-9658-4937-80fb-0c6074cd1eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa06d8e3851479ba8e6b2ef15c883c4', 'request_id': 'req-05496497-9658-4937-80fb-0c6074cd1eef'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:34.586009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-05496497-9658-4937-80fb-0c6074cd1eef admin admin] The token cache is being invalidate because project aaa06d8e3851479ba8e6b2ef15c883c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:30:34.586533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-05496497-9658-4937-80fb-0c6074cd1eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:34.588146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-05496497-9658-4937-80fb-0c6074cd1eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:34.590688 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1235/2475] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:30:34 2022] DELETE /identity/v3/projects/aaa06d8e3851479ba8e6b2ef15c883c4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:34.596408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bed3c-c0f5-43e6-9faf-f741f95c1dbd None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:34.597322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bed3c-c0f5-43e6-9faf-f741f95c1dbd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:34.599212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bed3c-c0f5-43e6-9faf-f741f95c1dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:34.686227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d95bed3c-c0f5-43e6-9faf-f741f95c1dbd None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:34.690919 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d95bed3c-c0f5-43e6-9faf-f741f95c1dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:34.797740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1241/2476] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:34.807117 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a8e55-3ab1-42ec-99c8-1ef51336dc1f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:34.807992 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a8e55-3ab1-42ec-99c8-1ef51336dc1f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:34.808274 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a8e55-3ab1-42ec-99c8-1ef51336dc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:34.851016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-544a8e55-3ab1-42ec-99c8-1ef51336dc1f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:34.852770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-544a8e55-3ab1-42ec-99c8-1ef51336dc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:34.870468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1236/2477] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:34.874701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bed3c-c0f5-43e6-9faf-f741f95c1dbd None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:34.885475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bed3c-c0f5-43e6-9faf-f741f95c1dbd None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:34.890855 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188e512-4155-4ae5-bde5-1ce9f6a72965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:34.891515 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188e512-4155-4ae5-bde5-1ce9f6a72965 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:34.892221 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188e512-4155-4ae5-bde5-1ce9f6a72965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:34.892502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188e512-4155-4ae5-bde5-1ce9f6a72965 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:34.893264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188e512-4155-4ae5-bde5-1ce9f6a72965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:30:34.893574 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188e512-4155-4ae5-bde5-1ce9f6a72965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:34.895303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188e512-4155-4ae5-bde5-1ce9f6a72965 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:34.908880 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1242/2478] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:30:34.916546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a8e55-3ab1-42ec-99c8-1ef51336dc1f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:34.930746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a8e55-3ab1-42ec-99c8-1ef51336dc1f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:34.944069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefd9f4-e81d-4c56-bb4e-ec54dea46a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:34.944812 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefd9f4-e81d-4c56-bb4e-ec54dea46a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:34.945098 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefd9f4-e81d-4c56-bb4e-ec54dea46a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:34.949814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefd9f4-e81d-4c56-bb4e-ec54dea46a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:34.950488 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefd9f4-e81d-4c56-bb4e-ec54dea46a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:34.960137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefd9f4-e81d-4c56-bb4e-ec54dea46a73 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:35.003576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1237/2479] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:30:34 2022] POST /identity/v3/projects => generated 405 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:35.010478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188e512-4155-4ae5-bde5-1ce9f6a72965 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:35.030786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188e512-4155-4ae5-bde5-1ce9f6a72965 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:35.127753 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b98a60-dc89-4ea5-b907-d685393fd18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:35.127996 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b98a60-dc89-4ea5-b907-d685393fd18a admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:35.128216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b98a60-dc89-4ea5-b907-d685393fd18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:35.128384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b98a60-dc89-4ea5-b907-d685393fd18a admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:35.129121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b98a60-dc89-4ea5-b907-d685393fd18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:35.131070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b98a60-dc89-4ea5-b907-d685393fd18a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:35.148311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:35.173738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1243/2480] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:30:35 2022] POST /identity/v3/users => generated 303 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:35.178331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefd9f4-e81d-4c56-bb4e-ec54dea46a73 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:35.193181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefd9f4-e81d-4c56-bb4e-ec54dea46a73 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:35.199811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed5e6d-480a-459a-8035-5c71d79d9b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:35.200624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed5e6d-480a-459a-8035-5c71d79d9b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:35.201166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed5e6d-480a-459a-8035-5c71d79d9b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:35.201524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed5e6d-480a-459a-8035-5c71d79d9b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:35.202264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed5e6d-480a-459a-8035-5c71d79d9b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:35.204429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed5e6d-480a-459a-8035-5c71d79d9b54 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:35.220530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1238/2481] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:35.225073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b98a60-dc89-4ea5-b907-d685393fd18a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:35.236605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b98a60-dc89-4ea5-b907-d685393fd18a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:35.242416 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42032dd6-14c4-44e7-9c08-94940b88b3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:35.243377 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032dd6-14c4-44e7-9c08-94940b88b3fb admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:35.243758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032dd6-14c4-44e7-9c08-94940b88b3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:35.244135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032dd6-14c4-44e7-9c08-94940b88b3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:35.245287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42032dd6-14c4-44e7-9c08-94940b88b3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:35.247789 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42032dd6-14c4-44e7-9c08-94940b88b3fb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:35.261764 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1244/2482] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:35.269850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed5e6d-480a-459a-8035-5c71d79d9b54 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:35.290173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed5e6d-480a-459a-8035-5c71d79d9b54 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:35.305705 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e21c3-56c7-4518-8d51-4f25750ca62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:35.306506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e21c3-56c7-4518-8d51-4f25750ca62a admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:35.306794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e21c3-56c7-4518-8d51-4f25750ca62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:35.307147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e21c3-56c7-4518-8d51-4f25750ca62a admin admin] PATH_INFO: `/v3/projects/9064df696290415fa4fc158bb3e60e05/users/a97aa63bcb45489b8017ee10151d5091/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:35.335890 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e21c3-56c7-4518-8d51-4f25750ca62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9064df696290415fa4fc158bb3e60e05, user_id=a97aa63bcb45489b8017ee10151d5091, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:35.339822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e21c3-56c7-4518-8d51-4f25750ca62a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:35.361429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1239/2483] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:35 2022] PUT /identity/v3/projects/9064df696290415fa4fc158bb3e60e05/users/a97aa63bcb45489b8017ee10151d5091/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:35.375422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461beb84-092a-42a3-9cc3-8b1a666d812f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:35.375641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461beb84-092a-42a3-9cc3-8b1a666d812f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:35.376083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461beb84-092a-42a3-9cc3-8b1a666d812f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:35.421984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-461beb84-092a-42a3-9cc3-8b1a666d812f None None] MFA Rules not processed for user `a97aa63bcb45489b8017ee10151d5091`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:35.423210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-461beb84-092a-42a3-9cc3-8b1a666d812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:35.535309 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1245/2484] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:35 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:35.539780 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e21c3-56c7-4518-8d51-4f25750ca62a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:35.679040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e21c3-56c7-4518-8d51-4f25750ca62a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:35.692677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0637c-e882-42fa-8ef3-71c08a798123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:35.693466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0637c-e882-42fa-8ef3-71c08a798123 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:35.693764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0637c-e882-42fa-8ef3-71c08a798123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:35.693999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0637c-e882-42fa-8ef3-71c08a798123 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:35.694786 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0637c-e882-42fa-8ef3-71c08a798123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:35.696903 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0637c-e882-42fa-8ef3-71c08a798123 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:35.708545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:35.744768 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1240/2485] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:30:35 2022] POST /identity/v3/projects => generated 403 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:35.749905 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461beb84-092a-42a3-9cc3-8b1a666d812f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:35.777460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461beb84-092a-42a3-9cc3-8b1a666d812f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:35.898898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9601a-a67b-4e90-995a-4a80bc8c0d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:35.899900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9601a-a67b-4e90-995a-4a80bc8c0d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:35.900034 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9601a-a67b-4e90-995a-4a80bc8c0d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:35.900386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9601a-a67b-4e90-995a-4a80bc8c0d39 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:35.901216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9601a-a67b-4e90-995a-4a80bc8c0d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:35.903373 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9601a-a67b-4e90-995a-4a80bc8c0d39 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:35.941403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1246/2486] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:30:35 2022] POST /identity/v3/users => generated 308 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:30:35.946684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0637c-e882-42fa-8ef3-71c08a798123 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:35.965909 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0637c-e882-42fa-8ef3-71c08a798123 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:35.974928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f53bc-11b0-4f7d-85c7-98c989d57792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:35.975933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f53bc-11b0-4f7d-85c7-98c989d57792 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:35.976312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f53bc-11b0-4f7d-85c7-98c989d57792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:35.976685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f53bc-11b0-4f7d-85c7-98c989d57792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:35.977554 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f53bc-11b0-4f7d-85c7-98c989d57792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:35.979800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f53bc-11b0-4f7d-85c7-98c989d57792 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:35.995249 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1241/2487] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:35.996750 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9601a-a67b-4e90-995a-4a80bc8c0d39 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:36.016795 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9601a-a67b-4e90-995a-4a80bc8c0d39 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:36.026271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af0f6e-b4eb-4f0a-8e01-237460ac1200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:36.027058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af0f6e-b4eb-4f0a-8e01-237460ac1200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:36.027680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af0f6e-b4eb-4f0a-8e01-237460ac1200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:36.028031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af0f6e-b4eb-4f0a-8e01-237460ac1200 admin admin] PATH_INFO: `/v3/projects/d6df32487d384a89a66e97133d644997/users/597fa92b1cae47bd8ffaea6736d968a2/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:36.047105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af0f6e-b4eb-4f0a-8e01-237460ac1200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6df32487d384a89a66e97133d644997, user_id=597fa92b1cae47bd8ffaea6736d968a2, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:36.050520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af0f6e-b4eb-4f0a-8e01-237460ac1200 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:36.071223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1247/2488] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:35 2022] PUT /identity/v3/projects/d6df32487d384a89a66e97133d644997/users/597fa92b1cae47bd8ffaea6736d968a2/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:36.075428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f53bc-11b0-4f7d-85c7-98c989d57792 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:36.091298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f53bc-11b0-4f7d-85c7-98c989d57792 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:36.228948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481083-57b3-4984-865d-a52a0637733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:36.230253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481083-57b3-4984-865d-a52a0637733e admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:36.230745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481083-57b3-4984-865d-a52a0637733e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:36.231411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481083-57b3-4984-865d-a52a0637733e admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:36.239006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f481083-57b3-4984-865d-a52a0637733e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:36.241154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f481083-57b3-4984-865d-a52a0637733e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:36.271999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af0f6e-b4eb-4f0a-8e01-237460ac1200 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:36.274638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1242/2489] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:36.296055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af0f6e-b4eb-4f0a-8e01-237460ac1200 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:36.306933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06617df-23d9-43fa-b420-fe7f91b51d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:36.308119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06617df-23d9-43fa-b420-fe7f91b51d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:36.308610 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06617df-23d9-43fa-b420-fe7f91b51d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:36.309164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06617df-23d9-43fa-b420-fe7f91b51d1f admin admin] PATH_INFO: `/v3/projects/d6df32487d384a89a66e97133d644997/users/597fa92b1cae47bd8ffaea6736d968a2/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:36.318472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06617df-23d9-43fa-b420-fe7f91b51d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6df32487d384a89a66e97133d644997, user_id=597fa92b1cae47bd8ffaea6736d968a2, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:36.329752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06617df-23d9-43fa-b420-fe7f91b51d1f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:36.356510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1248/2490] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:36 2022] PUT /identity/v3/projects/d6df32487d384a89a66e97133d644997/users/597fa92b1cae47bd8ffaea6736d968a2/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:36.357133 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1aed0-70f9-42bb-8983-ec2f377af353 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:36.357425 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1aed0-70f9-42bb-8983-ec2f377af353 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:36.357706 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1aed0-70f9-42bb-8983-ec2f377af353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:36.416516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1ca1aed0-70f9-42bb-8983-ec2f377af353 None None] MFA Rules not processed for user `597fa92b1cae47bd8ffaea6736d968a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:36.418338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1ca1aed0-70f9-42bb-8983-ec2f377af353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:36.419964 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67fcfe-2a23-4be6-84d2-a97af83900a8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:36.420913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67fcfe-2a23-4be6-84d2-a97af83900a8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:36.421506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67fcfe-2a23-4be6-84d2-a97af83900a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:36.460446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-bc67fcfe-2a23-4be6-84d2-a97af83900a8 None None] MFA Rules not processed for user `fd0921be36eb4388a8e3098f5fba3ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:36.462260 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bc67fcfe-2a23-4be6-84d2-a97af83900a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:36.477574 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:36.567537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1249/2491] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:30:36.571656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67fcfe-2a23-4be6-84d2-a97af83900a8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:36.573286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bc67fcfe-2a23-4be6-84d2-a97af83900a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:36.588953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1243/2492] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:36.600076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1aed0-70f9-42bb-8983-ec2f377af353 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:36.602804 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1ca1aed0-70f9-42bb-8983-ec2f377af353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:36.685414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1aed0-70f9-42bb-8983-ec2f377af353 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:36.691020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cdc40-b29d-40d6-a250-4281b52781d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:36.692552 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cdc40-b29d-40d6-a250-4281b52781d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:36.692881 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cdc40-b29d-40d6-a250-4281b52781d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:36.693166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cdc40-b29d-40d6-a250-4281b52781d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:36.705068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cdc40-b29d-40d6-a250-4281b52781d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:36.706841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cdc40-b29d-40d6-a250-4281b52781d9 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:36.721567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1244/2493] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:36 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:36.739839 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67fcfe-2a23-4be6-84d2-a97af83900a8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:36.751528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89459550-2f6d-4341-8dfb-2205889a5800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:36.754679 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89459550-2f6d-4341-8dfb-2205889a5800 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:36.756187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89459550-2f6d-4341-8dfb-2205889a5800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:36.757680 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89459550-2f6d-4341-8dfb-2205889a5800 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:36.766807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89459550-2f6d-4341-8dfb-2205889a5800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:36.777766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89459550-2f6d-4341-8dfb-2205889a5800 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:36.862689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1250/2494] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:30:36 2022] POST /identity/v3/projects => generated 373 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:30:36.866568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cdc40-b29d-40d6-a250-4281b52781d9 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:36.873242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:36.890466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cdc40-b29d-40d6-a250-4281b52781d9 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:37.033583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89459550-2f6d-4341-8dfb-2205889a5800 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:37.122935 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b349369-8d14-4a2c-a3e2-af8a706d3184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:37.123756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b349369-8d14-4a2c-a3e2-af8a706d3184 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:37.123934 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b349369-8d14-4a2c-a3e2-af8a706d3184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:37.124305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b349369-8d14-4a2c-a3e2-af8a706d3184 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:37.125180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b349369-8d14-4a2c-a3e2-af8a706d3184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:37.127388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b349369-8d14-4a2c-a3e2-af8a706d3184 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:37.154976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1245/2495] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:30:36 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:37.159205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b349369-8d14-4a2c-a3e2-af8a706d3184 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:37.175404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b349369-8d14-4a2c-a3e2-af8a706d3184 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:37.175902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89459550-2f6d-4341-8dfb-2205889a5800 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:37.180282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138e21b-60ed-4e06-9c73-c98675a99f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:37.180938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138e21b-60ed-4e06-9c73-c98675a99f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:37.181216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138e21b-60ed-4e06-9c73-c98675a99f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:37.181343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982cabe-6a01-4291-956d-0db478728385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:37.181500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138e21b-60ed-4e06-9c73-c98675a99f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:37.182117 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982cabe-6a01-4291-956d-0db478728385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:37.182236 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138e21b-60ed-4e06-9c73-c98675a99f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:37.182514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982cabe-6a01-4291-956d-0db478728385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:37.183520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982cabe-6a01-4291-956d-0db478728385 admin admin] PATH_INFO: `/v3/users/a97aa63bcb45489b8017ee10151d5091` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:37.183802 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138e21b-60ed-4e06-9c73-c98675a99f95 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:37.184793 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982cabe-6a01-4291-956d-0db478728385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a97aa63bcb45489b8017ee10151d5091)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:37.187425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982cabe-6a01-4291-956d-0db478728385 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:37.194508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1246/2496] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:37.198666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138e21b-60ed-4e06-9c73-c98675a99f95 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:37.211290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138e21b-60ed-4e06-9c73-c98675a99f95 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:37.216751 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173b08c-ce8e-41a1-a75b-03777df76370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:37.217500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173b08c-ce8e-41a1-a75b-03777df76370 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:37.217787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173b08c-ce8e-41a1-a75b-03777df76370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:37.218229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173b08c-ce8e-41a1-a75b-03777df76370 admin admin] PATH_INFO: `/v3/projects/538b0b2526cb470c902eec19c82f5308/users/1f2950443b7d4cfaa7db5d3930578932/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:37.236408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173b08c-ce8e-41a1-a75b-03777df76370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538b0b2526cb470c902eec19c82f5308, user_id=1f2950443b7d4cfaa7db5d3930578932, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:37.239739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173b08c-ce8e-41a1-a75b-03777df76370 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:37.243222 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:37.246128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7982cabe-6a01-4291-956d-0db478728385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a97aa63bcb45489b8017ee10151d5091'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:37.246787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7982cabe-6a01-4291-956d-0db478728385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a97aa63bcb45489b8017ee10151d5091'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:37.255304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7982cabe-6a01-4291-956d-0db478728385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a97aa63bcb45489b8017ee10151d5091'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:37.256692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1247/2497] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:37 2022] PUT /identity/v3/projects/538b0b2526cb470c902eec19c82f5308/users/1f2950443b7d4cfaa7db5d3930578932/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:30:37.260765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173b08c-ce8e-41a1-a75b-03777df76370 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:37.266818 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7982cabe-6a01-4291-956d-0db478728385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a97aa63bcb45489b8017ee10151d5091'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:37.267769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7982cabe-6a01-4291-956d-0db478728385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a97aa63bcb45489b8017ee10151d5091'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:37.288090 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1251/2498] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:30:37 2022] DELETE /identity/v3/users/a97aa63bcb45489b8017ee10151d5091 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:37.292373 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c5afa-8874-4eda-a548-b3cc63553d4f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:37.292658 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c5afa-8874-4eda-a548-b3cc63553d4f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:37.292982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c5afa-8874-4eda-a548-b3cc63553d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:37.311811 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d27c5afa-8874-4eda-a548-b3cc63553d4f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:37.313151 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d27c5afa-8874-4eda-a548-b3cc63553d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:37.368418 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173b08c-ce8e-41a1-a75b-03777df76370 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:37.403264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1252/2499] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:30:37.426279 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c5afa-8874-4eda-a548-b3cc63553d4f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:37.428043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d27c5afa-8874-4eda-a548-b3cc63553d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:37.441454 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa33b42-5a94-46b4-8512-70a3ba0506f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:37.442224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa33b42-5a94-46b4-8512-70a3ba0506f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:37.442591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa33b42-5a94-46b4-8512-70a3ba0506f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:37.442933 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa33b42-5a94-46b4-8512-70a3ba0506f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:37.443706 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa33b42-5a94-46b4-8512-70a3ba0506f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:37.445713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa33b42-5a94-46b4-8512-70a3ba0506f1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:37.451728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:37.463056 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1248/2500] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:37.464246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa33b42-5a94-46b4-8512-70a3ba0506f1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:37.467111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bfa33b42-5a94-46b4-8512-70a3ba0506f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:37.481247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa33b42-5a94-46b4-8512-70a3ba0506f1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:37.490585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc224b04-be8e-47d4-a17d-5e0d9676664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:37.491369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc224b04-be8e-47d4-a17d-5e0d9676664c admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:37.491751 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc224b04-be8e-47d4-a17d-5e0d9676664c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:37.492095 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc224b04-be8e-47d4-a17d-5e0d9676664c admin admin] PATH_INFO: `/v3/projects/538b0b2526cb470c902eec19c82f5308/users/1f2950443b7d4cfaa7db5d3930578932/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:37.493464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c5afa-8874-4eda-a548-b3cc63553d4f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:37.494897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc224b04-be8e-47d4-a17d-5e0d9676664c admin admin] RBAC: Authorizing `identity:create_grant(project_id=538b0b2526cb470c902eec19c82f5308, user_id=1f2950443b7d4cfaa7db5d3930578932, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:37.497246 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6ab7f-94ff-47c4-84ed-d461a0ad6170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:37.497847 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6ab7f-94ff-47c4-84ed-d461a0ad6170 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:37.498122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6ab7f-94ff-47c4-84ed-d461a0ad6170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:37.498390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6ab7f-94ff-47c4-84ed-d461a0ad6170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:37.498592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc224b04-be8e-47d4-a17d-5e0d9676664c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:37.509565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6ab7f-94ff-47c4-84ed-d461a0ad6170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:37.511608 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6ab7f-94ff-47c4-84ed-d461a0ad6170 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:37.513071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1249/2501] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:37 2022] PUT /identity/v3/projects/538b0b2526cb470c902eec19c82f5308/users/1f2950443b7d4cfaa7db5d3930578932/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:37.531205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1253/2502] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:37.915645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc224b04-be8e-47d4-a17d-5e0d9676664c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:37.918171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bc224b04-be8e-47d4-a17d-5e0d9676664c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:38.010225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc224b04-be8e-47d4-a17d-5e0d9676664c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:38.017823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:38.018622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:38.019000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:38.019324 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] PATH_INFO: `/v3/projects/9064df696290415fa4fc158bb3e60e05` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:38.020935 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9064df696290415fa4fc158bb3e60e05)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:38.023707 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:38.091260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9064df696290415fa4fc158bb3e60e05', 'request_id': 'req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.102019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9064df696290415fa4fc158bb3e60e05', 'request_id': 'req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.112776 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9064df696290415fa4fc158bb3e60e05', 'request_id': 'req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.126836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] The token cache is being invalidate because project 9064df696290415fa4fc158bb3e60e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:30:38.127497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.128495 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.130156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1250/2503] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:30:37 2022] DELETE /identity/v3/projects/9064df696290415fa4fc158bb3e60e05 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:38.134266 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6ab7f-94ff-47c4-84ed-d461a0ad6170 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:38.144418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6ab7f-94ff-47c4-84ed-d461a0ad6170 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:38.208287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5781a-dc2c-4b63-8daa-75e134eb7b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:38.208817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5781a-dc2c-4b63-8daa-75e134eb7b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:38.209128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5781a-dc2c-4b63-8daa-75e134eb7b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:38.209900 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5781a-dc2c-4b63-8daa-75e134eb7b5d admin admin] PATH_INFO: `/v3/users/597fa92b1cae47bd8ffaea6736d968a2` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:38.212350 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5781a-dc2c-4b63-8daa-75e134eb7b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=597fa92b1cae47bd8ffaea6736d968a2)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:38.213387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5781a-dc2c-4b63-8daa-75e134eb7b5d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:38.219304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:38.285274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-81f5781a-dc2c-4b63-8daa-75e134eb7b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597fa92b1cae47bd8ffaea6736d968a2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.285914 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-81f5781a-dc2c-4b63-8daa-75e134eb7b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597fa92b1cae47bd8ffaea6736d968a2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.297372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-81f5781a-dc2c-4b63-8daa-75e134eb7b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597fa92b1cae47bd8ffaea6736d968a2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.310272 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-81f5781a-dc2c-4b63-8daa-75e134eb7b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597fa92b1cae47bd8ffaea6736d968a2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.312142 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-81f5781a-dc2c-4b63-8daa-75e134eb7b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597fa92b1cae47bd8ffaea6736d968a2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.333430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1254/2504] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:30:38 2022] DELETE /identity/v3/users/597fa92b1cae47bd8ffaea6736d968a2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:38.679112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:38.682281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:38.703646 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87934d3-a23d-4f64-9d9f-ecdee82b6fd4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:38.788178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46074b-ab03-41ad-814e-fa8bc7020182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:38.788178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46074b-ab03-41ad-814e-fa8bc7020182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:38.789307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46074b-ab03-41ad-814e-fa8bc7020182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:38.789653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46074b-ab03-41ad-814e-fa8bc7020182 admin admin] PATH_INFO: `/v3/projects/d6df32487d384a89a66e97133d644997` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:38.792136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46074b-ab03-41ad-814e-fa8bc7020182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6df32487d384a89a66e97133d644997)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:38.794456 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46074b-ab03-41ad-814e-fa8bc7020182 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:38.818126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:38.853189 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3a46074b-ab03-41ad-814e-fa8bc7020182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6df32487d384a89a66e97133d644997', 'request_id': 'req-3a46074b-ab03-41ad-814e-fa8bc7020182'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.864443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3a46074b-ab03-41ad-814e-fa8bc7020182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6df32487d384a89a66e97133d644997', 'request_id': 'req-3a46074b-ab03-41ad-814e-fa8bc7020182'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.871803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3a46074b-ab03-41ad-814e-fa8bc7020182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6df32487d384a89a66e97133d644997', 'request_id': 'req-3a46074b-ab03-41ad-814e-fa8bc7020182'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.884927 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3a46074b-ab03-41ad-814e-fa8bc7020182 admin admin] The token cache is being invalidate because project d6df32487d384a89a66e97133d644997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:30:38.885312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3a46074b-ab03-41ad-814e-fa8bc7020182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.885893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3a46074b-ab03-41ad-814e-fa8bc7020182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:38.891296 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1251/2505] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:30:38 2022] DELETE /identity/v3/projects/d6df32487d384a89a66e97133d644997 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:38.892988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca84c-82f2-4ca4-ae18-deb70ab3db52 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:38.893281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca84c-82f2-4ca4-ae18-deb70ab3db52 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:38.893602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca84c-82f2-4ca4-ae18-deb70ab3db52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:38.921512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-969ca84c-82f2-4ca4-ae18-deb70ab3db52 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:38.923224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-969ca84c-82f2-4ca4-ae18-deb70ab3db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:39.033477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1255/2506] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:30:39.034335 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c371578-f878-4ff4-8573-83730daac371 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:39.034662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c371578-f878-4ff4-8573-83730daac371 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:39.034946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c371578-f878-4ff4-8573-83730daac371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:39.057705 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9c371578-f878-4ff4-8573-83730daac371 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:39.058951 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9c371578-f878-4ff4-8573-83730daac371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:39.068278 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1252/2507] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:39.073244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca84c-82f2-4ca4-ae18-deb70ab3db52 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:39.085188 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca84c-82f2-4ca4-ae18-deb70ab3db52 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:39.091677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffb40a-a2a8-4e33-a57d-21c487f2db57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:39.092376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffb40a-a2a8-4e33-a57d-21c487f2db57 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:39.092655 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffb40a-a2a8-4e33-a57d-21c487f2db57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:39.092962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffb40a-a2a8-4e33-a57d-21c487f2db57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:39.093658 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffb40a-a2a8-4e33-a57d-21c487f2db57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:30:39.094266 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffb40a-a2a8-4e33-a57d-21c487f2db57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:39.095940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffb40a-a2a8-4e33-a57d-21c487f2db57 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:39.115472 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1256/2508] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:30:39.116635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c371578-f878-4ff4-8573-83730daac371 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:39.128564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c371578-f878-4ff4-8573-83730daac371 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:39.133529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9b7a4-bc60-4d63-96a4-5cd4ebd3c8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:39.134221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9b7a4-bc60-4d63-96a4-5cd4ebd3c8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:39.134788 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9b7a4-bc60-4d63-96a4-5cd4ebd3c8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:39.134971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9b7a4-bc60-4d63-96a4-5cd4ebd3c8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:39.135726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9b7a4-bc60-4d63-96a4-5cd4ebd3c8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:39.137878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9b7a4-bc60-4d63-96a4-5cd4ebd3c8b8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:39.174465 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1253/2509] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:30:39 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:30:39.176366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffb40a-a2a8-4e33-a57d-21c487f2db57 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:39.188336 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffb40a-a2a8-4e33-a57d-21c487f2db57 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:39.262125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b781cdc-a441-49af-b999-791ab9ef2da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:39.263441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b781cdc-a441-49af-b999-791ab9ef2da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:39.263731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b781cdc-a441-49af-b999-791ab9ef2da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:39.264008 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b781cdc-a441-49af-b999-791ab9ef2da4 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:39.264685 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b781cdc-a441-49af-b999-791ab9ef2da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:39.267432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b781cdc-a441-49af-b999-791ab9ef2da4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:39.292994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:39.305763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9b7a4-bc60-4d63-96a4-5cd4ebd3c8b8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:39.316458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1257/2510] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:30:39 2022] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:39.324266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9b7a4-bc60-4d63-96a4-5cd4ebd3c8b8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:39.331635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1619a5-e5db-45d6-95b0-9540318c5e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:39.332279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1619a5-e5db-45d6-95b0-9540318c5e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:39.332591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1619a5-e5db-45d6-95b0-9540318c5e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:39.333460 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1619a5-e5db-45d6-95b0-9540318c5e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:39.334168 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1619a5-e5db-45d6-95b0-9540318c5e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:39.335813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1619a5-e5db-45d6-95b0-9540318c5e13 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:39.348769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1254/2511] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:39.351065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b781cdc-a441-49af-b999-791ab9ef2da4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:39.362430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b781cdc-a441-49af-b999-791ab9ef2da4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:39.367815 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b01334-7987-49c5-8b74-bded616afe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:39.368678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b01334-7987-49c5-8b74-bded616afe11 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:39.368678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b01334-7987-49c5-8b74-bded616afe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:39.369005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b01334-7987-49c5-8b74-bded616afe11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:39.369611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b01334-7987-49c5-8b74-bded616afe11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:39.371233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b01334-7987-49c5-8b74-bded616afe11 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:39.382168 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1258/2512] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:39.386533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1619a5-e5db-45d6-95b0-9540318c5e13 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:39.397764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1619a5-e5db-45d6-95b0-9540318c5e13 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:39.403154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b535975-7507-44d1-94d7-a2c17cbf3615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:39.403920 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b535975-7507-44d1-94d7-a2c17cbf3615 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:39.404261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b535975-7507-44d1-94d7-a2c17cbf3615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:39.404598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b535975-7507-44d1-94d7-a2c17cbf3615 admin admin] PATH_INFO: `/v3/projects/752c741a91da46e89bd931213a4e2c5c/users/3f2ea3ff88fb43fa9fc31fd7b17fdfd1/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:39.421260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b535975-7507-44d1-94d7-a2c17cbf3615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=752c741a91da46e89bd931213a4e2c5c, user_id=3f2ea3ff88fb43fa9fc31fd7b17fdfd1, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:39.424047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b535975-7507-44d1-94d7-a2c17cbf3615 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:39.445959 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1255/2513] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:39 2022] PUT /identity/v3/projects/752c741a91da46e89bd931213a4e2c5c/users/3f2ea3ff88fb43fa9fc31fd7b17fdfd1/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:30:39.451384 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91852113-a851-4864-9fb0-a2c225d1125f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:39.451671 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91852113-a851-4864-9fb0-a2c225d1125f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:39.451952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91852113-a851-4864-9fb0-a2c225d1125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:39.495249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-91852113-a851-4864-9fb0-a2c225d1125f None None] MFA Rules not processed for user `3f2ea3ff88fb43fa9fc31fd7b17fdfd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:39.496297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-91852113-a851-4864-9fb0-a2c225d1125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:39.572858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1259/2514] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:39.577006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b535975-7507-44d1-94d7-a2c17cbf3615 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:39.655126 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b535975-7507-44d1-94d7-a2c17cbf3615 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:39.666374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f571a-6875-4028-86fe-434f07b39bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:39.667141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f571a-6875-4028-86fe-434f07b39bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:39.667522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f571a-6875-4028-86fe-434f07b39bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:39.667897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f571a-6875-4028-86fe-434f07b39bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:39.668650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f571a-6875-4028-86fe-434f07b39bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:39.671385 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f571a-6875-4028-86fe-434f07b39bfa admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:39.704072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1256/2515] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:30:39 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:39.709244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91852113-a851-4864-9fb0-a2c225d1125f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:39.721426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91852113-a851-4864-9fb0-a2c225d1125f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:39.782516 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebefe3d-24eb-4f7a-ac7f-6453f9ff317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:39.783465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebefe3d-24eb-4f7a-ac7f-6453f9ff317d admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:39.783465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebefe3d-24eb-4f7a-ac7f-6453f9ff317d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:39.783684 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebefe3d-24eb-4f7a-ac7f-6453f9ff317d admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:39.784321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebefe3d-24eb-4f7a-ac7f-6453f9ff317d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:39.786421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebefe3d-24eb-4f7a-ac7f-6453f9ff317d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:39.817172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1260/2516] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:30:39 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:39.818893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f571a-6875-4028-86fe-434f07b39bfa admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:39.831031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f571a-6875-4028-86fe-434f07b39bfa admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:39.836453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283fde7-fe0e-4581-bda5-5691d2f5226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:39.837467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283fde7-fe0e-4581-bda5-5691d2f5226c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:39.837808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283fde7-fe0e-4581-bda5-5691d2f5226c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:39.838674 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283fde7-fe0e-4581-bda5-5691d2f5226c admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:39.839203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283fde7-fe0e-4581-bda5-5691d2f5226c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:39.840946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283fde7-fe0e-4581-bda5-5691d2f5226c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:39.856662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1257/2517] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:39.857497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebefe3d-24eb-4f7a-ac7f-6453f9ff317d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:39.868366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebefe3d-24eb-4f7a-ac7f-6453f9ff317d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:39.873296 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb376f-89c2-4690-9891-67ef2e6c807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:39.873991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb376f-89c2-4690-9891-67ef2e6c807d admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:39.874270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb376f-89c2-4690-9891-67ef2e6c807d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:39.874582 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb376f-89c2-4690-9891-67ef2e6c807d admin admin] PATH_INFO: `/v3/projects/0d8c89712f964f4a880d1e18e6308a9c/users/f5acea1130c44263aeeaed8b43ed603a/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:39.893085 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb376f-89c2-4690-9891-67ef2e6c807d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8c89712f964f4a880d1e18e6308a9c, user_id=f5acea1130c44263aeeaed8b43ed603a, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:39.897095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb376f-89c2-4690-9891-67ef2e6c807d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:39.926349 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1261/2518] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:39 2022] PUT /identity/v3/projects/0d8c89712f964f4a880d1e18e6308a9c/users/f5acea1130c44263aeeaed8b43ed603a/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:39.927576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283fde7-fe0e-4581-bda5-5691d2f5226c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:39.944347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283fde7-fe0e-4581-bda5-5691d2f5226c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:39.969519 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:40.047721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31cad1-ab31-4093-af80-cba87d0cd442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:40.048471 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31cad1-ab31-4093-af80-cba87d0cd442 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:40.048866 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31cad1-ab31-4093-af80-cba87d0cd442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:40.049241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31cad1-ab31-4093-af80-cba87d0cd442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:40.049966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31cad1-ab31-4093-af80-cba87d0cd442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:40.051956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31cad1-ab31-4093-af80-cba87d0cd442 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:40.069777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1258/2519] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:40.071927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb376f-89c2-4690-9891-67ef2e6c807d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:40.086556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb376f-89c2-4690-9891-67ef2e6c807d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:40.092598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee92c84-063d-4c4c-a5db-3848f1ea11db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:40.092598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee92c84-063d-4c4c-a5db-3848f1ea11db admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:40.092598 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee92c84-063d-4c4c-a5db-3848f1ea11db admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:40.092934 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee92c84-063d-4c4c-a5db-3848f1ea11db admin admin] PATH_INFO: `/v3/projects/0d8c89712f964f4a880d1e18e6308a9c/users/f5acea1130c44263aeeaed8b43ed603a/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:40.094910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee92c84-063d-4c4c-a5db-3848f1ea11db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8c89712f964f4a880d1e18e6308a9c, user_id=f5acea1130c44263aeeaed8b43ed603a, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:40.097746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee92c84-063d-4c4c-a5db-3848f1ea11db admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:40.122513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1262/2520] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:40 2022] PUT /identity/v3/projects/0d8c89712f964f4a880d1e18e6308a9c/users/f5acea1130c44263aeeaed8b43ed603a/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:30:40.141159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42ef5d-647f-4add-a2c3-141f52bc1741 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:40.141608 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42ef5d-647f-4add-a2c3-141f52bc1741 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:40.141690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42ef5d-647f-4add-a2c3-141f52bc1741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:40.174455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6c42ef5d-647f-4add-a2c3-141f52bc1741 None None] MFA Rules not processed for user `f5acea1130c44263aeeaed8b43ed603a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:40.176904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6c42ef5d-647f-4add-a2c3-141f52bc1741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:40.294324 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1259/2521] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:40.307557 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee92c84-063d-4c4c-a5db-3848f1ea11db admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:40.309636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-dee92c84-063d-4c4c-a5db-3848f1ea11db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:40.369305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:40.404399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee92c84-063d-4c4c-a5db-3848f1ea11db admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:40.411432 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e21f4-d061-45be-94fa-80bb78d7d28a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:40.412302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e21f4-d061-45be-94fa-80bb78d7d28a service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:40.412926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e21f4-d061-45be-94fa-80bb78d7d28a service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:40.413376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e21f4-d061-45be-94fa-80bb78d7d28a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:40.451944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e21f4-d061-45be-94fa-80bb78d7d28a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:40.453636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e21f4-d061-45be-94fa-80bb78d7d28a service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:40.469614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1263/2522] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:40.559941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42ef5d-647f-4add-a2c3-141f52bc1741 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:40.562339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6c42ef5d-647f-4add-a2c3-141f52bc1741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:40.598558 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42ef5d-647f-4add-a2c3-141f52bc1741 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:40.607162 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591437e9-8cbe-49ae-b961-7b45307434fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:40.613536 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591437e9-8cbe-49ae-b961-7b45307434fa service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:40.614061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591437e9-8cbe-49ae-b961-7b45307434fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:40.614398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591437e9-8cbe-49ae-b961-7b45307434fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:40.708142 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591437e9-8cbe-49ae-b961-7b45307434fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:40.710199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591437e9-8cbe-49ae-b961-7b45307434fa service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:40.733993 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1260/2523] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:30:42.717099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1696537-6619-4aca-a242-bd8fe3412651 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:42.717560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1696537-6619-4aca-a242-bd8fe3412651 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:42.717724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1696537-6619-4aca-a242-bd8fe3412651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:42.770923 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d1696537-6619-4aca-a242-bd8fe3412651 None None] MFA Rules not processed for user `1f2950443b7d4cfaa7db5d3930578932`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:42.772446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d1696537-6619-4aca-a242-bd8fe3412651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:42.922622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1264/2524] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:42.940297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591437e9-8cbe-49ae-b961-7b45307434fa service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:42.942639 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-591437e9-8cbe-49ae-b961-7b45307434fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:43.029033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:43.071979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591437e9-8cbe-49ae-b961-7b45307434fa service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:43.080739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c553-c2a8-4f62-b7ca-65704dd951e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:43.081408 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c553-c2a8-4f62-b7ca-65704dd951e8 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:43.081701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c553-c2a8-4f62-b7ca-65704dd951e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:43.082117 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c553-c2a8-4f62-b7ca-65704dd951e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:43.084058 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3483c553-c2a8-4f62-b7ca-65704dd951e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:43.210367 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483c553-c2a8-4f62-b7ca-65704dd951e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:43.212004 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483c553-c2a8-4f62-b7ca-65704dd951e8 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:43.237716 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1261/2525] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:44.303407 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b8c6e-cbef-48ea-812e-8824631f8ba5 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:44.303959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b8c6e-cbef-48ea-812e-8824631f8ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:44.304062 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b8c6e-cbef-48ea-812e-8824631f8ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:44.323805 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-534b8c6e-cbef-48ea-812e-8824631f8ba5 None None] MFA Rules not processed for user `fd0921be36eb4388a8e3098f5fba3ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:44.325266 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-534b8c6e-cbef-48ea-812e-8824631f8ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:44.334070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1265/2526] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:45.261655 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c553-c2a8-4f62-b7ca-65704dd951e8 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:45.338724 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c553-c2a8-4f62-b7ca-65704dd951e8 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:45.344041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:45.345038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:45.345344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:45.345623 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] PATH_INFO: `/v3/users/3f2ea3ff88fb43fa9fc31fd7b17fdfd1` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:45.346764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2ea3ff88fb43fa9fc31fd7b17fdfd1)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:45.349428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:45.414684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2ea3ff88fb43fa9fc31fd7b17fdfd1'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:45.427154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2ea3ff88fb43fa9fc31fd7b17fdfd1'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:45.428435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2ea3ff88fb43fa9fc31fd7b17fdfd1'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:45.436273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2ea3ff88fb43fa9fc31fd7b17fdfd1'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:45.439492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:45.449146 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2ea3ff88fb43fa9fc31fd7b17fdfd1'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:45.462618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1262/2527] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:30:45 2022] DELETE /identity/v3/users/3f2ea3ff88fb43fa9fc31fd7b17fdfd1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:45.467261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00e50-a790-4fd8-9bfc-a67801f1545f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:45.467762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00e50-a790-4fd8-9bfc-a67801f1545f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:45.467762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00e50-a790-4fd8-9bfc-a67801f1545f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:45.486783 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ecc00e50-a790-4fd8-9bfc-a67801f1545f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:45.487981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ecc00e50-a790-4fd8-9bfc-a67801f1545f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:45.564853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1266/2528] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:45.574068 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:45.575525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:45.637052 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721a57-ff0d-42a2-a220-3c70dc8bec3d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:45.641837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a0da0-621c-4c36-bf58-ab123c5400e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:45.642487 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a0da0-621c-4c36-bf58-ab123c5400e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:45.642948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a0da0-621c-4c36-bf58-ab123c5400e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:45.643209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a0da0-621c-4c36-bf58-ab123c5400e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:45.657195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a0da0-621c-4c36-bf58-ab123c5400e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:45.658741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a0da0-621c-4c36-bf58-ab123c5400e1 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:45.670179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1263/2529] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:45.998981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00e50-a790-4fd8-9bfc-a67801f1545f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:46.000824 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ecc00e50-a790-4fd8-9bfc-a67801f1545f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:46.052882 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00e50-a790-4fd8-9bfc-a67801f1545f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:46.068162 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:46.069075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:46.069425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:46.069821 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] PATH_INFO: `/v3/projects/752c741a91da46e89bd931213a4e2c5c` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:46.071170 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=752c741a91da46e89bd931213a4e2c5c)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:46.073235 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:46.124063 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:46.126128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752c741a91da46e89bd931213a4e2c5c', 'request_id': 'req-5bef21db-8255-4d47-ba44-c52e97f96f2e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.133532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752c741a91da46e89bd931213a4e2c5c', 'request_id': 'req-5bef21db-8255-4d47-ba44-c52e97f96f2e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.140487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752c741a91da46e89bd931213a4e2c5c', 'request_id': 'req-5bef21db-8255-4d47-ba44-c52e97f96f2e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.154327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] The token cache is being invalidate because project 752c741a91da46e89bd931213a4e2c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:30:46.154531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.155159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.159128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1267/2530] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:30:45 2022] DELETE /identity/v3/projects/752c741a91da46e89bd931213a4e2c5c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:46.163131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a0da0-621c-4c36-bf58-ab123c5400e1 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:46.173373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a0da0-621c-4c36-bf58-ab123c5400e1 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:46.240812 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0808dd-2f1f-4f30-a626-223eebafa4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:46.241572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0808dd-2f1f-4f30-a626-223eebafa4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:46.241973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0808dd-2f1f-4f30-a626-223eebafa4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:46.242108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0808dd-2f1f-4f30-a626-223eebafa4ec admin admin] PATH_INFO: `/v3/users/f5acea1130c44263aeeaed8b43ed603a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:46.243496 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0808dd-2f1f-4f30-a626-223eebafa4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5acea1130c44263aeeaed8b43ed603a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:46.245458 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0808dd-2f1f-4f30-a626-223eebafa4ec admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:46.297267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8f0808dd-2f1f-4f30-a626-223eebafa4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5acea1130c44263aeeaed8b43ed603a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.309849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8f0808dd-2f1f-4f30-a626-223eebafa4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5acea1130c44263aeeaed8b43ed603a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.310597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8f0808dd-2f1f-4f30-a626-223eebafa4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5acea1130c44263aeeaed8b43ed603a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.317440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8f0808dd-2f1f-4f30-a626-223eebafa4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5acea1130c44263aeeaed8b43ed603a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.326555 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8f0808dd-2f1f-4f30-a626-223eebafa4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5acea1130c44263aeeaed8b43ed603a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.333900 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1264/2531] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:30:46 2022] DELETE /identity/v3/users/f5acea1130c44263aeeaed8b43ed603a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:46.636323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:46.637851 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:46.651716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef21db-8255-4d47-ba44-c52e97f96f2e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:46.716698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51eca14-2b91-4a76-9b93-26c43af859de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:46.717458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eca14-2b91-4a76-9b93-26c43af859de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:46.717806 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eca14-2b91-4a76-9b93-26c43af859de admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:46.718145 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eca14-2b91-4a76-9b93-26c43af859de admin admin] PATH_INFO: `/v3/projects/0d8c89712f964f4a880d1e18e6308a9c` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:46.719457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51eca14-2b91-4a76-9b93-26c43af859de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8c89712f964f4a880d1e18e6308a9c)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:46.721452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51eca14-2b91-4a76-9b93-26c43af859de admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:46.772740 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a51eca14-2b91-4a76-9b93-26c43af859de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8c89712f964f4a880d1e18e6308a9c', 'request_id': 'req-a51eca14-2b91-4a76-9b93-26c43af859de'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.778719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a51eca14-2b91-4a76-9b93-26c43af859de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8c89712f964f4a880d1e18e6308a9c', 'request_id': 'req-a51eca14-2b91-4a76-9b93-26c43af859de'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.788616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a51eca14-2b91-4a76-9b93-26c43af859de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8c89712f964f4a880d1e18e6308a9c', 'request_id': 'req-a51eca14-2b91-4a76-9b93-26c43af859de'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.803195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a51eca14-2b91-4a76-9b93-26c43af859de admin admin] The token cache is being invalidate because project 0d8c89712f964f4a880d1e18e6308a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:30:46.803488 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a51eca14-2b91-4a76-9b93-26c43af859de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.804106 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a51eca14-2b91-4a76-9b93-26c43af859de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:46.805669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1268/2532] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:30:46 2022] DELETE /identity/v3/projects/0d8c89712f964f4a880d1e18e6308a9c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:46.810592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a49a8-ef09-4d23-92ed-b8e40c0ddd1f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:46.810875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a49a8-ef09-4d23-92ed-b8e40c0ddd1f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:46.811155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a49a8-ef09-4d23-92ed-b8e40c0ddd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:46.830633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ac3a49a8-ef09-4d23-92ed-b8e40c0ddd1f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:46.831777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ac3a49a8-ef09-4d23-92ed-b8e40c0ddd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:46.841423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:46.898117 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1265/2533] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:46.906635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edb88a-5d11-4e65-9252-9fb8bca66f0e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:46.906922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edb88a-5d11-4e65-9252-9fb8bca66f0e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:46.907197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edb88a-5d11-4e65-9252-9fb8bca66f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:46.928652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-92edb88a-5d11-4e65-9252-9fb8bca66f0e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:46.929940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-92edb88a-5d11-4e65-9252-9fb8bca66f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:46.939317 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1269/2534] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:46.943962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a49a8-ef09-4d23-92ed-b8e40c0ddd1f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:46.954798 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a49a8-ef09-4d23-92ed-b8e40c0ddd1f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:46.961508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f245d2c-ea79-4107-b5ef-29096ac78e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:46.962135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f245d2c-ea79-4107-b5ef-29096ac78e3c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:46.962381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f245d2c-ea79-4107-b5ef-29096ac78e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:46.962662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f245d2c-ea79-4107-b5ef-29096ac78e3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:46.963325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f245d2c-ea79-4107-b5ef-29096ac78e3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:30:46.963599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f245d2c-ea79-4107-b5ef-29096ac78e3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:46.965253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f245d2c-ea79-4107-b5ef-29096ac78e3c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:46.979305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1266/2535] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:30:46.982970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edb88a-5d11-4e65-9252-9fb8bca66f0e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:46.993387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edb88a-5d11-4e65-9252-9fb8bca66f0e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:47.000350 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c45227-c21e-4b89-99d6-7f244f71fe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:47.001043 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c45227-c21e-4b89-99d6-7f244f71fe9c admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.001329 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c45227-c21e-4b89-99d6-7f244f71fe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.001635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c45227-c21e-4b89-99d6-7f244f71fe9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.002312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c45227-c21e-4b89-99d6-7f244f71fe9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:47.004307 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c45227-c21e-4b89-99d6-7f244f71fe9c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:47.035814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1270/2536] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:30:46 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:47.040246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f245d2c-ea79-4107-b5ef-29096ac78e3c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:47.052882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f245d2c-ea79-4107-b5ef-29096ac78e3c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:47.119117 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60695537-2766-438c-8acb-a4416b2bf535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:47.121202 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60695537-2766-438c-8acb-a4416b2bf535 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.121671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60695537-2766-438c-8acb-a4416b2bf535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.122100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60695537-2766-438c-8acb-a4416b2bf535 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.123127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60695537-2766-438c-8acb-a4416b2bf535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:47.125373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60695537-2766-438c-8acb-a4416b2bf535 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:47.149749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1267/2537] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:30:47 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:30:47.154618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c45227-c21e-4b89-99d6-7f244f71fe9c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:47.169127 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c45227-c21e-4b89-99d6-7f244f71fe9c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:47.175850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128ea3-2c8e-464f-90ff-2ca9268adc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:47.176867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128ea3-2c8e-464f-90ff-2ca9268adc8e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.176867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128ea3-2c8e-464f-90ff-2ca9268adc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.177102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128ea3-2c8e-464f-90ff-2ca9268adc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.177678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128ea3-2c8e-464f-90ff-2ca9268adc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:47.179354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128ea3-2c8e-464f-90ff-2ca9268adc8e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:47.191891 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1271/2538] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:30:47.195956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60695537-2766-438c-8acb-a4416b2bf535 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:47.206675 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60695537-2766-438c-8acb-a4416b2bf535 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:47.211834 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883da40f-37da-47f3-b354-2326b2b8e2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:47.212546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883da40f-37da-47f3-b354-2326b2b8e2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.212955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883da40f-37da-47f3-b354-2326b2b8e2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.213236 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883da40f-37da-47f3-b354-2326b2b8e2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.213889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883da40f-37da-47f3-b354-2326b2b8e2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:47.215493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883da40f-37da-47f3-b354-2326b2b8e2fb admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:47.229497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1268/2539] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:47.230990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128ea3-2c8e-464f-90ff-2ca9268adc8e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:47.242623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128ea3-2c8e-464f-90ff-2ca9268adc8e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:47.247731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6673f7-6c8e-4dcd-8101-3a0495eed447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:47.248480 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6673f7-6c8e-4dcd-8101-3a0495eed447 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.248868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6673f7-6c8e-4dcd-8101-3a0495eed447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.249248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6673f7-6c8e-4dcd-8101-3a0495eed447 admin admin] PATH_INFO: `/v3/projects/6e08b10ce4a2446081777a1323cd7c87/users/400294ad17764528b90c07facf4a0b63/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.266953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6673f7-6c8e-4dcd-8101-3a0495eed447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e08b10ce4a2446081777a1323cd7c87, user_id=400294ad17764528b90c07facf4a0b63, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:47.269835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6673f7-6c8e-4dcd-8101-3a0495eed447 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:47.289641 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1272/2540] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:47 2022] PUT /identity/v3/projects/6e08b10ce4a2446081777a1323cd7c87/users/400294ad17764528b90c07facf4a0b63/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:47.302123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698178eb-9e3d-4595-8475-3a7ab4e75615 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.302923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698178eb-9e3d-4595-8475-3a7ab4e75615 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.302923 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698178eb-9e3d-4595-8475-3a7ab4e75615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.339546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-698178eb-9e3d-4595-8475-3a7ab4e75615 None None] MFA Rules not processed for user `400294ad17764528b90c07facf4a0b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:47.340855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-698178eb-9e3d-4595-8475-3a7ab4e75615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:47.420888 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1269/2541] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:47.422025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6673f7-6c8e-4dcd-8101-3a0495eed447 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:47.426628 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:47.516835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6673f7-6c8e-4dcd-8101-3a0495eed447 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:47.521439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24729926-c9b9-4cc6-8c83-a197f0118f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:47.522064 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24729926-c9b9-4cc6-8c83-a197f0118f12 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.522347 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24729926-c9b9-4cc6-8c83-a197f0118f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.522625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24729926-c9b9-4cc6-8c83-a197f0118f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.523269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24729926-c9b9-4cc6-8c83-a197f0118f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:47.525291 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24729926-c9b9-4cc6-8c83-a197f0118f12 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:47.556940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1273/2542] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:30:47 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:47.561141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698178eb-9e3d-4595-8475-3a7ab4e75615 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:47.572185 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698178eb-9e3d-4595-8475-3a7ab4e75615 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:47.580702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:47.635009 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3e0a2-5bc6-448d-8bb3-b08ec6c146ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:47.635641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3e0a2-5bc6-448d-8bb3-b08ec6c146ce admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.635924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3e0a2-5bc6-448d-8bb3-b08ec6c146ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.636210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3e0a2-5bc6-448d-8bb3-b08ec6c146ce admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.637213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3e0a2-5bc6-448d-8bb3-b08ec6c146ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:47.638858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3e0a2-5bc6-448d-8bb3-b08ec6c146ce admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:47.683771 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1270/2543] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:30:47 2022] POST /identity/v3/users => generated 300 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:47.687795 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24729926-c9b9-4cc6-8c83-a197f0118f12 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:47.698794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24729926-c9b9-4cc6-8c83-a197f0118f12 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:47.703584 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a3075-c678-4bd2-84d0-8b10d951f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:47.704193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a3075-c678-4bd2-84d0-8b10d951f3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.704473 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a3075-c678-4bd2-84d0-8b10d951f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.704771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a3075-c678-4bd2-84d0-8b10d951f3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.705421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a3075-c678-4bd2-84d0-8b10d951f3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:47.707077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a3075-c678-4bd2-84d0-8b10d951f3a3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:47.717730 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1274/2544] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:47.721937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3e0a2-5bc6-448d-8bb3-b08ec6c146ce admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:47.732499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3e0a2-5bc6-448d-8bb3-b08ec6c146ce admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:47.737203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e244e-2d41-4a01-8ed4-77613088dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:47.737887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e244e-2d41-4a01-8ed4-77613088dfe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.738169 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e244e-2d41-4a01-8ed4-77613088dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.738443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e244e-2d41-4a01-8ed4-77613088dfe5 admin admin] PATH_INFO: `/v3/projects/c450faec88c74b1790d17df419658e39/users/2f7474f60de345e2a7abb5b263353019/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.754737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e244e-2d41-4a01-8ed4-77613088dfe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c450faec88c74b1790d17df419658e39, user_id=2f7474f60de345e2a7abb5b263353019, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:47.757480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e244e-2d41-4a01-8ed4-77613088dfe5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:47.773072 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1271/2545] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:47 2022] PUT /identity/v3/projects/c450faec88c74b1790d17df419658e39/users/2f7474f60de345e2a7abb5b263353019/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:30:47.777038 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a3075-c678-4bd2-84d0-8b10d951f3a3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:47.788392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a3075-c678-4bd2-84d0-8b10d951f3a3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:47.847507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15430e3-1fbe-4a75-8617-43aff9d4bc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:47.848190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15430e3-1fbe-4a75-8617-43aff9d4bc42 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.848447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15430e3-1fbe-4a75-8617-43aff9d4bc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.848742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15430e3-1fbe-4a75-8617-43aff9d4bc42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.849371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15430e3-1fbe-4a75-8617-43aff9d4bc42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:47.851004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15430e3-1fbe-4a75-8617-43aff9d4bc42 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:47.861133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1275/2546] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:47.865546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e244e-2d41-4a01-8ed4-77613088dfe5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:47.876938 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e244e-2d41-4a01-8ed4-77613088dfe5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:47.882062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d11249-8805-4397-94d9-b5fecc45ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:47.882721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d11249-8805-4397-94d9-b5fecc45ecee admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.883007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d11249-8805-4397-94d9-b5fecc45ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.883286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d11249-8805-4397-94d9-b5fecc45ecee admin admin] PATH_INFO: `/v3/projects/c450faec88c74b1790d17df419658e39/users/2f7474f60de345e2a7abb5b263353019/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.885325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d11249-8805-4397-94d9-b5fecc45ecee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c450faec88c74b1790d17df419658e39, user_id=2f7474f60de345e2a7abb5b263353019, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:47.887964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d11249-8805-4397-94d9-b5fecc45ecee admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:47.899144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1272/2547] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:47 2022] PUT /identity/v3/projects/c450faec88c74b1790d17df419658e39/users/2f7474f60de345e2a7abb5b263353019/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:47.910240 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870d39f-c88d-4337-b21a-3582a65c3240 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:47.910523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870d39f-c88d-4337-b21a-3582a65c3240 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:47.910796 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870d39f-c88d-4337-b21a-3582a65c3240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:47.940066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f870d39f-c88d-4337-b21a-3582a65c3240 None None] MFA Rules not processed for user `2f7474f60de345e2a7abb5b263353019`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:47.941329 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f870d39f-c88d-4337-b21a-3582a65c3240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:48.007354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:48.015296 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1276/2548] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:30:48.026713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d11249-8805-4397-94d9-b5fecc45ecee admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:48.028486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c4d11249-8805-4397-94d9-b5fecc45ecee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:48.100605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d11249-8805-4397-94d9-b5fecc45ecee admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:48.104226 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52574-eed6-4bc1-8381-d979d95b2df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:48.104877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52574-eed6-4bc1-8381-d979d95b2df5 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:48.105156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52574-eed6-4bc1-8381-d979d95b2df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:48.105452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52574-eed6-4bc1-8381-d979d95b2df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:48.114438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52574-eed6-4bc1-8381-d979d95b2df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:48.115815 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52574-eed6-4bc1-8381-d979d95b2df5 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:48.125487 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1273/2549] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:30:48.785528 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870d39f-c88d-4337-b21a-3582a65c3240 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:48.858426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870d39f-c88d-4337-b21a-3582a65c3240 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:48.863238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:48.863878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:48.864156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:48.864428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] PATH_INFO: `/v3/users/400294ad17764528b90c07facf4a0b63` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:48.865609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=400294ad17764528b90c07facf4a0b63)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:48.867539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:48.916817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400294ad17764528b90c07facf4a0b63'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:48.917494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400294ad17764528b90c07facf4a0b63'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:48.926756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400294ad17764528b90c07facf4a0b63'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:48.934873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400294ad17764528b90c07facf4a0b63'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:48.935649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400294ad17764528b90c07facf4a0b63'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:48.955586 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1277/2550] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:30:48 2022] DELETE /identity/v3/users/400294ad17764528b90c07facf4a0b63 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:48.960466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680012-f58c-4178-b320-6994b66b61e0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:48.960970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680012-f58c-4178-b320-6994b66b61e0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:48.961065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680012-f58c-4178-b320-6994b66b61e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:48.981499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2c680012-f58c-4178-b320-6994b66b61e0 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:48.982906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2c680012-f58c-4178-b320-6994b66b61e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:49.060453 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1274/2551] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:49.070871 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:49.072513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:49.132014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc61ddc-b589-443b-a6a4-1d2c9a9ba769 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:49.136187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438ef66-71b1-40b2-8a38-0c1a444bed2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:49.136861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438ef66-71b1-40b2-8a38-0c1a444bed2f service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:49.137141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438ef66-71b1-40b2-8a38-0c1a444bed2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:49.137477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438ef66-71b1-40b2-8a38-0c1a444bed2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:49.147725 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438ef66-71b1-40b2-8a38-0c1a444bed2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:49.149361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438ef66-71b1-40b2-8a38-0c1a444bed2f service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:49.159752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1278/2552] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:30:49.464112 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c680012-f58c-4178-b320-6994b66b61e0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:49.465869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2c680012-f58c-4178-b320-6994b66b61e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:49.478260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c680012-f58c-4178-b320-6994b66b61e0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:49.483605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:49.484665 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:49.485361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:49.485796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] PATH_INFO: `/v3/projects/6e08b10ce4a2446081777a1323cd7c87` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:49.487218 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e08b10ce4a2446081777a1323cd7c87)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:49.489315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:49.490883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:49.557390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e08b10ce4a2446081777a1323cd7c87', 'request_id': 'req-f40f968c-c885-4119-b82e-c562f2435064'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:49.566300 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e08b10ce4a2446081777a1323cd7c87', 'request_id': 'req-f40f968c-c885-4119-b82e-c562f2435064'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:49.574765 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e08b10ce4a2446081777a1323cd7c87', 'request_id': 'req-f40f968c-c885-4119-b82e-c562f2435064'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:49.586691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] The token cache is being invalidate because project 6e08b10ce4a2446081777a1323cd7c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:30:49.586978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:49.587671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:49.589577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1275/2553] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:30:49 2022] DELETE /identity/v3/projects/6e08b10ce4a2446081777a1323cd7c87 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:49.593859 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438ef66-71b1-40b2-8a38-0c1a444bed2f service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:49.604345 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438ef66-71b1-40b2-8a38-0c1a444bed2f service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:49.621348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:49.674504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd9d95-065f-40bd-a919-cbb12ce2163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:49.675166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd9d95-065f-40bd-a919-cbb12ce2163c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:49.675448 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd9d95-065f-40bd-a919-cbb12ce2163c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:49.675722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd9d95-065f-40bd-a919-cbb12ce2163c admin admin] PATH_INFO: `/v3/users/2f7474f60de345e2a7abb5b263353019` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:49.676926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd9d95-065f-40bd-a919-cbb12ce2163c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7474f60de345e2a7abb5b263353019)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:49.678953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd9d95-065f-40bd-a919-cbb12ce2163c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:49.728004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-adcd9d95-065f-40bd-a919-cbb12ce2163c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7474f60de345e2a7abb5b263353019'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:49.728663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-adcd9d95-065f-40bd-a919-cbb12ce2163c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7474f60de345e2a7abb5b263353019'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:49.740754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-adcd9d95-065f-40bd-a919-cbb12ce2163c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7474f60de345e2a7abb5b263353019'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:49.748515 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-adcd9d95-065f-40bd-a919-cbb12ce2163c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7474f60de345e2a7abb5b263353019'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:49.749290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-adcd9d95-065f-40bd-a919-cbb12ce2163c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7474f60de345e2a7abb5b263353019'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:49.768634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1279/2554] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:30:49 2022] DELETE /identity/v3/users/2f7474f60de345e2a7abb5b263353019 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:50.226967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:50.228542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:50.243016 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f968c-c885-4119-b82e-c562f2435064 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:50.327049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c369d17-420d-40da-bccc-6b1876a021b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:50.327693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c369d17-420d-40da-bccc-6b1876a021b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:50.328003 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c369d17-420d-40da-bccc-6b1876a021b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:50.328279 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c369d17-420d-40da-bccc-6b1876a021b0 admin admin] PATH_INFO: `/v3/projects/c450faec88c74b1790d17df419658e39` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:50.329593 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c369d17-420d-40da-bccc-6b1876a021b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c450faec88c74b1790d17df419658e39)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:50.331581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c369d17-420d-40da-bccc-6b1876a021b0 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:50.379214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0c369d17-420d-40da-bccc-6b1876a021b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c450faec88c74b1790d17df419658e39', 'request_id': 'req-0c369d17-420d-40da-bccc-6b1876a021b0'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:50.386812 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0c369d17-420d-40da-bccc-6b1876a021b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c450faec88c74b1790d17df419658e39', 'request_id': 'req-0c369d17-420d-40da-bccc-6b1876a021b0'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:50.395257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0c369d17-420d-40da-bccc-6b1876a021b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c450faec88c74b1790d17df419658e39', 'request_id': 'req-0c369d17-420d-40da-bccc-6b1876a021b0'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:50.408786 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0c369d17-420d-40da-bccc-6b1876a021b0 admin admin] The token cache is being invalidate because project c450faec88c74b1790d17df419658e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:30:50.409078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0c369d17-420d-40da-bccc-6b1876a021b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:50.409759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0c369d17-420d-40da-bccc-6b1876a021b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:50.411268 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1276/2555] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:30:50 2022] DELETE /identity/v3/projects/c450faec88c74b1790d17df419658e39 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:30:50.418223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f528fa-76c5-4fb3-a96f-9c0d861ceffd None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:50.418726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f528fa-76c5-4fb3-a96f-9c0d861ceffd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:50.418814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f528fa-76c5-4fb3-a96f-9c0d861ceffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:50.439290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-06f528fa-76c5-4fb3-a96f-9c0d861ceffd None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:50.440911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-06f528fa-76c5-4fb3-a96f-9c0d861ceffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:50.510739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1280/2556] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:50.520225 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb44f7-b73e-4255-88ba-194dc4a71242 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:50.520509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb44f7-b73e-4255-88ba-194dc4a71242 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:50.520813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb44f7-b73e-4255-88ba-194dc4a71242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:50.543513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-bffb44f7-b73e-4255-88ba-194dc4a71242 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:50.544883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bffb44f7-b73e-4255-88ba-194dc4a71242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:50.553041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1277/2557] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:50.558004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f528fa-76c5-4fb3-a96f-9c0d861ceffd None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:50.568191 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f528fa-76c5-4fb3-a96f-9c0d861ceffd None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:50.574161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce04c2f-6a30-4c8c-a6fb-d72d69380de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:50.574959 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce04c2f-6a30-4c8c-a6fb-d72d69380de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:50.575475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce04c2f-6a30-4c8c-a6fb-d72d69380de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:50.575728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce04c2f-6a30-4c8c-a6fb-d72d69380de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:50.576752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce04c2f-6a30-4c8c-a6fb-d72d69380de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:30:50.577083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce04c2f-6a30-4c8c-a6fb-d72d69380de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:50.579019 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce04c2f-6a30-4c8c-a6fb-d72d69380de0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:50.592014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1281/2558] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:30:50.597011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb44f7-b73e-4255-88ba-194dc4a71242 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:50.607898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb44f7-b73e-4255-88ba-194dc4a71242 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:50.614515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc54297-6002-44ea-8cf0-4af1b6ac4073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:50.615238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc54297-6002-44ea-8cf0-4af1b6ac4073 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:50.615525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc54297-6002-44ea-8cf0-4af1b6ac4073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:50.615964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc54297-6002-44ea-8cf0-4af1b6ac4073 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:50.616687 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc54297-6002-44ea-8cf0-4af1b6ac4073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:50.618846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc54297-6002-44ea-8cf0-4af1b6ac4073 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:50.631278 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:50.650578 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1278/2559] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:30:50 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:50.654482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce04c2f-6a30-4c8c-a6fb-d72d69380de0 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:50.665146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce04c2f-6a30-4c8c-a6fb-d72d69380de0 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:50.690905 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:50.738779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d081d-f66e-4aa6-81f3-445c6eb83bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:50.739474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d081d-f66e-4aa6-81f3-445c6eb83bab admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:50.739815 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d081d-f66e-4aa6-81f3-445c6eb83bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:50.740143 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d081d-f66e-4aa6-81f3-445c6eb83bab admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:50.740881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d081d-f66e-4aa6-81f3-445c6eb83bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:50.742892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d081d-f66e-4aa6-81f3-445c6eb83bab admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:50.764677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1282/2560] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:30:50 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:30:50.768986 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc54297-6002-44ea-8cf0-4af1b6ac4073 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:50.780398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc54297-6002-44ea-8cf0-4af1b6ac4073 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:50.786027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b205b83-ca33-4811-b7e5-11bb39b4cd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:50.786886 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b205b83-ca33-4811-b7e5-11bb39b4cd9c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:50.787227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b205b83-ca33-4811-b7e5-11bb39b4cd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:50.787587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b205b83-ca33-4811-b7e5-11bb39b4cd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:50.788295 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b205b83-ca33-4811-b7e5-11bb39b4cd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:50.790061 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b205b83-ca33-4811-b7e5-11bb39b4cd9c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:50.801354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1279/2561] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:50.806287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d081d-f66e-4aa6-81f3-445c6eb83bab admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:50.817189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d081d-f66e-4aa6-81f3-445c6eb83bab admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:50.822031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b332c-6683-4880-9be6-5dc75466612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:50.822716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b332c-6683-4880-9be6-5dc75466612a admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:50.823056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b332c-6683-4880-9be6-5dc75466612a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:50.823417 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b332c-6683-4880-9be6-5dc75466612a admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:50.824810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b332c-6683-4880-9be6-5dc75466612a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:50.827021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b332c-6683-4880-9be6-5dc75466612a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:50.842199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1283/2562] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:30:50.843664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b205b83-ca33-4811-b7e5-11bb39b4cd9c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:50.854806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b205b83-ca33-4811-b7e5-11bb39b4cd9c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:50.863805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1f435-52d8-448b-917b-bbcdf4de14e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:50.869031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1f435-52d8-448b-917b-bbcdf4de14e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:50.869517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1f435-52d8-448b-917b-bbcdf4de14e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:50.869915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1f435-52d8-448b-917b-bbcdf4de14e7 admin admin] PATH_INFO: `/v3/projects/ca0f48a6e87344f581f937f4725b5bf3/users/0bd703e402864dea9d4ff5cd19b4e649/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:50.890434 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1f435-52d8-448b-917b-bbcdf4de14e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0f48a6e87344f581f937f4725b5bf3, user_id=0bd703e402864dea9d4ff5cd19b4e649, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:50.893691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1f435-52d8-448b-917b-bbcdf4de14e7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:50.914950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1280/2563] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:30:50 2022] PUT /identity/v3/projects/ca0f48a6e87344f581f937f4725b5bf3/users/0bd703e402864dea9d4ff5cd19b4e649/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:50.926131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5a674-00c6-4408-b1db-2b0eb375409a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:50.926789 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5a674-00c6-4408-b1db-2b0eb375409a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:50.927197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5a674-00c6-4408-b1db-2b0eb375409a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:50.983650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-33e5a674-00c6-4408-b1db-2b0eb375409a None None] MFA Rules not processed for user `0bd703e402864dea9d4ff5cd19b4e649`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:50.985249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-33e5a674-00c6-4408-b1db-2b0eb375409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:51.060337 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1284/2564] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:30:51.072170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1f435-52d8-448b-917b-bbcdf4de14e7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:51.073995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-17b1f435-52d8-448b-917b-bbcdf4de14e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:51.145850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1f435-52d8-448b-917b-bbcdf4de14e7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:51.150187 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695cfa0-a76b-4e5e-a318-245ce270ad9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:51.150958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695cfa0-a76b-4e5e-a318-245ce270ad9f service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:51.151440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695cfa0-a76b-4e5e-a318-245ce270ad9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:51.151686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695cfa0-a76b-4e5e-a318-245ce270ad9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:51.163129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695cfa0-a76b-4e5e-a318-245ce270ad9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:51.165027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695cfa0-a76b-4e5e-a318-245ce270ad9f service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:51.176543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1281/2565] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:51 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:57.547638 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5a674-00c6-4408-b1db-2b0eb375409a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:57.549194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-33e5a674-00c6-4408-b1db-2b0eb375409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:57.605642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5a674-00c6-4408-b1db-2b0eb375409a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:57.609664 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d08773-4cee-4d49-af1d-3bbd67aecfc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:57.610292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d08773-4cee-4d49-af1d-3bbd67aecfc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:57.610574 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d08773-4cee-4d49-af1d-3bbd67aecfc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:57.610847 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d08773-4cee-4d49-af1d-3bbd67aecfc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:57.612980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-17d08773-4cee-4d49-af1d-3bbd67aecfc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:57.663956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:57.680933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d08773-4cee-4d49-af1d-3bbd67aecfc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:57.682428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d08773-4cee-4d49-af1d-3bbd67aecfc1 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:57.692897 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1285/2566] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:30:59.478204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695cfa0-a76b-4e5e-a318-245ce270ad9f service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:59.497110 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695cfa0-a76b-4e5e-a318-245ce270ad9f service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:59.524617 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:59.525322 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:59.525615 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:59.525877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] PATH_INFO: `/v3/users/0bd703e402864dea9d4ff5cd19b4e649` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:59.527145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd703e402864dea9d4ff5cd19b4e649)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:59.529158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:59.628129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd703e402864dea9d4ff5cd19b4e649'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:59.643291 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd703e402864dea9d4ff5cd19b4e649'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:59.645648 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd703e402864dea9d4ff5cd19b4e649'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:59.672589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd703e402864dea9d4ff5cd19b4e649'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:59.684442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd703e402864dea9d4ff5cd19b4e649'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:30:59.701028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1282/2567] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:30:59 2022] DELETE /identity/v3/users/0bd703e402864dea9d4ff5cd19b4e649 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:30:59.701504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47a339-fa10-4c55-85a9-62c442ff25e4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:59.701978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47a339-fa10-4c55-85a9-62c442ff25e4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:59.702087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47a339-fa10-4c55-85a9-62c442ff25e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:59.726259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-eb47a339-fa10-4c55-85a9-62c442ff25e4 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:30:59.728293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-eb47a339-fa10-4c55-85a9-62c442ff25e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:59.860478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1286/2568] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:30:59.875058 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:30:59.876512 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:30:59.922455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:59.948662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135d34-07fa-428f-9c0f-f11d0de34bc4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:30:59.954918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a1cde-0b8d-46d6-a38d-d018c174c0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:30:59.955632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a1cde-0b8d-46d6-a38d-d018c174c0da service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:30:59.956119 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a1cde-0b8d-46d6-a38d-d018c174c0da service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:30:59.956947 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a1cde-0b8d-46d6-a38d-d018c174c0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:30:59.968122 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a1cde-0b8d-46d6-a38d-d018c174c0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:30:59.969645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a1cde-0b8d-46d6-a38d-d018c174c0da service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:30:59.980982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1283/2569] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:00.415326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47a339-fa10-4c55-85a9-62c442ff25e4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:00.416809 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-eb47a339-fa10-4c55-85a9-62c442ff25e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:00.429402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47a339-fa10-4c55-85a9-62c442ff25e4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:00.435316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:00.435316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:00.435316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:00.435316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] PATH_INFO: `/v3/projects/ca0f48a6e87344f581f937f4725b5bf3` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:00.436430 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0f48a6e87344f581f937f4725b5bf3)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:00.438478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:00.497451 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0f48a6e87344f581f937f4725b5bf3', 'request_id': 'req-5baaf76d-86e3-4889-875e-4b2aca39856f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:00.505591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0f48a6e87344f581f937f4725b5bf3', 'request_id': 'req-5baaf76d-86e3-4889-875e-4b2aca39856f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:00.513168 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0f48a6e87344f581f937f4725b5bf3', 'request_id': 'req-5baaf76d-86e3-4889-875e-4b2aca39856f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:00.530975 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] The token cache is being invalidate because project ca0f48a6e87344f581f937f4725b5bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:00.531372 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:00.532482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:00.534540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1287/2570] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:00 2022] DELETE /identity/v3/projects/ca0f48a6e87344f581f937f4725b5bf3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:02.799194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a1cde-0b8d-46d6-a38d-d018c174c0da service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:02.800926 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-295a1cde-0b8d-46d6-a38d-d018c174c0da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:02.898371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:02.905047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:02.918261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a1cde-0b8d-46d6-a38d-d018c174c0da service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:02.983704 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaf76d-86e3-4889-875e-4b2aca39856f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:02.991087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ed21c-2441-45a0-aedd-f7d7a3ebd302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:02.991932 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ed21c-2441-45a0-aedd-f7d7a3ebd302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:02.992209 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ed21c-2441-45a0-aedd-f7d7a3ebd302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:02.992491 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ed21c-2441-45a0-aedd-f7d7a3ebd302 admin admin] PATH_INFO: `/v3/users/cde02839effc4354a4fd7e82c1dc8e26` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:02.993694 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ed21c-2441-45a0-aedd-f7d7a3ebd302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde02839effc4354a4fd7e82c1dc8e26)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:02.995778 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ed21c-2441-45a0-aedd-f7d7a3ebd302 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:02.996246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f98ed-3de9-403c-9df9-37083620441b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9eef8921de43f18245f47559f3fa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:02.996917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f98ed-3de9-403c-9df9-37083620441b service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:02.997187 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f98ed-3de9-403c-9df9-37083620441b service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:02.997606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f98ed-3de9-403c-9df9-37083620441b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:02.999449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-594f98ed-3de9-403c-9df9-37083620441b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:03.011479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f98ed-3de9-403c-9df9-37083620441b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:03.013134 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f98ed-3de9-403c-9df9-37083620441b service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:03.018727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:03.025677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1284/2571] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:03.066982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fe7ed21c-2441-45a0-aedd-f7d7a3ebd302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde02839effc4354a4fd7e82c1dc8e26'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:03.067777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fe7ed21c-2441-45a0-aedd-f7d7a3ebd302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde02839effc4354a4fd7e82c1dc8e26'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:03.077040 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fe7ed21c-2441-45a0-aedd-f7d7a3ebd302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde02839effc4354a4fd7e82c1dc8e26'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:03.086274 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fe7ed21c-2441-45a0-aedd-f7d7a3ebd302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde02839effc4354a4fd7e82c1dc8e26'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:03.087049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fe7ed21c-2441-45a0-aedd-f7d7a3ebd302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde02839effc4354a4fd7e82c1dc8e26'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:03.104915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1288/2572] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:02 2022] DELETE /identity/v3/users/cde02839effc4354a4fd7e82c1dc8e26 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:03.290122 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f98ed-3de9-403c-9df9-37083620441b service placement] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:03.302517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f98ed-3de9-403c-9df9-37083620441b service placement] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:03.362521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00d910-d106-44ab-829f-92f3de7d0eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:03.363157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00d910-d106-44ab-829f-92f3de7d0eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:03.363438 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00d910-d106-44ab-829f-92f3de7d0eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:03.363709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00d910-d106-44ab-829f-92f3de7d0eae admin admin] PATH_INFO: `/v3/projects/4e1167fc380043c5b04a6746d715003a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:03.364925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00d910-d106-44ab-829f-92f3de7d0eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1167fc380043c5b04a6746d715003a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:03.366827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00d910-d106-44ab-829f-92f3de7d0eae admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:03.374880 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:03.419800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4b00d910-d106-44ab-829f-92f3de7d0eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1167fc380043c5b04a6746d715003a', 'request_id': 'req-4b00d910-d106-44ab-829f-92f3de7d0eae'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:03.428937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4b00d910-d106-44ab-829f-92f3de7d0eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1167fc380043c5b04a6746d715003a', 'request_id': 'req-4b00d910-d106-44ab-829f-92f3de7d0eae'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:03.435477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4b00d910-d106-44ab-829f-92f3de7d0eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1167fc380043c5b04a6746d715003a', 'request_id': 'req-4b00d910-d106-44ab-829f-92f3de7d0eae'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:03.447404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4b00d910-d106-44ab-829f-92f3de7d0eae admin admin] The token cache is being invalidate because project 4e1167fc380043c5b04a6746d715003a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:03.447699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4b00d910-d106-44ab-829f-92f3de7d0eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:03.448414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4b00d910-d106-44ab-829f-92f3de7d0eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:03.450326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1285/2573] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:03 2022] DELETE /identity/v3/projects/4e1167fc380043c5b04a6746d715003a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:03.455250 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34160-117f-43a1-a4ba-7b99c15466e9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:03.455587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34160-117f-43a1-a4ba-7b99c15466e9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:03.455816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34160-117f-43a1-a4ba-7b99c15466e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:03.478770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-12f34160-117f-43a1-a4ba-7b99c15466e9 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:03.480075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-12f34160-117f-43a1-a4ba-7b99c15466e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:03.568785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1289/2574] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:03.574232 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ecdd0-3600-4623-9da3-dd9fed50ae94 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:03.574752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ecdd0-3600-4623-9da3-dd9fed50ae94 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:03.575217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ecdd0-3600-4623-9da3-dd9fed50ae94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:03.599111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-780ecdd0-3600-4623-9da3-dd9fed50ae94 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:03.600380 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-780ecdd0-3600-4623-9da3-dd9fed50ae94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:03.608873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1286/2575] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:03.613354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f34160-117f-43a1-a4ba-7b99c15466e9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:03.624387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f34160-117f-43a1-a4ba-7b99c15466e9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:03.629672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9592657-f19a-4e47-ad2b-2704016466cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:03.630284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9592657-f19a-4e47-ad2b-2704016466cd admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:03.630558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9592657-f19a-4e47-ad2b-2704016466cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:03.630828 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9592657-f19a-4e47-ad2b-2704016466cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:03.631476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9592657-f19a-4e47-ad2b-2704016466cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:31:03.631853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9592657-f19a-4e47-ad2b-2704016466cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:03.633503 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9592657-f19a-4e47-ad2b-2704016466cd admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:03.649814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1290/2576] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:31:03.651201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ecdd0-3600-4623-9da3-dd9fed50ae94 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:03.664743 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ecdd0-3600-4623-9da3-dd9fed50ae94 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:03.670310 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bfc66-0feb-4ff2-ac46-e72916b7da23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:03.670859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bfc66-0feb-4ff2-ac46-e72916b7da23 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:03.671210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bfc66-0feb-4ff2-ac46-e72916b7da23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:03.671492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bfc66-0feb-4ff2-ac46-e72916b7da23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:03.672365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bfc66-0feb-4ff2-ac46-e72916b7da23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:03.674382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bfc66-0feb-4ff2-ac46-e72916b7da23 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:03.709036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1287/2577] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:03 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:31:03.710078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9592657-f19a-4e47-ad2b-2704016466cd admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:03.722561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9592657-f19a-4e47-ad2b-2704016466cd admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:03.781164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5715d-d91e-493f-b95b-1a34764ac869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:03.782173 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5715d-d91e-493f-b95b-1a34764ac869 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:03.782452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5715d-d91e-493f-b95b-1a34764ac869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:03.782720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5715d-d91e-493f-b95b-1a34764ac869 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:03.783350 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5715d-d91e-493f-b95b-1a34764ac869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:03.785322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5715d-d91e-493f-b95b-1a34764ac869 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:03.807865 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1291/2578] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:03 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:03.812229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bfc66-0feb-4ff2-ac46-e72916b7da23 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:03.823113 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bfc66-0feb-4ff2-ac46-e72916b7da23 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:03.828040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de854780-a628-4d71-97b9-024df89bcd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:03.828855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de854780-a628-4d71-97b9-024df89bcd9a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:03.829139 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de854780-a628-4d71-97b9-024df89bcd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:03.829409 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de854780-a628-4d71-97b9-024df89bcd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:03.830083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de854780-a628-4d71-97b9-024df89bcd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:03.831719 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de854780-a628-4d71-97b9-024df89bcd9a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:03.845242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1288/2579] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:03.848198 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5715d-d91e-493f-b95b-1a34764ac869 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:03.854843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:03.858966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5715d-d91e-493f-b95b-1a34764ac869 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:03.865410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd655ee-f154-4e7f-b1f1-48fe6c7e9282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:03.866030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd655ee-f154-4e7f-b1f1-48fe6c7e9282 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:03.866467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd655ee-f154-4e7f-b1f1-48fe6c7e9282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:03.866778 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd655ee-f154-4e7f-b1f1-48fe6c7e9282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:03.867613 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd655ee-f154-4e7f-b1f1-48fe6c7e9282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:03.869513 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd655ee-f154-4e7f-b1f1-48fe6c7e9282 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:03.881093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1292/2580] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:03.885401 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de854780-a628-4d71-97b9-024df89bcd9a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:03.896019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de854780-a628-4d71-97b9-024df89bcd9a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:03.901571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2180f5-f3ea-407c-89ea-53fc52442cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:03.902320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2180f5-f3ea-407c-89ea-53fc52442cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:03.902601 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2180f5-f3ea-407c-89ea-53fc52442cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:03.903010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2180f5-f3ea-407c-89ea-53fc52442cb9 admin admin] PATH_INFO: `/v3/projects/348cbae2c5274a509185611c7570e498/users/80cf1659e1264cd6872aaaadb388c242/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:03.926513 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2180f5-f3ea-407c-89ea-53fc52442cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348cbae2c5274a509185611c7570e498, user_id=80cf1659e1264cd6872aaaadb388c242, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:03.928144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2180f5-f3ea-407c-89ea-53fc52442cb9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:03.945167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1289/2581] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:03 2022] PUT /identity/v3/projects/348cbae2c5274a509185611c7570e498/users/80cf1659e1264cd6872aaaadb388c242/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:03.955569 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97312a1e-c2c9-4446-9973-b4479b64db13 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:03.956065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97312a1e-c2c9-4446-9973-b4479b64db13 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:03.956170 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97312a1e-c2c9-4446-9973-b4479b64db13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:03.991457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-97312a1e-c2c9-4446-9973-b4479b64db13 None None] MFA Rules not processed for user `80cf1659e1264cd6872aaaadb388c242`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:03.992834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-97312a1e-c2c9-4446-9973-b4479b64db13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:04.087475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1293/2582] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:04.100233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2180f5-f3ea-407c-89ea-53fc52442cb9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:04.102422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6a2180f5-f3ea-407c-89ea-53fc52442cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:04.202226 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2180f5-f3ea-407c-89ea-53fc52442cb9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:04.208452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd51aa-ad3b-43c1-a06f-b72b472b9a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:04.209102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd51aa-ad3b-43c1-a06f-b72b472b9a0f service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:04.209378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd51aa-ad3b-43c1-a06f-b72b472b9a0f service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:04.209649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd51aa-ad3b-43c1-a06f-b72b472b9a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:04.218580 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd51aa-ad3b-43c1-a06f-b72b472b9a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:04.219710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd51aa-ad3b-43c1-a06f-b72b472b9a0f service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:04.230305 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1290/2583] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:04.489473 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97312a1e-c2c9-4446-9973-b4479b64db13 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:04.572383 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97312a1e-c2c9-4446-9973-b4479b64db13 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:04.577536 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:04.578220 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:04.578503 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:04.578779 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] PATH_INFO: `/v3/users/80cf1659e1264cd6872aaaadb388c242` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:04.580057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80cf1659e1264cd6872aaaadb388c242)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:04.582797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:04.637773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80cf1659e1264cd6872aaaadb388c242'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:04.638427 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80cf1659e1264cd6872aaaadb388c242'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:04.647459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80cf1659e1264cd6872aaaadb388c242'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:04.656630 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80cf1659e1264cd6872aaaadb388c242'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:04.657425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80cf1659e1264cd6872aaaadb388c242'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:04.676164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1294/2584] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:04 2022] DELETE /identity/v3/users/80cf1659e1264cd6872aaaadb388c242 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:04.680916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591f99e-4386-4a17-8d73-233ae0bd50e3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:04.681173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591f99e-4386-4a17-8d73-233ae0bd50e3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:04.681435 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591f99e-4386-4a17-8d73-233ae0bd50e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:04.701166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f591f99e-4386-4a17-8d73-233ae0bd50e3 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:04.702384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f591f99e-4386-4a17-8d73-233ae0bd50e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:04.714624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:04.768111 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1291/2585] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:04.778905 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:04.780577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:04.787182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:04.851003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc29942-beaf-4680-979e-fc4d09552b36 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:04.854836 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3b4d1-c298-45bd-aaf1-26cecb02c55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:04.855556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3b4d1-c298-45bd-aaf1-26cecb02c55f service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:04.855862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3b4d1-c298-45bd-aaf1-26cecb02c55f service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:04.856105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3b4d1-c298-45bd-aaf1-26cecb02c55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:04.865801 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3b4d1-c298-45bd-aaf1-26cecb02c55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:04.867238 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3b4d1-c298-45bd-aaf1-26cecb02c55f service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:04.876653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1295/2586] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:05.160622 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591f99e-4386-4a17-8d73-233ae0bd50e3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:05.162339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f591f99e-4386-4a17-8d73-233ae0bd50e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:05.177924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591f99e-4386-4a17-8d73-233ae0bd50e3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:05.192424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293c5ac-dece-4c3d-9d81-0c267183e1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:05.193336 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293c5ac-dece-4c3d-9d81-0c267183e1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:05.194073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293c5ac-dece-4c3d-9d81-0c267183e1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:05.194588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293c5ac-dece-4c3d-9d81-0c267183e1ba admin admin] PATH_INFO: `/v3/projects/348cbae2c5274a509185611c7570e498` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:05.196239 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293c5ac-dece-4c3d-9d81-0c267183e1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=348cbae2c5274a509185611c7570e498)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:05.200794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293c5ac-dece-4c3d-9d81-0c267183e1ba admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:05.267175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a293c5ac-dece-4c3d-9d81-0c267183e1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348cbae2c5274a509185611c7570e498', 'request_id': 'req-a293c5ac-dece-4c3d-9d81-0c267183e1ba'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:05.277423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a293c5ac-dece-4c3d-9d81-0c267183e1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348cbae2c5274a509185611c7570e498', 'request_id': 'req-a293c5ac-dece-4c3d-9d81-0c267183e1ba'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:05.292140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a293c5ac-dece-4c3d-9d81-0c267183e1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348cbae2c5274a509185611c7570e498', 'request_id': 'req-a293c5ac-dece-4c3d-9d81-0c267183e1ba'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:05.305127 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a293c5ac-dece-4c3d-9d81-0c267183e1ba admin admin] The token cache is being invalidate because project 348cbae2c5274a509185611c7570e498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:05.305517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a293c5ac-dece-4c3d-9d81-0c267183e1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:05.306222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a293c5ac-dece-4c3d-9d81-0c267183e1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:05.307905 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1292/2587] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:05 2022] DELETE /identity/v3/projects/348cbae2c5274a509185611c7570e498 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:05.313215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b260c2-8c07-44ec-bed1-4674461fd3b8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:05.313705 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b260c2-8c07-44ec-bed1-4674461fd3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:05.313807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b260c2-8c07-44ec-bed1-4674461fd3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:05.470888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-50b260c2-8c07-44ec-bed1-4674461fd3b8 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:05.472189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-50b260c2-8c07-44ec-bed1-4674461fd3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:05.540398 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1296/2588] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:05.548815 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba93816-4623-4039-9e5b-a0fd331b4d30 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:05.549100 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba93816-4623-4039-9e5b-a0fd331b4d30 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:05.549431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba93816-4623-4039-9e5b-a0fd331b4d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:05.572837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3ba93816-4623-4039-9e5b-a0fd331b4d30 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:05.574374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3ba93816-4623-4039-9e5b-a0fd331b4d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:05.585276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1293/2589] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:05.590359 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b260c2-8c07-44ec-bed1-4674461fd3b8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:05.602182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b260c2-8c07-44ec-bed1-4674461fd3b8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:05.607197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e80fe9-4c9a-46fa-8b0d-931e9b6b44d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:05.607800 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e80fe9-4c9a-46fa-8b0d-931e9b6b44d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:05.608078 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e80fe9-4c9a-46fa-8b0d-931e9b6b44d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:05.608350 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e80fe9-4c9a-46fa-8b0d-931e9b6b44d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:05.609033 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e80fe9-4c9a-46fa-8b0d-931e9b6b44d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:31:05.609332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e80fe9-4c9a-46fa-8b0d-931e9b6b44d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:05.610951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e80fe9-4c9a-46fa-8b0d-931e9b6b44d5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:05.623125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1297/2590] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:31:05.627710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba93816-4623-4039-9e5b-a0fd331b4d30 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:05.637342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba93816-4623-4039-9e5b-a0fd331b4d30 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:05.643041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f3bc5-9929-4669-b6dc-cc313ab2623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:05.644131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f3bc5-9929-4669-b6dc-cc313ab2623d admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:05.644608 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f3bc5-9929-4669-b6dc-cc313ab2623d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:05.644922 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f3bc5-9929-4669-b6dc-cc313ab2623d admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:05.645565 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f3bc5-9929-4669-b6dc-cc313ab2623d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:05.647508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f3bc5-9929-4669-b6dc-cc313ab2623d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:05.678627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1294/2591] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:05 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:05.682992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e80fe9-4c9a-46fa-8b0d-931e9b6b44d5 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:05.693539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e80fe9-4c9a-46fa-8b0d-931e9b6b44d5 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:05.752663 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ccd3-9d92-4305-b49b-527bb8be480f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:05.753227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ccd3-9d92-4305-b49b-527bb8be480f admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:05.753509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ccd3-9d92-4305-b49b-527bb8be480f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:05.753783 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ccd3-9d92-4305-b49b-527bb8be480f admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:05.754415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754ccd3-9d92-4305-b49b-527bb8be480f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:05.756364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754ccd3-9d92-4305-b49b-527bb8be480f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:05.779642 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1298/2592] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:05 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:05.784349 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f3bc5-9929-4669-b6dc-cc313ab2623d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:05.794829 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f3bc5-9929-4669-b6dc-cc313ab2623d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:05.799716 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a0f04-ec61-4304-af1c-a71ec2fe1059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:05.800318 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a0f04-ec61-4304-af1c-a71ec2fe1059 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:05.800591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a0f04-ec61-4304-af1c-a71ec2fe1059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:05.801371 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a0f04-ec61-4304-af1c-a71ec2fe1059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:05.801564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a0f04-ec61-4304-af1c-a71ec2fe1059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:05.803140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a0f04-ec61-4304-af1c-a71ec2fe1059 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:05.814206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1295/2593] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:05.818794 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ccd3-9d92-4305-b49b-527bb8be480f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:05.829836 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ccd3-9d92-4305-b49b-527bb8be480f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:05.836467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27db19-c168-4864-b6b1-c7c60008f85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:05.837130 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27db19-c168-4864-b6b1-c7c60008f85c admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:05.837408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27db19-c168-4864-b6b1-c7c60008f85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:05.837679 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27db19-c168-4864-b6b1-c7c60008f85c admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:05.838323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27db19-c168-4864-b6b1-c7c60008f85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:05.839945 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27db19-c168-4864-b6b1-c7c60008f85c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:05.852255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1299/2594] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:05.855742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a0f04-ec61-4304-af1c-a71ec2fe1059 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:05.866020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a0f04-ec61-4304-af1c-a71ec2fe1059 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:05.871259 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbc75c-4175-4da2-b1b0-cc5b5b0f5863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:05.871952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbc75c-4175-4da2-b1b0-cc5b5b0f5863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:05.872227 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbc75c-4175-4da2-b1b0-cc5b5b0f5863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:05.872491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbc75c-4175-4da2-b1b0-cc5b5b0f5863 admin admin] PATH_INFO: `/v3/projects/af4642c9d1ab48f6aa08fafe6ca75284/users/545b06d16e5f4e16b2f969c712f5ef66/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:05.889411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbc75c-4175-4da2-b1b0-cc5b5b0f5863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4642c9d1ab48f6aa08fafe6ca75284, user_id=545b06d16e5f4e16b2f969c712f5ef66, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:05.892134 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbc75c-4175-4da2-b1b0-cc5b5b0f5863 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:05.905969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1296/2595] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:05 2022] PUT /identity/v3/projects/af4642c9d1ab48f6aa08fafe6ca75284/users/545b06d16e5f4e16b2f969c712f5ef66/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:05.918004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9986e9-cca7-46fa-9b22-1ec617e63c82 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:05.918308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9986e9-cca7-46fa-9b22-1ec617e63c82 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:05.918980 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9986e9-cca7-46fa-9b22-1ec617e63c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:05.940151 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:05.948426 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fe9986e9-cca7-46fa-9b22-1ec617e63c82 None None] MFA Rules not processed for user `545b06d16e5f4e16b2f969c712f5ef66`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:05.951119 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fe9986e9-cca7-46fa-9b22-1ec617e63c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:06.020952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1300/2596] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:06.025690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbc75c-4175-4da2-b1b0-cc5b5b0f5863 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:06.078516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:06.091810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbc75c-4175-4da2-b1b0-cc5b5b0f5863 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:06.097466 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddeb13-bf81-4f17-86a9-b8ce6bec6492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:06.098090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddeb13-bf81-4f17-86a9-b8ce6bec6492 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:06.098428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddeb13-bf81-4f17-86a9-b8ce6bec6492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:06.098700 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddeb13-bf81-4f17-86a9-b8ce6bec6492 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:06.099373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddeb13-bf81-4f17-86a9-b8ce6bec6492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:06.101356 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddeb13-bf81-4f17-86a9-b8ce6bec6492 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:06.129060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1297/2597] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:06 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:31:06.133355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9986e9-cca7-46fa-9b22-1ec617e63c82 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:06.144632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9986e9-cca7-46fa-9b22-1ec617e63c82 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:06.200245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded007-9ec1-4fa2-91f1-80c7c2e758dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:06.200889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded007-9ec1-4fa2-91f1-80c7c2e758dd admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:06.201166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded007-9ec1-4fa2-91f1-80c7c2e758dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:06.201433 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded007-9ec1-4fa2-91f1-80c7c2e758dd admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:06.202061 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ded007-9ec1-4fa2-91f1-80c7c2e758dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:06.204003 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ded007-9ec1-4fa2-91f1-80c7c2e758dd admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:06.228439 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1301/2598] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:06 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:31:06.232873 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddeb13-bf81-4f17-86a9-b8ce6bec6492 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:06.243224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddeb13-bf81-4f17-86a9-b8ce6bec6492 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:06.247776 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767b85a-f623-436e-a12b-e8b07fbb957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:06.248373 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b85a-f623-436e-a12b-e8b07fbb957d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:06.248668 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b85a-f623-436e-a12b-e8b07fbb957d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:06.248962 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b85a-f623-436e-a12b-e8b07fbb957d admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:06.249606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767b85a-f623-436e-a12b-e8b07fbb957d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:06.251273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767b85a-f623-436e-a12b-e8b07fbb957d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:06.261732 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1298/2599] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:06.266237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded007-9ec1-4fa2-91f1-80c7c2e758dd admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:06.276749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded007-9ec1-4fa2-91f1-80c7c2e758dd admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:06.282077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e88a34-7f00-423d-a4c2-1b1e89f5f87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:06.282753 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e88a34-7f00-423d-a4c2-1b1e89f5f87a admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:06.283033 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e88a34-7f00-423d-a4c2-1b1e89f5f87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:06.283304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e88a34-7f00-423d-a4c2-1b1e89f5f87a admin admin] PATH_INFO: `/v3/projects/09dff6e47364406b82ea1d0cb43f4060/users/59c7768100bb45739669ee47e60ba207/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:06.299962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e88a34-7f00-423d-a4c2-1b1e89f5f87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=09dff6e47364406b82ea1d0cb43f4060, user_id=59c7768100bb45739669ee47e60ba207, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:06.302741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e88a34-7f00-423d-a4c2-1b1e89f5f87a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:06.317483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1302/2600] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:06 2022] PUT /identity/v3/projects/09dff6e47364406b82ea1d0cb43f4060/users/59c7768100bb45739669ee47e60ba207/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:06.322150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767b85a-f623-436e-a12b-e8b07fbb957d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:06.337165 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767b85a-f623-436e-a12b-e8b07fbb957d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:06.394694 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c58f3-825f-4349-b8fa-bea9fec03143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:06.395303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c58f3-825f-4349-b8fa-bea9fec03143 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:06.395588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c58f3-825f-4349-b8fa-bea9fec03143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:06.395855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c58f3-825f-4349-b8fa-bea9fec03143 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:06.396490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c58f3-825f-4349-b8fa-bea9fec03143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:06.398140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c58f3-825f-4349-b8fa-bea9fec03143 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:06.408044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1299/2601] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:06.412403 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e88a34-7f00-423d-a4c2-1b1e89f5f87a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:06.422842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e88a34-7f00-423d-a4c2-1b1e89f5f87a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:06.427698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7944b5-4602-4294-98dc-9ce7aaee0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:06.428343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7944b5-4602-4294-98dc-9ce7aaee0d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:06.428621 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7944b5-4602-4294-98dc-9ce7aaee0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:06.429048 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7944b5-4602-4294-98dc-9ce7aaee0d19 admin admin] PATH_INFO: `/v3/projects/09dff6e47364406b82ea1d0cb43f4060/users/59c7768100bb45739669ee47e60ba207/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:06.431028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7944b5-4602-4294-98dc-9ce7aaee0d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09dff6e47364406b82ea1d0cb43f4060, user_id=59c7768100bb45739669ee47e60ba207, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:06.433710 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7944b5-4602-4294-98dc-9ce7aaee0d19 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:06.443866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1303/2602] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:06 2022] PUT /identity/v3/projects/09dff6e47364406b82ea1d0cb43f4060/users/59c7768100bb45739669ee47e60ba207/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:06.454141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37803c-b9e6-4617-9575-db1e799c6f97 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:06.454432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37803c-b9e6-4617-9575-db1e799c6f97 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:06.454713 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37803c-b9e6-4617-9575-db1e799c6f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:06.483179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3f37803c-b9e6-4617-9575-db1e799c6f97 None None] MFA Rules not processed for user `59c7768100bb45739669ee47e60ba207`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:06.484403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3f37803c-b9e6-4617-9575-db1e799c6f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:06.568787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1300/2603] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:06.579543 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7944b5-4602-4294-98dc-9ce7aaee0d19 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:06.581456 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6f7944b5-4602-4294-98dc-9ce7aaee0d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:06.596521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37803c-b9e6-4617-9575-db1e799c6f97 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:06.597952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3f37803c-b9e6-4617-9575-db1e799c6f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:06.633440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:06.641397 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7944b5-4602-4294-98dc-9ce7aaee0d19 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:06.645666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e431-22a9-4ee7-a1ca-0645acbaa5bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:06.646281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e431-22a9-4ee7-a1ca-0645acbaa5bd service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:06.646557 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e431-22a9-4ee7-a1ca-0645acbaa5bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:06.646829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e431-22a9-4ee7-a1ca-0645acbaa5bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:06.653868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:06.656591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37803c-b9e6-4617-9575-db1e799c6f97 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:06.656767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339e431-22a9-4ee7-a1ca-0645acbaa5bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:06.658909 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339e431-22a9-4ee7-a1ca-0645acbaa5bd service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:06.660915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4081450-2ea0-42d6-98a0-f5e790be8233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:06.661531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081450-2ea0-42d6-98a0-f5e790be8233 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:06.661810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081450-2ea0-42d6-98a0-f5e790be8233 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:06.662079 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081450-2ea0-42d6-98a0-f5e790be8233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:06.663813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d4081450-2ea0-42d6-98a0-f5e790be8233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:06.669180 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1304/2604] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:06.728318 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4081450-2ea0-42d6-98a0-f5e790be8233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:06.732528 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4081450-2ea0-42d6-98a0-f5e790be8233 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:06.739945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1301/2605] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:31:06.807940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e431-22a9-4ee7-a1ca-0645acbaa5bd service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:06.819093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e431-22a9-4ee7-a1ca-0645acbaa5bd service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:06.823977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:06.824667 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:06.825102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:06.825382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] PATH_INFO: `/v3/users/545b06d16e5f4e16b2f969c712f5ef66` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:06.826539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545b06d16e5f4e16b2f969c712f5ef66)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:06.828470 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:06.875835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545b06d16e5f4e16b2f969c712f5ef66'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:06.876736 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545b06d16e5f4e16b2f969c712f5ef66'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:06.885314 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545b06d16e5f4e16b2f969c712f5ef66'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:06.893166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545b06d16e5f4e16b2f969c712f5ef66'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:06.893929 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545b06d16e5f4e16b2f969c712f5ef66'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:06.911892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1305/2606] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:06 2022] DELETE /identity/v3/users/545b06d16e5f4e16b2f969c712f5ef66 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:06.916483 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb053e44-2797-4025-9cf0-240128437025 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:06.916800 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb053e44-2797-4025-9cf0-240128437025 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:06.917076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb053e44-2797-4025-9cf0-240128437025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:06.936469 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fb053e44-2797-4025-9cf0-240128437025 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:06.937829 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fb053e44-2797-4025-9cf0-240128437025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:06.998740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1302/2607] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:07.008422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:07.010023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:07.068233 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cc77d-e25f-4251-a29b-85d206b38e73 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:07.072021 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25b939-3bf0-42d4-8e71-96c37da084f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:07.072667 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b939-3bf0-42d4-8e71-96c37da084f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:07.072991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b939-3bf0-42d4-8e71-96c37da084f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:07.073263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b939-3bf0-42d4-8e71-96c37da084f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:07.082759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25b939-3bf0-42d4-8e71-96c37da084f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:07.084208 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25b939-3bf0-42d4-8e71-96c37da084f9 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:07.094927 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1306/2608] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:07.370548 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb053e44-2797-4025-9cf0-240128437025 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:07.372010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fb053e44-2797-4025-9cf0-240128437025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:07.385258 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb053e44-2797-4025-9cf0-240128437025 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:07.390718 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:07.392757 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:07.392997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:07.393266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] PATH_INFO: `/v3/projects/af4642c9d1ab48f6aa08fafe6ca75284` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:07.394451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4642c9d1ab48f6aa08fafe6ca75284)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:07.396936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:07.451542 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4642c9d1ab48f6aa08fafe6ca75284', 'request_id': 'req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:07.460964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4642c9d1ab48f6aa08fafe6ca75284', 'request_id': 'req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:07.467712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4642c9d1ab48f6aa08fafe6ca75284', 'request_id': 'req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:07.478663 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] The token cache is being invalidate because project af4642c9d1ab48f6aa08fafe6ca75284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:07.478957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:07.479626 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:07.481156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1303/2609] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:07 2022] DELETE /identity/v3/projects/af4642c9d1ab48f6aa08fafe6ca75284 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:07.485766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25b939-3bf0-42d4-8e71-96c37da084f9 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:07.495607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25b939-3bf0-42d4-8e71-96c37da084f9 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:07.564769 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3b909-ac9e-4dc5-a0e4-4755be33e812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:07.565311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3b909-ac9e-4dc5-a0e4-4755be33e812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:07.565591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3b909-ac9e-4dc5-a0e4-4755be33e812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:07.565892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3b909-ac9e-4dc5-a0e4-4755be33e812 admin admin] PATH_INFO: `/v3/users/59c7768100bb45739669ee47e60ba207` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:07.567064 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3b909-ac9e-4dc5-a0e4-4755be33e812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c7768100bb45739669ee47e60ba207)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:07.569198 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3b909-ac9e-4dc5-a0e4-4755be33e812 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:07.582026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:07.621027 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3bb3b909-ac9e-4dc5-a0e4-4755be33e812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c7768100bb45739669ee47e60ba207'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:07.621691 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3bb3b909-ac9e-4dc5-a0e4-4755be33e812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c7768100bb45739669ee47e60ba207'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:07.629785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3bb3b909-ac9e-4dc5-a0e4-4755be33e812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c7768100bb45739669ee47e60ba207'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:07.636922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3bb3b909-ac9e-4dc5-a0e4-4755be33e812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c7768100bb45739669ee47e60ba207'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:07.637595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3bb3b909-ac9e-4dc5-a0e4-4755be33e812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c7768100bb45739669ee47e60ba207'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:07.655205 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1307/2610] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:07 2022] DELETE /identity/v3/users/59c7768100bb45739669ee47e60ba207 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:07.940855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:07.942830 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:07.964547 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040ccfe-4a1d-4b4f-986e-e42bb9d8536c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:07.970677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:08.027928 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:08.028572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:08.028893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:08.029170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a admin admin] PATH_INFO: `/v3/projects/09dff6e47364406b82ea1d0cb43f4060` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:08.030296 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a admin admin] RBAC: Authorizing `identity:delete_project(project_id=09dff6e47364406b82ea1d0cb43f4060)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:08.032600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:08.082968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09dff6e47364406b82ea1d0cb43f4060', 'request_id': 'req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:08.091087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09dff6e47364406b82ea1d0cb43f4060', 'request_id': 'req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:08.097875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09dff6e47364406b82ea1d0cb43f4060', 'request_id': 'req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:08.108158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a admin admin] The token cache is being invalidate because project 09dff6e47364406b82ea1d0cb43f4060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:08.108447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:08.109102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-eb8b2ef0-7121-47e2-a0c4-c6bf3af0595a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:08.110653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1304/2611] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:07 2022] DELETE /identity/v3/projects/09dff6e47364406b82ea1d0cb43f4060 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:08.115842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935239ca-b6a3-484c-91fd-74db6df6ae86 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:08.116199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935239ca-b6a3-484c-91fd-74db6df6ae86 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:08.116541 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935239ca-b6a3-484c-91fd-74db6df6ae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:08.137189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-935239ca-b6a3-484c-91fd-74db6df6ae86 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:08.138544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-935239ca-b6a3-484c-91fd-74db6df6ae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:08.215985 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1308/2612] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:08.225329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da7804-3bc4-4051-93a3-d25f486858aa None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:08.225614 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da7804-3bc4-4051-93a3-d25f486858aa None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:08.225889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da7804-3bc4-4051-93a3-d25f486858aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:08.246572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-60da7804-3bc4-4051-93a3-d25f486858aa None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:08.247829 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-60da7804-3bc4-4051-93a3-d25f486858aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:08.256235 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1305/2613] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:08.260798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935239ca-b6a3-484c-91fd-74db6df6ae86 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:08.272577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935239ca-b6a3-484c-91fd-74db6df6ae86 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:08.277580 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ef9a0-f573-43fa-b8b1-32cefbbc5293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:08.278316 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ef9a0-f573-43fa-b8b1-32cefbbc5293 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:08.279371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ef9a0-f573-43fa-b8b1-32cefbbc5293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:08.279724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ef9a0-f573-43fa-b8b1-32cefbbc5293 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:08.280790 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ef9a0-f573-43fa-b8b1-32cefbbc5293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:31:08.281163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ef9a0-f573-43fa-b8b1-32cefbbc5293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:08.283637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ef9a0-f573-43fa-b8b1-32cefbbc5293 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:08.301457 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1309/2614] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:31:08.302804 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da7804-3bc4-4051-93a3-d25f486858aa None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:08.313428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da7804-3bc4-4051-93a3-d25f486858aa None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:08.318451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276b1bc-ef84-4215-888f-4a39721ec21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:08.319188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276b1bc-ef84-4215-888f-4a39721ec21f admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:08.319814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276b1bc-ef84-4215-888f-4a39721ec21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:08.319814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276b1bc-ef84-4215-888f-4a39721ec21f admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:08.320756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276b1bc-ef84-4215-888f-4a39721ec21f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:08.323194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276b1bc-ef84-4215-888f-4a39721ec21f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:08.362963 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1306/2615] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:08 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:08.364381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ef9a0-f573-43fa-b8b1-32cefbbc5293 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:08.379926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ef9a0-f573-43fa-b8b1-32cefbbc5293 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:08.454313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ce65f-6b86-4351-92dd-10a48f63ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:08.455249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ce65f-6b86-4351-92dd-10a48f63ee53 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:08.455422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ce65f-6b86-4351-92dd-10a48f63ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:08.455757 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ce65f-6b86-4351-92dd-10a48f63ee53 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:08.458072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ce65f-6b86-4351-92dd-10a48f63ee53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:08.458375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ce65f-6b86-4351-92dd-10a48f63ee53 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:08.492751 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1310/2616] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:08 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:08.493574 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276b1bc-ef84-4215-888f-4a39721ec21f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:08.508922 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276b1bc-ef84-4215-888f-4a39721ec21f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:08.525141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf645b2-b068-4fc2-9ffc-16fbed300744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:08.526074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf645b2-b068-4fc2-9ffc-16fbed300744 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:08.526808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf645b2-b068-4fc2-9ffc-16fbed300744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:08.527282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf645b2-b068-4fc2-9ffc-16fbed300744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:08.528176 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf645b2-b068-4fc2-9ffc-16fbed300744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:08.530628 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf645b2-b068-4fc2-9ffc-16fbed300744 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:08.545825 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1307/2617] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:08.549993 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ce65f-6b86-4351-92dd-10a48f63ee53 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:08.562837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ce65f-6b86-4351-92dd-10a48f63ee53 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:08.568664 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417df14b-cc59-4282-a673-2c97ab83bf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:08.569737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417df14b-cc59-4282-a673-2c97ab83bf21 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:08.570141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417df14b-cc59-4282-a673-2c97ab83bf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:08.570590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417df14b-cc59-4282-a673-2c97ab83bf21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:08.571435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417df14b-cc59-4282-a673-2c97ab83bf21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:08.573477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417df14b-cc59-4282-a673-2c97ab83bf21 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:08.575202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:08.587585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1311/2618] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:08.591955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf645b2-b068-4fc2-9ffc-16fbed300744 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:08.603092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf645b2-b068-4fc2-9ffc-16fbed300744 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:08.608135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f01819-5caf-4f89-be3e-297aa701a919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:08.608869 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f01819-5caf-4f89-be3e-297aa701a919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:08.609155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f01819-5caf-4f89-be3e-297aa701a919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:08.609433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f01819-5caf-4f89-be3e-297aa701a919 admin admin] PATH_INFO: `/v3/projects/184cb2514edc459eb61d20284950b843/users/0b31980dab234024ab08cad70ecfb2dd/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:08.632457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f01819-5caf-4f89-be3e-297aa701a919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184cb2514edc459eb61d20284950b843, user_id=0b31980dab234024ab08cad70ecfb2dd, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:08.635935 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f01819-5caf-4f89-be3e-297aa701a919 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:08.665756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1308/2619] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:08 2022] PUT /identity/v3/projects/184cb2514edc459eb61d20284950b843/users/0b31980dab234024ab08cad70ecfb2dd/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:08.667994 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ccf6f-fc92-4f89-ad22-90c2b0ab45c2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:08.668398 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ccf6f-fc92-4f89-ad22-90c2b0ab45c2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:08.668784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ccf6f-fc92-4f89-ad22-90c2b0ab45c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:08.699999 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-523ccf6f-fc92-4f89-ad22-90c2b0ab45c2 None None] MFA Rules not processed for user `0b31980dab234024ab08cad70ecfb2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:08.701405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-523ccf6f-fc92-4f89-ad22-90c2b0ab45c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:08.743571 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f01819-5caf-4f89-be3e-297aa701a919 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:08.746019 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-31f01819-5caf-4f89-be3e-297aa701a919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:08.798295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1312/2620] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:08.802918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:08.806251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ccf6f-fc92-4f89-ad22-90c2b0ab45c2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:08.848937 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f01819-5caf-4f89-be3e-297aa701a919 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:08.854638 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ea33d-6983-4529-80e8-f868a175ef57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:08.857036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ea33d-6983-4529-80e8-f868a175ef57 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:08.858428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ea33d-6983-4529-80e8-f868a175ef57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:08.860499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ea33d-6983-4529-80e8-f868a175ef57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:08.862811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0e3ea33d-6983-4529-80e8-f868a175ef57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:08.907467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ccf6f-fc92-4f89-ad22-90c2b0ab45c2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:08.914418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06812c9-2269-457e-86d6-0a0e7497ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:08.915304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06812c9-2269-457e-86d6-0a0e7497ff5c admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:08.915703 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06812c9-2269-457e-86d6-0a0e7497ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:08.915984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06812c9-2269-457e-86d6-0a0e7497ff5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:08.917400 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06812c9-2269-457e-86d6-0a0e7497ff5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:08.920556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06812c9-2269-457e-86d6-0a0e7497ff5c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:08.935472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ea33d-6983-4529-80e8-f868a175ef57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:08.937087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ea33d-6983-4529-80e8-f868a175ef57 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:08.947448 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1309/2621] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:08.966690 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1313/2622] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:08 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:08.970871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ea33d-6983-4529-80e8-f868a175ef57 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:08.983758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ea33d-6983-4529-80e8-f868a175ef57 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:09.061924 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815d2bf-f0dd-4b99-b467-73c72a724f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:09.062558 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815d2bf-f0dd-4b99-b467-73c72a724f14 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:09.062895 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815d2bf-f0dd-4b99-b467-73c72a724f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:09.063169 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815d2bf-f0dd-4b99-b467-73c72a724f14 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:09.063805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815d2bf-f0dd-4b99-b467-73c72a724f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:09.066581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815d2bf-f0dd-4b99-b467-73c72a724f14 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:09.097025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1310/2623] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:08 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:31:09.100415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06812c9-2269-457e-86d6-0a0e7497ff5c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:09.118633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06812c9-2269-457e-86d6-0a0e7497ff5c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:09.125804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f629bc-c4b3-4328-a594-a962a5b6034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:09.126786 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f629bc-c4b3-4328-a594-a962a5b6034a admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:09.127144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f629bc-c4b3-4328-a594-a962a5b6034a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:09.128071 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f629bc-c4b3-4328-a594-a962a5b6034a admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:09.129075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f629bc-c4b3-4328-a594-a962a5b6034a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:09.130862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f629bc-c4b3-4328-a594-a962a5b6034a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:09.146061 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1314/2624] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:09.150652 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815d2bf-f0dd-4b99-b467-73c72a724f14 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:09.161875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815d2bf-f0dd-4b99-b467-73c72a724f14 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:09.167250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209bde-eeb1-46d1-aa34-0b2e8cc6ec5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:09.171239 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209bde-eeb1-46d1-aa34-0b2e8cc6ec5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:09.171533 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209bde-eeb1-46d1-aa34-0b2e8cc6ec5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:09.171819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209bde-eeb1-46d1-aa34-0b2e8cc6ec5d admin admin] PATH_INFO: `/v3/projects/56a6132d539248acac240e62ab7d7e68/users/c0118f981b5544869963b279ff7c692c/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:09.206641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df209bde-eeb1-46d1-aa34-0b2e8cc6ec5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a6132d539248acac240e62ab7d7e68, user_id=c0118f981b5544869963b279ff7c692c, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:09.209691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df209bde-eeb1-46d1-aa34-0b2e8cc6ec5d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:09.233478 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1311/2625] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:09 2022] PUT /identity/v3/projects/56a6132d539248acac240e62ab7d7e68/users/c0118f981b5544869963b279ff7c692c/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:09.237743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f629bc-c4b3-4328-a594-a962a5b6034a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:09.248755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f629bc-c4b3-4328-a594-a962a5b6034a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:09.318888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98182b4e-e7ff-4e63-a0fa-45ac863a1b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:09.319506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98182b4e-e7ff-4e63-a0fa-45ac863a1b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:09.319780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98182b4e-e7ff-4e63-a0fa-45ac863a1b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:09.320047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98182b4e-e7ff-4e63-a0fa-45ac863a1b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:09.320687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98182b4e-e7ff-4e63-a0fa-45ac863a1b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:09.322346 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98182b4e-e7ff-4e63-a0fa-45ac863a1b91 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:09.323637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:09.334371 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1315/2626] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:09.338913 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209bde-eeb1-46d1-aa34-0b2e8cc6ec5d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:09.350180 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209bde-eeb1-46d1-aa34-0b2e8cc6ec5d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:09.354801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d75d7-eac5-4443-855d-7c5418a3c939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:09.355458 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d75d7-eac5-4443-855d-7c5418a3c939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:09.355769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d75d7-eac5-4443-855d-7c5418a3c939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:09.356135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d75d7-eac5-4443-855d-7c5418a3c939 admin admin] PATH_INFO: `/v3/projects/56a6132d539248acac240e62ab7d7e68/users/c0118f981b5544869963b279ff7c692c/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:09.358156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d75d7-eac5-4443-855d-7c5418a3c939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a6132d539248acac240e62ab7d7e68, user_id=c0118f981b5544869963b279ff7c692c, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:09.360885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d75d7-eac5-4443-855d-7c5418a3c939 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:09.372271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1312/2627] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:09 2022] PUT /identity/v3/projects/56a6132d539248acac240e62ab7d7e68/users/c0118f981b5544869963b279ff7c692c/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:09.382745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059c2ff-e614-4398-bf38-1c6a3f0f12d4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:09.383088 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059c2ff-e614-4398-bf38-1c6a3f0f12d4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:09.383311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059c2ff-e614-4398-bf38-1c6a3f0f12d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:09.413054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c059c2ff-e614-4398-bf38-1c6a3f0f12d4 None None] MFA Rules not processed for user `c0118f981b5544869963b279ff7c692c`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:09.414286 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c059c2ff-e614-4398-bf38-1c6a3f0f12d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:09.494950 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1316/2628] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:09.508022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d75d7-eac5-4443-855d-7c5418a3c939 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:09.563729 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:09.582017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d75d7-eac5-4443-855d-7c5418a3c939 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:09.586085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e958f5-1133-439e-aa20-0d7dc18017c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:09.586870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e958f5-1133-439e-aa20-0d7dc18017c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:09.587136 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e958f5-1133-439e-aa20-0d7dc18017c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:09.587471 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e958f5-1133-439e-aa20-0d7dc18017c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:09.597922 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e958f5-1133-439e-aa20-0d7dc18017c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:09.599375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e958f5-1133-439e-aa20-0d7dc18017c7 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:09.611926 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1313/2629] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:09.704607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059c2ff-e614-4398-bf38-1c6a3f0f12d4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:09.718784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059c2ff-e614-4398-bf38-1c6a3f0f12d4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:09.723050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481decb-55d9-4177-82b5-f0d02e8fb4b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:09.724102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481decb-55d9-4177-82b5-f0d02e8fb4b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:09.724102 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481decb-55d9-4177-82b5-f0d02e8fb4b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:09.724502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481decb-55d9-4177-82b5-f0d02e8fb4b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:09.812319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481decb-55d9-4177-82b5-f0d02e8fb4b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:09.814001 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481decb-55d9-4177-82b5-f0d02e8fb4b1 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:09.825033 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1317/2630] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:10.201998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e958f5-1133-439e-aa20-0d7dc18017c7 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:10.287764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e958f5-1133-439e-aa20-0d7dc18017c7 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:10.298978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67881e7-83c2-4295-9be8-313f85feee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:10.299624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67881e7-83c2-4295-9be8-313f85feee2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:10.299912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67881e7-83c2-4295-9be8-313f85feee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:10.300174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67881e7-83c2-4295-9be8-313f85feee2b admin admin] PATH_INFO: `/v3/users/0b31980dab234024ab08cad70ecfb2dd` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:10.301443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67881e7-83c2-4295-9be8-313f85feee2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b31980dab234024ab08cad70ecfb2dd)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:10.303475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67881e7-83c2-4295-9be8-313f85feee2b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:10.327066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481decb-55d9-4177-82b5-f0d02e8fb4b1 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:10.328664 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e481decb-55d9-4177-82b5-f0d02e8fb4b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:10.343301 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481decb-55d9-4177-82b5-f0d02e8fb4b1 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:10.347946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:10.348611 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:10.348936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:10.349208 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] PATH_INFO: `/v3/users/a1be02f9e7fd4bdabc05ec48e2a35f56` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:10.350343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1be02f9e7fd4bdabc05ec48e2a35f56)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:10.352305 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:10.363400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b67881e7-83c2-4295-9be8-313f85feee2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b31980dab234024ab08cad70ecfb2dd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.379051 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b67881e7-83c2-4295-9be8-313f85feee2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b31980dab234024ab08cad70ecfb2dd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.379758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b67881e7-83c2-4295-9be8-313f85feee2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b31980dab234024ab08cad70ecfb2dd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.386975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b67881e7-83c2-4295-9be8-313f85feee2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b31980dab234024ab08cad70ecfb2dd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.394445 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b67881e7-83c2-4295-9be8-313f85feee2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b31980dab234024ab08cad70ecfb2dd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.400262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1314/2631] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:10 2022] DELETE /identity/v3/users/0b31980dab234024ab08cad70ecfb2dd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:10.402269 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1be02f9e7fd4bdabc05ec48e2a35f56'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.402939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1be02f9e7fd4bdabc05ec48e2a35f56'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.404857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce44cf-d730-4381-bc16-cbb942546443 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:10.405145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce44cf-d730-4381-bc16-cbb942546443 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:10.405414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce44cf-d730-4381-bc16-cbb942546443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:10.412463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1be02f9e7fd4bdabc05ec48e2a35f56'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.421453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1be02f9e7fd4bdabc05ec48e2a35f56'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.422210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1be02f9e7fd4bdabc05ec48e2a35f56'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.426454 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-adce44cf-d730-4381-bc16-cbb942546443 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:10.427679 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-adce44cf-d730-4381-bc16-cbb942546443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:10.430479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:10.443597 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1318/2632] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:10 2022] DELETE /identity/v3/users/a1be02f9e7fd4bdabc05ec48e2a35f56 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:10.497856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1315/2633] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:10.510225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:10.512148 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:10.583560 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58980662-bfaa-4f0c-a400-1f7fb89ea7ed admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:10.587634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152558d-3042-45ed-b30c-f16b27193e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:10.588505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152558d-3042-45ed-b30c-f16b27193e62 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:10.589052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152558d-3042-45ed-b30c-f16b27193e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:10.589422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152558d-3042-45ed-b30c-f16b27193e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:10.641044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce44cf-d730-4381-bc16-cbb942546443 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:10.643125 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-adce44cf-d730-4381-bc16-cbb942546443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:10.651131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:10.661074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce44cf-d730-4381-bc16-cbb942546443 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:10.670045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e19ac7-b230-48b5-870e-951a366a136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:10.670395 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152558d-3042-45ed-b30c-f16b27193e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:10.671157 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19ac7-b230-48b5-870e-951a366a136d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:10.671264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19ac7-b230-48b5-870e-951a366a136d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:10.671537 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19ac7-b230-48b5-870e-951a366a136d admin admin] PATH_INFO: `/v3/projects/67f4fd75428040ab9ff8a0458e4708fb` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:10.671880 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152558d-3042-45ed-b30c-f16b27193e62 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:10.672855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e19ac7-b230-48b5-870e-951a366a136d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f4fd75428040ab9ff8a0458e4708fb)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:10.674862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e19ac7-b230-48b5-870e-951a366a136d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:10.682093 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1319/2634] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:31:10.726813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-63e19ac7-b230-48b5-870e-951a366a136d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f4fd75428040ab9ff8a0458e4708fb', 'request_id': 'req-63e19ac7-b230-48b5-870e-951a366a136d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.735665 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-63e19ac7-b230-48b5-870e-951a366a136d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f4fd75428040ab9ff8a0458e4708fb', 'request_id': 'req-63e19ac7-b230-48b5-870e-951a366a136d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.742060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-63e19ac7-b230-48b5-870e-951a366a136d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f4fd75428040ab9ff8a0458e4708fb', 'request_id': 'req-63e19ac7-b230-48b5-870e-951a366a136d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.753433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-63e19ac7-b230-48b5-870e-951a366a136d admin admin] The token cache is being invalidate because project 67f4fd75428040ab9ff8a0458e4708fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:10.753720 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-63e19ac7-b230-48b5-870e-951a366a136d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.754389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-63e19ac7-b230-48b5-870e-951a366a136d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:10.755930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1316/2635] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:10 2022] DELETE /identity/v3/projects/67f4fd75428040ab9ff8a0458e4708fb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:10.760846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d2cfd-c6be-4607-a838-7c5f5b5ea6dd None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:10.761132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d2cfd-c6be-4607-a838-7c5f5b5ea6dd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:10.761906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d2cfd-c6be-4607-a838-7c5f5b5ea6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:10.780898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8e9d2cfd-c6be-4607-a838-7c5f5b5ea6dd None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:10.782479 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8e9d2cfd-c6be-4607-a838-7c5f5b5ea6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:10.855767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1320/2636] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:10.864263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5904785-b02e-4bb8-bbbf-1542fda77165 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:10.864522 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5904785-b02e-4bb8-bbbf-1542fda77165 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:10.864870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5904785-b02e-4bb8-bbbf-1542fda77165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:10.884672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c5904785-b02e-4bb8-bbbf-1542fda77165 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:10.885919 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c5904785-b02e-4bb8-bbbf-1542fda77165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:10.894424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1317/2637] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:10.898702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d2cfd-c6be-4607-a838-7c5f5b5ea6dd None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:10.909158 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d2cfd-c6be-4607-a838-7c5f5b5ea6dd None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:10.914050 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6461f5-cd96-469f-878d-5930222e0f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:10.914648 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6461f5-cd96-469f-878d-5930222e0f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:10.914945 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6461f5-cd96-469f-878d-5930222e0f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:10.915224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6461f5-cd96-469f-878d-5930222e0f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:10.915880 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6461f5-cd96-469f-878d-5930222e0f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:31:10.916184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6461f5-cd96-469f-878d-5930222e0f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:10.917877 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6461f5-cd96-469f-878d-5930222e0f0c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:10.940947 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1321/2638] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:31:10.945531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5904785-b02e-4bb8-bbbf-1542fda77165 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:10.956156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5904785-b02e-4bb8-bbbf-1542fda77165 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:10.967970 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e18151-0fac-4d6b-9199-0ddb588d1d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:10.968612 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e18151-0fac-4d6b-9199-0ddb588d1d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:10.968945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e18151-0fac-4d6b-9199-0ddb588d1d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:10.969222 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e18151-0fac-4d6b-9199-0ddb588d1d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:10.970879 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6461f5-cd96-469f-878d-5930222e0f0c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:10.971381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e18151-0fac-4d6b-9199-0ddb588d1d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:10.972742 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cb6461f5-cd96-469f-878d-5930222e0f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:10.973348 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e18151-0fac-4d6b-9199-0ddb588d1d00 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:10.993033 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6461f5-cd96-469f-878d-5930222e0f0c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:10.999670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:11.000408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.000629 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.000949 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] PATH_INFO: `/v3/projects/184cb2514edc459eb61d20284950b843` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.002249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=184cb2514edc459eb61d20284950b843)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:11.004071 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:11.017457 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1318/2639] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:10 2022] POST /identity/v3/projects => generated 403 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:11.018558 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e18151-0fac-4d6b-9199-0ddb588d1d00 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:11.040332 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:11.069913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184cb2514edc459eb61d20284950b843', 'request_id': 'req-0baf71bb-8809-4fa5-a553-fbf554080fd8'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.076022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184cb2514edc459eb61d20284950b843', 'request_id': 'req-0baf71bb-8809-4fa5-a553-fbf554080fd8'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.084059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184cb2514edc459eb61d20284950b843', 'request_id': 'req-0baf71bb-8809-4fa5-a553-fbf554080fd8'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.093428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e18151-0fac-4d6b-9199-0ddb588d1d00 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:11.100109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] The token cache is being invalidate because project 184cb2514edc459eb61d20284950b843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:11.100476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.101291 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.103241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1322/2640] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:10 2022] DELETE /identity/v3/projects/184cb2514edc459eb61d20284950b843 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:11.107146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:11.108652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:11.163822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77037149-5f9e-468e-a026-3c5ca73d76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:11.164532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77037149-5f9e-468e-a026-3c5ca73d76a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.164977 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77037149-5f9e-468e-a026-3c5ca73d76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.165327 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77037149-5f9e-468e-a026-3c5ca73d76a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.166049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77037149-5f9e-468e-a026-3c5ca73d76a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:11.169006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77037149-5f9e-468e-a026-3c5ca73d76a1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:11.181058 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf71bb-8809-4fa5-a553-fbf554080fd8 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:11.181330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:11.187532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ba13b-6ba2-4977-9612-c5b19c02ad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:11.188394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba13b-6ba2-4977-9612-c5b19c02ad13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.188758 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba13b-6ba2-4977-9612-c5b19c02ad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.189081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba13b-6ba2-4977-9612-c5b19c02ad13 admin admin] PATH_INFO: `/v3/users/c0118f981b5544869963b279ff7c692c` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.190449 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ba13b-6ba2-4977-9612-c5b19c02ad13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0118f981b5544869963b279ff7c692c)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:11.192616 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ba13b-6ba2-4977-9612-c5b19c02ad13 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:11.197538 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1319/2641] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:11 2022] POST /identity/v3/users => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:31:11.201422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77037149-5f9e-468e-a026-3c5ca73d76a1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:11.203178 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-77037149-5f9e-468e-a026-3c5ca73d76a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:11.216237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77037149-5f9e-468e-a026-3c5ca73d76a1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:11.226314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311279a9-a5b8-498a-8637-321db4e2bc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:11.227005 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311279a9-a5b8-498a-8637-321db4e2bc60 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.227297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311279a9-a5b8-498a-8637-321db4e2bc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.228069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311279a9-a5b8-498a-8637-321db4e2bc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.228427 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311279a9-a5b8-498a-8637-321db4e2bc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:11.230437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311279a9-a5b8-498a-8637-321db4e2bc60 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:11.241758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1320/2642] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:11.246086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311279a9-a5b8-498a-8637-321db4e2bc60 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:11.259865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311279a9-a5b8-498a-8637-321db4e2bc60 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:11.261722 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-307ba13b-6ba2-4977-9612-c5b19c02ad13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0118f981b5544869963b279ff7c692c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.265737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-307ba13b-6ba2-4977-9612-c5b19c02ad13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0118f981b5544869963b279ff7c692c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.266140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51344de7-fe51-4753-8d78-e9a0d6fe35c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:11.266730 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51344de7-fe51-4753-8d78-e9a0d6fe35c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.267018 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51344de7-fe51-4753-8d78-e9a0d6fe35c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.267346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51344de7-fe51-4753-8d78-e9a0d6fe35c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.268221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51344de7-fe51-4753-8d78-e9a0d6fe35c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:11.270816 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51344de7-fe51-4753-8d78-e9a0d6fe35c3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:11.276678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-307ba13b-6ba2-4977-9612-c5b19c02ad13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0118f981b5544869963b279ff7c692c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.288280 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1321/2643] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:11.290450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-307ba13b-6ba2-4977-9612-c5b19c02ad13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0118f981b5544869963b279ff7c692c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.291202 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-307ba13b-6ba2-4977-9612-c5b19c02ad13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0118f981b5544869963b279ff7c692c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.298581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51344de7-fe51-4753-8d78-e9a0d6fe35c3 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:11.300420 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-51344de7-fe51-4753-8d78-e9a0d6fe35c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:11.313936 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51344de7-fe51-4753-8d78-e9a0d6fe35c3 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:11.316073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1323/2644] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:11 2022] DELETE /identity/v3/users/c0118f981b5544869963b279ff7c692c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:11.322541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dd5bb-8226-4ab4-88fe-d667a65a13ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:11.323422 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dd5bb-8226-4ab4-88fe-d667a65a13ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.323991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dd5bb-8226-4ab4-88fe-d667a65a13ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.323991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dd5bb-8226-4ab4-88fe-d667a65a13ed admin admin] PATH_INFO: `/v3/projects/4f7a6006a8e347a2b64d2b0925aaea25/users/ac762e15c66742eeb7c269d4346b849a/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.341257 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dd5bb-8226-4ab4-88fe-d667a65a13ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7a6006a8e347a2b64d2b0925aaea25, user_id=ac762e15c66742eeb7c269d4346b849a, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:11.343978 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dd5bb-8226-4ab4-88fe-d667a65a13ed admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:11.359854 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1322/2645] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:11 2022] PUT /identity/v3/projects/4f7a6006a8e347a2b64d2b0925aaea25/users/ac762e15c66742eeb7c269d4346b849a/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:11.365244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49d4b9-a0e8-4df5-af67-a7a5bb0ebc4f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.365676 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49d4b9-a0e8-4df5-af67-a7a5bb0ebc4f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.366195 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49d4b9-a0e8-4df5-af67-a7a5bb0ebc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.387519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2d49d4b9-a0e8-4df5-af67-a7a5bb0ebc4f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:11.389173 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2d49d4b9-a0e8-4df5-af67-a7a5bb0ebc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:11.418652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:11.462313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1324/2646] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:11.473108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dd5bb-8226-4ab4-88fe-d667a65a13ed admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:11.478502 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-401dd5bb-8226-4ab4-88fe-d667a65a13ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:11.548583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dd5bb-8226-4ab4-88fe-d667a65a13ed admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:11.553194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427b1b4-f489-423a-887f-78dd498c65e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:11.553811 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427b1b4-f489-423a-887f-78dd498c65e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.554088 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427b1b4-f489-423a-887f-78dd498c65e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.554357 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427b1b4-f489-423a-887f-78dd498c65e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.564560 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427b1b4-f489-423a-887f-78dd498c65e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:11.567803 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427b1b4-f489-423a-887f-78dd498c65e6 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:11.576415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1323/2647] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:11.653245 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49d4b9-a0e8-4df5-af67-a7a5bb0ebc4f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:11.655477 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2d49d4b9-a0e8-4df5-af67-a7a5bb0ebc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:11.669865 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49d4b9-a0e8-4df5-af67-a7a5bb0ebc4f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:11.675552 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6b72e-1a59-49fc-ac56-31fed85df05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:11.676237 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6b72e-1a59-49fc-ac56-31fed85df05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.676881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6b72e-1a59-49fc-ac56-31fed85df05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.676881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6b72e-1a59-49fc-ac56-31fed85df05b admin admin] PATH_INFO: `/v3/projects/56a6132d539248acac240e62ab7d7e68` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.678125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6b72e-1a59-49fc-ac56-31fed85df05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a6132d539248acac240e62ab7d7e68)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:11.680544 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6b72e-1a59-49fc-ac56-31fed85df05b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:11.735918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-71b6b72e-1a59-49fc-ac56-31fed85df05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a6132d539248acac240e62ab7d7e68', 'request_id': 'req-71b6b72e-1a59-49fc-ac56-31fed85df05b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.742171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-71b6b72e-1a59-49fc-ac56-31fed85df05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a6132d539248acac240e62ab7d7e68', 'request_id': 'req-71b6b72e-1a59-49fc-ac56-31fed85df05b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.748774 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-71b6b72e-1a59-49fc-ac56-31fed85df05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a6132d539248acac240e62ab7d7e68', 'request_id': 'req-71b6b72e-1a59-49fc-ac56-31fed85df05b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.763184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-71b6b72e-1a59-49fc-ac56-31fed85df05b admin admin] The token cache is being invalidate because project 56a6132d539248acac240e62ab7d7e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:11.763453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-71b6b72e-1a59-49fc-ac56-31fed85df05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.764374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-71b6b72e-1a59-49fc-ac56-31fed85df05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:11.766413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1325/2648] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:11 2022] DELETE /identity/v3/projects/56a6132d539248acac240e62ab7d7e68 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:11.771835 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449eb2fb-2168-451c-9da9-463e24b2d3f3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.772383 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449eb2fb-2168-451c-9da9-463e24b2d3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.772499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449eb2fb-2168-451c-9da9-463e24b2d3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.797450 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-449eb2fb-2168-451c-9da9-463e24b2d3f3 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:11.799038 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-449eb2fb-2168-451c-9da9-463e24b2d3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:11.861383 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1324/2649] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:11.870253 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440c0f6-27a0-482f-9702-c36d77b5cc96 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.870446 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440c0f6-27a0-482f-9702-c36d77b5cc96 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.870718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440c0f6-27a0-482f-9702-c36d77b5cc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.890698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7440c0f6-27a0-482f-9702-c36d77b5cc96 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:11.892068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7440c0f6-27a0-482f-9702-c36d77b5cc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:11.900121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1326/2650] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:11.904464 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449eb2fb-2168-451c-9da9-463e24b2d3f3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:11.915326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449eb2fb-2168-451c-9da9-463e24b2d3f3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:11.921078 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c1329-8154-49cf-80bc-ca29188c06a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:11.921689 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c1329-8154-49cf-80bc-ca29188c06a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.921968 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c1329-8154-49cf-80bc-ca29188c06a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.925364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c1329-8154-49cf-80bc-ca29188c06a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.925364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c1329-8154-49cf-80bc-ca29188c06a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:31:11.925364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c1329-8154-49cf-80bc-ca29188c06a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:11.925364 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c1329-8154-49cf-80bc-ca29188c06a4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:11.941499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1325/2651] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:31:11.949322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440c0f6-27a0-482f-9702-c36d77b5cc96 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:11.960514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440c0f6-27a0-482f-9702-c36d77b5cc96 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:11.965958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0fb67-828a-464d-8d2c-96df80792301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:11.966723 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0fb67-828a-464d-8d2c-96df80792301 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:11.967104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0fb67-828a-464d-8d2c-96df80792301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:11.967482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0fb67-828a-464d-8d2c-96df80792301 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:11.968223 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0fb67-828a-464d-8d2c-96df80792301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:11.970464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0fb67-828a-464d-8d2c-96df80792301 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:12.005180 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1327/2652] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:11 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:31:12.006365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c1329-8154-49cf-80bc-ca29188c06a4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:12.017805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c1329-8154-49cf-80bc-ca29188c06a4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:12.054191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:12.080077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b7676-a986-44c1-a428-33b95407bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:12.080695 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b7676-a986-44c1-a428-33b95407bd54 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.081012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b7676-a986-44c1-a428-33b95407bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.081288 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b7676-a986-44c1-a428-33b95407bd54 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.081940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b7676-a986-44c1-a428-33b95407bd54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:12.083884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b7676-a986-44c1-a428-33b95407bd54 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:12.108534 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1326/2653] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:12 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:12.113052 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0fb67-828a-464d-8d2c-96df80792301 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:12.123519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0fb67-828a-464d-8d2c-96df80792301 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:12.128554 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236b695-4f15-4ba8-a0e6-4c49210c6806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:12.129181 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236b695-4f15-4ba8-a0e6-4c49210c6806 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.129453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236b695-4f15-4ba8-a0e6-4c49210c6806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.129718 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236b695-4f15-4ba8-a0e6-4c49210c6806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.130382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236b695-4f15-4ba8-a0e6-4c49210c6806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:12.131977 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236b695-4f15-4ba8-a0e6-4c49210c6806 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:12.141827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1328/2654] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:12.146183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b7676-a986-44c1-a428-33b95407bd54 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:12.156814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b7676-a986-44c1-a428-33b95407bd54 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:12.162312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d57688-a027-4dd9-a638-9a3b95be2cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:12.162921 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d57688-a027-4dd9-a638-9a3b95be2cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.163202 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d57688-a027-4dd9-a638-9a3b95be2cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.163509 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d57688-a027-4dd9-a638-9a3b95be2cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.164160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d57688-a027-4dd9-a638-9a3b95be2cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:12.165799 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d57688-a027-4dd9-a638-9a3b95be2cb9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:12.176845 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1327/2655] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:12.181034 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236b695-4f15-4ba8-a0e6-4c49210c6806 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:12.192110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236b695-4f15-4ba8-a0e6-4c49210c6806 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:12.198753 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c5903-40dd-4636-babc-19716aaaa68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:12.199483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c5903-40dd-4636-babc-19716aaaa68a admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.199754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c5903-40dd-4636-babc-19716aaaa68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.200002 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c5903-40dd-4636-babc-19716aaaa68a admin admin] PATH_INFO: `/v3/projects/70b05e3b966c4304b97e86053946550a/users/758b3c5e65184cfcbf08394b71ee2744/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.221087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c5903-40dd-4636-babc-19716aaaa68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b05e3b966c4304b97e86053946550a, user_id=758b3c5e65184cfcbf08394b71ee2744, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:12.224939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c5903-40dd-4636-babc-19716aaaa68a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:12.242548 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1329/2656] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:12 2022] PUT /identity/v3/projects/70b05e3b966c4304b97e86053946550a/users/758b3c5e65184cfcbf08394b71ee2744/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:12.254144 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235db9c-f57a-46d8-85d8-c45ca0be7216 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.254437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235db9c-f57a-46d8-85d8-c45ca0be7216 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.254712 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235db9c-f57a-46d8-85d8-c45ca0be7216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.287445 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e699ca9-a483-4403-bf81-0e4af38c8eb0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.287857 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e699ca9-a483-4403-bf81-0e4af38c8eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.288429 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e699ca9-a483-4403-bf81-0e4af38c8eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.290564 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d235db9c-f57a-46d8-85d8-c45ca0be7216 None None] MFA Rules not processed for user `758b3c5e65184cfcbf08394b71ee2744`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:12.292523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d235db9c-f57a-46d8-85d8-c45ca0be7216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:12.351059 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7e699ca9-a483-4403-bf81-0e4af38c8eb0 None None] MFA Rules not processed for user `ac762e15c66742eeb7c269d4346b849a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:12.352276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7e699ca9-a483-4403-bf81-0e4af38c8eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:12.408521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1328/2657] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:12.414381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:12.419433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235db9c-f57a-46d8-85d8-c45ca0be7216 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:12.422197 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d235db9c-f57a-46d8-85d8-c45ca0be7216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:12.471180 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1330/2658] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:12 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:12.473509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e699ca9-a483-4403-bf81-0e4af38c8eb0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:12.481360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7e699ca9-a483-4403-bf81-0e4af38c8eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:12.537618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235db9c-f57a-46d8-85d8-c45ca0be7216 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:12.541732 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0492b-724a-4656-9572-094b6518b9d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:12.542527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0492b-724a-4656-9572-094b6518b9d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.543011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0492b-724a-4656-9572-094b6518b9d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.543741 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0492b-724a-4656-9572-094b6518b9d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.555588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0492b-724a-4656-9572-094b6518b9d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:12.557120 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0492b-724a-4656-9572-094b6518b9d7 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:12.568239 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1329/2659] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:12.568543 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e699ca9-a483-4403-bf81-0e4af38c8eb0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:12.573422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e71a16-9adc-4599-83ed-9bd63ecf32bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:12.574140 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71a16-9adc-4599-83ed-9bd63ecf32bc admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.574668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71a16-9adc-4599-83ed-9bd63ecf32bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.574771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71a16-9adc-4599-83ed-9bd63ecf32bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.575482 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e71a16-9adc-4599-83ed-9bd63ecf32bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:12.577690 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e71a16-9adc-4599-83ed-9bd63ecf32bc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:12.590204 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0492b-724a-4656-9572-094b6518b9d7 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:12.602036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0492b-724a-4656-9572-094b6518b9d7 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:12.607210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1993fe-10d7-4762-b20b-20182ad74b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:12.607860 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1993fe-10d7-4762-b20b-20182ad74b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.608137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1993fe-10d7-4762-b20b-20182ad74b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.608428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1993fe-10d7-4762-b20b-20182ad74b25 admin admin] PATH_INFO: `/v3/users/758b3c5e65184cfcbf08394b71ee2744` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.613489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1993fe-10d7-4762-b20b-20182ad74b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=758b3c5e65184cfcbf08394b71ee2744)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:12.615729 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1993fe-10d7-4762-b20b-20182ad74b25 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:12.619167 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1331/2660] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:12 2022] POST /identity/v3/projects => generated 401 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:12.623483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e71a16-9adc-4599-83ed-9bd63ecf32bc admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:12.670451 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:12.673808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4a1993fe-10d7-4762-b20b-20182ad74b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '758b3c5e65184cfcbf08394b71ee2744'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:12.688892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4a1993fe-10d7-4762-b20b-20182ad74b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '758b3c5e65184cfcbf08394b71ee2744'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:12.689731 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4a1993fe-10d7-4762-b20b-20182ad74b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '758b3c5e65184cfcbf08394b71ee2744'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:12.696005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e71a16-9adc-4599-83ed-9bd63ecf32bc admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:12.697660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4a1993fe-10d7-4762-b20b-20182ad74b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '758b3c5e65184cfcbf08394b71ee2744'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:12.702044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7eb81-119b-40eb-aa04-953593c30381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:12.702402 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7eb81-119b-40eb-aa04-953593c30381 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.702666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7eb81-119b-40eb-aa04-953593c30381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.702945 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7eb81-119b-40eb-aa04-953593c30381 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.703639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7eb81-119b-40eb-aa04-953593c30381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:12.705885 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7eb81-119b-40eb-aa04-953593c30381 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:12.706910 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4a1993fe-10d7-4762-b20b-20182ad74b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '758b3c5e65184cfcbf08394b71ee2744'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:12.713701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1330/2661] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:12 2022] DELETE /identity/v3/users/758b3c5e65184cfcbf08394b71ee2744 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:12.718743 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb7b76-648f-4782-a56c-f0dcf5ea906c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.719263 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb7b76-648f-4782-a56c-f0dcf5ea906c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.719644 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb7b76-648f-4782-a56c-f0dcf5ea906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.730151 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1332/2662] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:12 2022] POST /identity/v3/users => generated 307 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:31:12.733878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7eb81-119b-40eb-aa04-953593c30381 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:12.735828 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cdd7eb81-119b-40eb-aa04-953593c30381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:12.741154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-84bb7b76-648f-4782-a56c-f0dcf5ea906c None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:12.742500 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-84bb7b76-648f-4782-a56c-f0dcf5ea906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:12.750267 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7eb81-119b-40eb-aa04-953593c30381 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:12.815062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1331/2663] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:12.824562 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb7b76-648f-4782-a56c-f0dcf5ea906c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:12.826202 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-84bb7b76-648f-4782-a56c-f0dcf5ea906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:12.826889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:12.841338 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297f1fa-1b06-45b0-bb26-c96c59766e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:12.842285 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297f1fa-1b06-45b0-bb26-c96c59766e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.843161 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297f1fa-1b06-45b0-bb26-c96c59766e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.843572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297f1fa-1b06-45b0-bb26-c96c59766e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.844494 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297f1fa-1b06-45b0-bb26-c96c59766e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:12.846507 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297f1fa-1b06-45b0-bb26-c96c59766e0b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:12.865565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1333/2664] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:12.866498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297f1fa-1b06-45b0-bb26-c96c59766e0b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:12.878192 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297f1fa-1b06-45b0-bb26-c96c59766e0b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:12.884822 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251930f-bc13-468c-bd95-2ede77fe1ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:12.885488 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251930f-bc13-468c-bd95-2ede77fe1ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.885781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251930f-bc13-468c-bd95-2ede77fe1ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.886118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251930f-bc13-468c-bd95-2ede77fe1ba8 admin admin] PATH_INFO: `/v3/projects/50f1160ec0d14b5d9aabd0005af51690/users/e20f8502b435445798ddc59b5910cb82/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.898840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb7b76-648f-4782-a56c-f0dcf5ea906c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:12.902312 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251930f-bc13-468c-bd95-2ede77fe1ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f1160ec0d14b5d9aabd0005af51690, user_id=e20f8502b435445798ddc59b5910cb82, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:12.902551 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615dcd5-29de-47b6-b4b1-1293905f3434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:12.903879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615dcd5-29de-47b6-b4b1-1293905f3434 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.903879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615dcd5-29de-47b6-b4b1-1293905f3434 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.904108 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615dcd5-29de-47b6-b4b1-1293905f3434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.905326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251930f-bc13-468c-bd95-2ede77fe1ba8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:12.913709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615dcd5-29de-47b6-b4b1-1293905f3434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:12.915138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615dcd5-29de-47b6-b4b1-1293905f3434 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:12.919674 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1334/2665] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:12 2022] PUT /identity/v3/projects/50f1160ec0d14b5d9aabd0005af51690/users/e20f8502b435445798ddc59b5910cb82/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:12.923526 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251930f-bc13-468c-bd95-2ede77fe1ba8 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:12.925818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1332/2666] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:31:12.988670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251930f-bc13-468c-bd95-2ede77fe1ba8 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:12.993944 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c806906-5e94-48f6-abf1-9f800ea35216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:12.994556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c806906-5e94-48f6-abf1-9f800ea35216 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:12.994834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c806906-5e94-48f6-abf1-9f800ea35216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:12.995113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c806906-5e94-48f6-abf1-9f800ea35216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:12.995759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c806906-5e94-48f6-abf1-9f800ea35216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:12.997768 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c806906-5e94-48f6-abf1-9f800ea35216 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:13.008049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1335/2667] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:13.012426 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615dcd5-29de-47b6-b4b1-1293905f3434 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:13.022754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615dcd5-29de-47b6-b4b1-1293905f3434 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:13.027912 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00571752-8645-46c5-98aa-17ae5e2627ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:13.028569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571752-8645-46c5-98aa-17ae5e2627ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:13.028881 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571752-8645-46c5-98aa-17ae5e2627ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:13.029152 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571752-8645-46c5-98aa-17ae5e2627ce admin admin] PATH_INFO: `/v3/projects/50f1160ec0d14b5d9aabd0005af51690/users/e20f8502b435445798ddc59b5910cb82/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:13.031083 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00571752-8645-46c5-98aa-17ae5e2627ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f1160ec0d14b5d9aabd0005af51690, user_id=e20f8502b435445798ddc59b5910cb82, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:13.034129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00571752-8645-46c5-98aa-17ae5e2627ce admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:13.044649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1333/2668] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:13 2022] PUT /identity/v3/projects/50f1160ec0d14b5d9aabd0005af51690/users/e20f8502b435445798ddc59b5910cb82/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:13.194858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c806906-5e94-48f6-abf1-9f800ea35216 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:13.196766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6c806906-5e94-48f6-abf1-9f800ea35216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:13.211230 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c806906-5e94-48f6-abf1-9f800ea35216 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:13.286115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4760a-dcb1-4314-9399-fa2d343ff95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:13.286862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4760a-dcb1-4314-9399-fa2d343ff95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:13.287190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4760a-dcb1-4314-9399-fa2d343ff95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:13.287498 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4760a-dcb1-4314-9399-fa2d343ff95f admin admin] PATH_INFO: `/v3/projects/70b05e3b966c4304b97e86053946550a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:13.288943 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4760a-dcb1-4314-9399-fa2d343ff95f admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b05e3b966c4304b97e86053946550a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:13.291273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4760a-dcb1-4314-9399-fa2d343ff95f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:13.345624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-39c4760a-dcb1-4314-9399-fa2d343ff95f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b05e3b966c4304b97e86053946550a', 'request_id': 'req-39c4760a-dcb1-4314-9399-fa2d343ff95f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:13.351926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-39c4760a-dcb1-4314-9399-fa2d343ff95f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b05e3b966c4304b97e86053946550a', 'request_id': 'req-39c4760a-dcb1-4314-9399-fa2d343ff95f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:13.361829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-39c4760a-dcb1-4314-9399-fa2d343ff95f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b05e3b966c4304b97e86053946550a', 'request_id': 'req-39c4760a-dcb1-4314-9399-fa2d343ff95f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:13.365673 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:13.387075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-39c4760a-dcb1-4314-9399-fa2d343ff95f admin admin] The token cache is being invalidate because project 70b05e3b966c4304b97e86053946550a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:13.387374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-39c4760a-dcb1-4314-9399-fa2d343ff95f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:13.388026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-39c4760a-dcb1-4314-9399-fa2d343ff95f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:13.389910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1336/2669] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:13 2022] DELETE /identity/v3/projects/70b05e3b966c4304b97e86053946550a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:13.395173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d44c3b-333f-435e-958c-5f0396a2f9b3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:13.395464 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d44c3b-333f-435e-958c-5f0396a2f9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:13.395737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d44c3b-333f-435e-958c-5f0396a2f9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:13.417864 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-83d44c3b-333f-435e-958c-5f0396a2f9b3 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:13.419092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-83d44c3b-333f-435e-958c-5f0396a2f9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:13.469337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:13.487195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1334/2670] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:13.495264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad225d-93ac-4342-9c4a-a25cc0141f4a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:13.495551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad225d-93ac-4342-9c4a-a25cc0141f4a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:13.495830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad225d-93ac-4342-9c4a-a25cc0141f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:13.517275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1dad225d-93ac-4342-9c4a-a25cc0141f4a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:13.518886 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1dad225d-93ac-4342-9c4a-a25cc0141f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:13.528757 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1337/2671] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:13.533814 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d44c3b-333f-435e-958c-5f0396a2f9b3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:13.546728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d44c3b-333f-435e-958c-5f0396a2f9b3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:13.552042 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f784a6-9d26-4baf-accc-9761ef3a0a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:13.552727 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f784a6-9d26-4baf-accc-9761ef3a0a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:13.553158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f784a6-9d26-4baf-accc-9761ef3a0a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:13.553440 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f784a6-9d26-4baf-accc-9761ef3a0a70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:13.554093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f784a6-9d26-4baf-accc-9761ef3a0a70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:31:13.554400 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f784a6-9d26-4baf-accc-9761ef3a0a70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:13.556063 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f784a6-9d26-4baf-accc-9761ef3a0a70 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:13.573384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1335/2672] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:31:13.578007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad225d-93ac-4342-9c4a-a25cc0141f4a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:13.587987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad225d-93ac-4342-9c4a-a25cc0141f4a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:13.593061 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82182da-f532-4e16-a8f1-41e293869981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:13.593653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82182da-f532-4e16-a8f1-41e293869981 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:13.594095 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82182da-f532-4e16-a8f1-41e293869981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:13.594401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82182da-f532-4e16-a8f1-41e293869981 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:13.595066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82182da-f532-4e16-a8f1-41e293869981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:13.597024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82182da-f532-4e16-a8f1-41e293869981 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:13.627654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1338/2673] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:13 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:13.631828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f784a6-9d26-4baf-accc-9761ef3a0a70 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:13.642979 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f784a6-9d26-4baf-accc-9761ef3a0a70 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:13.704684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04e959-f692-4e96-aeca-d4b18341af1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:13.705341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04e959-f692-4e96-aeca-d4b18341af1f admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:13.705633 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04e959-f692-4e96-aeca-d4b18341af1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:13.705908 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04e959-f692-4e96-aeca-d4b18341af1f admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:13.706546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04e959-f692-4e96-aeca-d4b18341af1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:13.708529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04e959-f692-4e96-aeca-d4b18341af1f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:13.733879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1336/2674] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:13 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:13.738066 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82182da-f532-4e16-a8f1-41e293869981 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:13.748914 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82182da-f532-4e16-a8f1-41e293869981 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:13.754054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607744c8-80be-4023-b53b-92a65f0ae2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:13.754670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607744c8-80be-4023-b53b-92a65f0ae2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:13.754931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607744c8-80be-4023-b53b-92a65f0ae2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:13.755187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607744c8-80be-4023-b53b-92a65f0ae2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:13.755890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607744c8-80be-4023-b53b-92a65f0ae2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:13.757586 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607744c8-80be-4023-b53b-92a65f0ae2e0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:13.771351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1339/2675] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:13.772605 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04e959-f692-4e96-aeca-d4b18341af1f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:13.787756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04e959-f692-4e96-aeca-d4b18341af1f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:13.799065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7450e-5d32-402d-a467-4af0f010caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:13.799858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7450e-5d32-402d-a467-4af0f010caa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:13.800198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7450e-5d32-402d-a467-4af0f010caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:13.800545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7450e-5d32-402d-a467-4af0f010caa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:13.801316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7450e-5d32-402d-a467-4af0f010caa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:13.803028 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7450e-5d32-402d-a467-4af0f010caa7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:13.814942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1337/2676] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:13.823318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607744c8-80be-4023-b53b-92a65f0ae2e0 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:13.824691 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a23e-2912-4e99-89c1-d587a7b2d757 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:13.825238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a23e-2912-4e99-89c1-d587a7b2d757 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:13.825238 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a23e-2912-4e99-89c1-d587a7b2d757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:13.833839 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607744c8-80be-4023-b53b-92a65f0ae2e0 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:13.839637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48ee96-8362-439b-8e42-44d895276b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:13.840327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48ee96-8362-439b-8e42-44d895276b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:13.840635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48ee96-8362-439b-8e42-44d895276b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:13.840961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48ee96-8362-439b-8e42-44d895276b32 admin admin] PATH_INFO: `/v3/projects/88826e3d7ee84ed6a92a80e27216da95/users/f6c4519283d248bab4d6f12eee2258ae/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:13.857282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1060a23e-2912-4e99-89c1-d587a7b2d757 None None] MFA Rules not processed for user `e20f8502b435445798ddc59b5910cb82`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:13.857542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48ee96-8362-439b-8e42-44d895276b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88826e3d7ee84ed6a92a80e27216da95, user_id=f6c4519283d248bab4d6f12eee2258ae, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:13.859247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1060a23e-2912-4e99-89c1-d587a7b2d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:13.861341 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48ee96-8362-439b-8e42-44d895276b32 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:13.881302 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1340/2677] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:13 2022] PUT /identity/v3/projects/88826e3d7ee84ed6a92a80e27216da95/users/f6c4519283d248bab4d6f12eee2258ae/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:13.902244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf0b17-432a-437b-88c1-408fa1c8b9d9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:13.902527 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf0b17-432a-437b-88c1-408fa1c8b9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:13.902804 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf0b17-432a-437b-88c1-408fa1c8b9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:13.934083 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7ebf0b17-432a-437b-88c1-408fa1c8b9d9 None None] MFA Rules not processed for user `f6c4519283d248bab4d6f12eee2258ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:13.935318 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7ebf0b17-432a-437b-88c1-408fa1c8b9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:13.959744 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1338/2678] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:13 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:14.009385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1341/2679] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:14.022960 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a23e-2912-4e99-89c1-d587a7b2d757 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:14.024573 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1060a23e-2912-4e99-89c1-d587a7b2d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:14.074344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:14.086817 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a23e-2912-4e99-89c1-d587a7b2d757 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:14.137073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009dbbf-b465-48ab-916b-6a73454290c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:14.137693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009dbbf-b465-48ab-916b-6a73454290c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:14.137975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009dbbf-b465-48ab-916b-6a73454290c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:14.138254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009dbbf-b465-48ab-916b-6a73454290c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:14.147233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009dbbf-b465-48ab-916b-6a73454290c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:14.148676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009dbbf-b465-48ab-916b-6a73454290c3 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:14.158341 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1339/2680] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:31:15.156026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf0b17-432a-437b-88c1-408fa1c8b9d9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:15.157954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7ebf0b17-432a-437b-88c1-408fa1c8b9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:15.227962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf0b17-432a-437b-88c1-408fa1c8b9d9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:15.232987 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:15.233631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:15.233911 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:15.234183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] PATH_INFO: `/v3/users/ac762e15c66742eeb7c269d4346b849a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:15.235508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac762e15c66742eeb7c269d4346b849a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:15.237557 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:15.261476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:15.296491 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac762e15c66742eeb7c269d4346b849a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.297082 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac762e15c66742eeb7c269d4346b849a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.313281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac762e15c66742eeb7c269d4346b849a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.320521 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac762e15c66742eeb7c269d4346b849a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.321263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac762e15c66742eeb7c269d4346b849a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.342186 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1342/2681] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:15 2022] DELETE /identity/v3/users/ac762e15c66742eeb7c269d4346b849a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:15.537312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009dbbf-b465-48ab-916b-6a73454290c3 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:15.556242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009dbbf-b465-48ab-916b-6a73454290c3 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:15.617981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:15.618607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:15.618881 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:15.619152 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] PATH_INFO: `/v3/projects/4f7a6006a8e347a2b64d2b0925aaea25` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:15.620255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7a6006a8e347a2b64d2b0925aaea25)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:15.622208 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:15.671541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7a6006a8e347a2b64d2b0925aaea25', 'request_id': 'req-f3610e51-f1ad-436b-b986-7ef152094a70'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.680850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7a6006a8e347a2b64d2b0925aaea25', 'request_id': 'req-f3610e51-f1ad-436b-b986-7ef152094a70'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.688429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7a6006a8e347a2b64d2b0925aaea25', 'request_id': 'req-f3610e51-f1ad-436b-b986-7ef152094a70'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.701769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] The token cache is being invalidate because project 4f7a6006a8e347a2b64d2b0925aaea25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:15.702134 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.702849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.704582 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1340/2682] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:15 2022] DELETE /identity/v3/projects/4f7a6006a8e347a2b64d2b0925aaea25 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:15.708539 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:15.710194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:15.723892 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998cccc-d7a9-4f46-881c-b931cbdeafc0 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:15.797174 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20852ad-8b9d-4977-80a7-4a2383844b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:15.797962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20852ad-8b9d-4977-80a7-4a2383844b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:15.798179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20852ad-8b9d-4977-80a7-4a2383844b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:15.798449 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20852ad-8b9d-4977-80a7-4a2383844b22 admin admin] PATH_INFO: `/v3/users/e20f8502b435445798ddc59b5910cb82` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:15.799665 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20852ad-8b9d-4977-80a7-4a2383844b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20f8502b435445798ddc59b5910cb82)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:15.802155 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20852ad-8b9d-4977-80a7-4a2383844b22 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:15.855866 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b20852ad-8b9d-4977-80a7-4a2383844b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20f8502b435445798ddc59b5910cb82'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.856898 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b20852ad-8b9d-4977-80a7-4a2383844b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20f8502b435445798ddc59b5910cb82'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.866276 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b20852ad-8b9d-4977-80a7-4a2383844b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20f8502b435445798ddc59b5910cb82'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.874736 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b20852ad-8b9d-4977-80a7-4a2383844b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20f8502b435445798ddc59b5910cb82'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.875637 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b20852ad-8b9d-4977-80a7-4a2383844b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20f8502b435445798ddc59b5910cb82'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:15.897754 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1343/2683] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:15 2022] DELETE /identity/v3/users/e20f8502b435445798ddc59b5910cb82 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:16.091740 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:16.093295 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:16.107631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888dd0a-28a7-4079-95c8-6f2a2be1e9d4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:16.107933 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888dd0a-28a7-4079-95c8-6f2a2be1e9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:16.108177 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888dd0a-28a7-4079-95c8-6f2a2be1e9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:16.113915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3610e51-f1ad-436b-b986-7ef152094a70 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:16.131763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c888dd0a-28a7-4079-95c8-6f2a2be1e9d4 None None] MFA Rules not processed for user `deb80cf02c84476182960a91d69b6da1`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:16.133354 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c888dd0a-28a7-4079-95c8-6f2a2be1e9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:16.165988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:16.175421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:16.220261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eec175-ad34-4a98-b35d-15636eb14ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:16.221154 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eec175-ad34-4a98-b35d-15636eb14ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:16.221503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eec175-ad34-4a98-b35d-15636eb14ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:16.222017 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eec175-ad34-4a98-b35d-15636eb14ebb admin admin] PATH_INFO: `/v3/projects/50f1160ec0d14b5d9aabd0005af51690` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:16.223241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eec175-ad34-4a98-b35d-15636eb14ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f1160ec0d14b5d9aabd0005af51690)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:16.225473 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eec175-ad34-4a98-b35d-15636eb14ebb admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:16.228255 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1344/2684] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:16.317073 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-80eec175-ad34-4a98-b35d-15636eb14ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f1160ec0d14b5d9aabd0005af51690', 'request_id': 'req-80eec175-ad34-4a98-b35d-15636eb14ebb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:16.330822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-80eec175-ad34-4a98-b35d-15636eb14ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f1160ec0d14b5d9aabd0005af51690', 'request_id': 'req-80eec175-ad34-4a98-b35d-15636eb14ebb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:16.337415 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-80eec175-ad34-4a98-b35d-15636eb14ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f1160ec0d14b5d9aabd0005af51690', 'request_id': 'req-80eec175-ad34-4a98-b35d-15636eb14ebb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:16.348071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-80eec175-ad34-4a98-b35d-15636eb14ebb admin admin] The token cache is being invalidate because project 50f1160ec0d14b5d9aabd0005af51690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:16.348361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-80eec175-ad34-4a98-b35d-15636eb14ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:16.349037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-80eec175-ad34-4a98-b35d-15636eb14ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:16.350588 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1341/2685] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:16 2022] DELETE /identity/v3/projects/50f1160ec0d14b5d9aabd0005af51690 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:16.355817 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091e53b-8e5d-41a8-a5c5-f92ea4d72314 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:16.356214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091e53b-8e5d-41a8-a5c5-f92ea4d72314 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:16.356493 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091e53b-8e5d-41a8-a5c5-f92ea4d72314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:16.376795 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0091e53b-8e5d-41a8-a5c5-f92ea4d72314 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:16.378027 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0091e53b-8e5d-41a8-a5c5-f92ea4d72314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:16.447073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1345/2686] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:16.455412 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a25e16-c8fc-40ec-a224-ab5b2d3cc6d2 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:16.455719 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a25e16-c8fc-40ec-a224-ab5b2d3cc6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:16.456086 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a25e16-c8fc-40ec-a224-ab5b2d3cc6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:16.479546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-70a25e16-c8fc-40ec-a224-ab5b2d3cc6d2 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:16.480878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-70a25e16-c8fc-40ec-a224-ab5b2d3cc6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:16.490372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1342/2687] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:16.494922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091e53b-8e5d-41a8-a5c5-f92ea4d72314 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:16.510534 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091e53b-8e5d-41a8-a5c5-f92ea4d72314 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:16.515355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37f4ae-6b03-4c91-bd35-c44b60200c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:16.516968 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37f4ae-6b03-4c91-bd35-c44b60200c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:16.517431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37f4ae-6b03-4c91-bd35-c44b60200c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:16.517681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37f4ae-6b03-4c91-bd35-c44b60200c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:16.518518 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37f4ae-6b03-4c91-bd35-c44b60200c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:31:16.518967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37f4ae-6b03-4c91-bd35-c44b60200c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:16.521013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37f4ae-6b03-4c91-bd35-c44b60200c0e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:16.533951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1346/2688] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:31:16.538722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a25e16-c8fc-40ec-a224-ab5b2d3cc6d2 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:16.548266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a25e16-c8fc-40ec-a224-ab5b2d3cc6d2 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:16.553181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f02f1-a674-40ca-82d2-bfc7972ecfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:16.553824 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f02f1-a674-40ca-82d2-bfc7972ecfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:16.554105 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f02f1-a674-40ca-82d2-bfc7972ecfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:16.554437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f02f1-a674-40ca-82d2-bfc7972ecfd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:16.555033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f02f1-a674-40ca-82d2-bfc7972ecfd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:16.557047 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f02f1-a674-40ca-82d2-bfc7972ecfd8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:16.589027 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1343/2689] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:16 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:16.590136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37f4ae-6b03-4c91-bd35-c44b60200c0e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:16.600497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37f4ae-6b03-4c91-bd35-c44b60200c0e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:16.657881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ea9f6-cf5d-4c0b-9593-e9397d539541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:16.658504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ea9f6-cf5d-4c0b-9593-e9397d539541 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:16.658781 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ea9f6-cf5d-4c0b-9593-e9397d539541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:16.659051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ea9f6-cf5d-4c0b-9593-e9397d539541 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:16.659705 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ea9f6-cf5d-4c0b-9593-e9397d539541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:16.661720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ea9f6-cf5d-4c0b-9593-e9397d539541 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:16.684904 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1347/2690] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:16 2022] POST /identity/v3/users => generated 279 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:16.689161 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f02f1-a674-40ca-82d2-bfc7972ecfd8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:16.699916 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f02f1-a674-40ca-82d2-bfc7972ecfd8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:16.704775 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe5567-a565-4a2d-88a3-bc997c31e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:16.705395 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe5567-a565-4a2d-88a3-bc997c31e77d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:16.705680 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe5567-a565-4a2d-88a3-bc997c31e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:16.705952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe5567-a565-4a2d-88a3-bc997c31e77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:16.706598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe5567-a565-4a2d-88a3-bc997c31e77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:16.708215 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe5567-a565-4a2d-88a3-bc997c31e77d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:16.718563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1344/2691] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:16.723024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ea9f6-cf5d-4c0b-9593-e9397d539541 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:16.733622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ea9f6-cf5d-4c0b-9593-e9397d539541 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:16.738545 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514790c-a38e-4fec-8621-c217512e69ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:16.739184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514790c-a38e-4fec-8621-c217512e69ba admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:16.739505 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514790c-a38e-4fec-8621-c217512e69ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:16.739784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514790c-a38e-4fec-8621-c217512e69ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:16.740438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514790c-a38e-4fec-8621-c217512e69ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:16.742117 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514790c-a38e-4fec-8621-c217512e69ba admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:16.753785 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1348/2692] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:16.757932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe5567-a565-4a2d-88a3-bc997c31e77d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:16.768964 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe5567-a565-4a2d-88a3-bc997c31e77d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:16.774621 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0ffe6-c241-4ab5-a0fb-3cace2e66b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:16.775361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0ffe6-c241-4ab5-a0fb-3cace2e66b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:16.775641 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0ffe6-c241-4ab5-a0fb-3cace2e66b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:16.775915 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0ffe6-c241-4ab5-a0fb-3cace2e66b85 admin admin] PATH_INFO: `/v3/projects/9c68ee103aec4bdf9f1fac1e5ac685c2/users/e2ac919113b04e51aafb1f99adbd9dfc/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:16.792939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0ffe6-c241-4ab5-a0fb-3cace2e66b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c68ee103aec4bdf9f1fac1e5ac685c2, user_id=e2ac919113b04e51aafb1f99adbd9dfc, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:16.795648 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0ffe6-c241-4ab5-a0fb-3cace2e66b85 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:16.811714 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1345/2693] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:16 2022] PUT /identity/v3/projects/9c68ee103aec4bdf9f1fac1e5ac685c2/users/e2ac919113b04e51aafb1f99adbd9dfc/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:16.823687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb717d36-5850-4dc8-b7a5-03a828fb7fea None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:16.823991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb717d36-5850-4dc8-b7a5-03a828fb7fea None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:16.824259 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb717d36-5850-4dc8-b7a5-03a828fb7fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:16.856005 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-cb717d36-5850-4dc8-b7a5-03a828fb7fea None None] MFA Rules not processed for user `e2ac919113b04e51aafb1f99adbd9dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:16.857436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cb717d36-5850-4dc8-b7a5-03a828fb7fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:16.877311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:16.931736 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1349/2694] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:16.936317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0ffe6-c241-4ab5-a0fb-3cace2e66b85 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:16.995393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:16.999702 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0ffe6-c241-4ab5-a0fb-3cace2e66b85 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:17.006203 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73593db9-49e4-41ff-a1e7-e6e16776f483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:17.006853 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73593db9-49e4-41ff-a1e7-e6e16776f483 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:17.007140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73593db9-49e4-41ff-a1e7-e6e16776f483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:17.007418 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73593db9-49e4-41ff-a1e7-e6e16776f483 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:17.008087 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73593db9-49e4-41ff-a1e7-e6e16776f483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:17.010840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73593db9-49e4-41ff-a1e7-e6e16776f483 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:17.044991 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1346/2695] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:16 2022] POST /identity/v3/projects => generated 353 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:17.046576 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb717d36-5850-4dc8-b7a5-03a828fb7fea None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:17.058399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb717d36-5850-4dc8-b7a5-03a828fb7fea None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:17.121133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f021a-e419-40f0-851b-1fe80101b2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:17.121133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f021a-e419-40f0-851b-1fe80101b2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:17.121133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f021a-e419-40f0-851b-1fe80101b2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:17.121555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f021a-e419-40f0-851b-1fe80101b2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:17.122034 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f021a-e419-40f0-851b-1fe80101b2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:17.123843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f021a-e419-40f0-851b-1fe80101b2d8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:17.149180 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1350/2696] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:17 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:17.152997 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73593db9-49e4-41ff-a1e7-e6e16776f483 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:17.165346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73593db9-49e4-41ff-a1e7-e6e16776f483 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:17.171269 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6af45-afcb-44d4-b494-ccaf484e14c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:17.172033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6af45-afcb-44d4-b494-ccaf484e14c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:17.172381 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6af45-afcb-44d4-b494-ccaf484e14c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:17.172797 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6af45-afcb-44d4-b494-ccaf484e14c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:17.173574 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6af45-afcb-44d4-b494-ccaf484e14c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:17.175433 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6af45-afcb-44d4-b494-ccaf484e14c4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:17.187607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1347/2697] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:17.192483 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f021a-e419-40f0-851b-1fe80101b2d8 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:17.202699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f021a-e419-40f0-851b-1fe80101b2d8 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:17.208124 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ae046-63a0-4741-8897-886241445bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:17.209109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ae046-63a0-4741-8897-886241445bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:17.209979 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ae046-63a0-4741-8897-886241445bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:17.210353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ae046-63a0-4741-8897-886241445bbc admin admin] PATH_INFO: `/v3/projects/51f066110fab43f8a0c48a23d31bd48f/users/cc5fe12a94e54511b51f329d44134777/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:17.229716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ae046-63a0-4741-8897-886241445bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f066110fab43f8a0c48a23d31bd48f, user_id=cc5fe12a94e54511b51f329d44134777, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:17.232603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ae046-63a0-4741-8897-886241445bbc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:17.247654 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1351/2698] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:17 2022] PUT /identity/v3/projects/51f066110fab43f8a0c48a23d31bd48f/users/cc5fe12a94e54511b51f329d44134777/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:17.252123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6af45-afcb-44d4-b494-ccaf484e14c4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:17.271323 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6af45-afcb-44d4-b494-ccaf484e14c4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:17.384862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ae046-63a0-4741-8897-886241445bbc admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:17.391133 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ff0ae046-63a0-4741-8897-886241445bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:17.394493 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf13a1-b050-4e2e-9d3b-978ff7d9fc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:17.395362 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf13a1-b050-4e2e-9d3b-978ff7d9fc71 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:17.395662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf13a1-b050-4e2e-9d3b-978ff7d9fc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:17.396386 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf13a1-b050-4e2e-9d3b-978ff7d9fc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:17.397568 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf13a1-b050-4e2e-9d3b-978ff7d9fc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:17.399550 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf13a1-b050-4e2e-9d3b-978ff7d9fc71 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:17.409992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ae046-63a0-4741-8897-886241445bbc admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:17.412607 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1348/2699] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:17.415525 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17b0c2-c053-4292-b31a-2cbcdc6e0c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:17.416295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17b0c2-c053-4292-b31a-2cbcdc6e0c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:17.416573 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17b0c2-c053-4292-b31a-2cbcdc6e0c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:17.417098 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf13a1-b050-4e2e-9d3b-978ff7d9fc71 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:17.417491 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17b0c2-c053-4292-b31a-2cbcdc6e0c26 admin admin] PATH_INFO: `/v3/users/f6c4519283d248bab4d6f12eee2258ae` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:17.418762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17b0c2-c053-4292-b31a-2cbcdc6e0c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c4519283d248bab4d6f12eee2258ae)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:17.421103 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17b0c2-c053-4292-b31a-2cbcdc6e0c26 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:17.434059 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf13a1-b050-4e2e-9d3b-978ff7d9fc71 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:17.439996 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d9303-f80e-4ecd-a1a8-0788a873c221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:17.443705 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9303-f80e-4ecd-a1a8-0788a873c221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:17.444309 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9303-f80e-4ecd-a1a8-0788a873c221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:17.444840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9303-f80e-4ecd-a1a8-0788a873c221 admin admin] PATH_INFO: `/v3/projects/51f066110fab43f8a0c48a23d31bd48f/users/cc5fe12a94e54511b51f329d44134777/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:17.449304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d9303-f80e-4ecd-a1a8-0788a873c221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f066110fab43f8a0c48a23d31bd48f, user_id=cc5fe12a94e54511b51f329d44134777, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:17.454518 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d9303-f80e-4ecd-a1a8-0788a873c221 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:17.471489 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1349/2700] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:17 2022] PUT /identity/v3/projects/51f066110fab43f8a0c48a23d31bd48f/users/cc5fe12a94e54511b51f329d44134777/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:17.496096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded86b66-ab6f-4d8d-bbba-d8dd866c1d20 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:17.496552 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded86b66-ab6f-4d8d-bbba-d8dd866c1d20 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:17.498374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded86b66-ab6f-4d8d-bbba-d8dd866c1d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:17.506144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3f17b0c2-c053-4292-b31a-2cbcdc6e0c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c4519283d248bab4d6f12eee2258ae'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:17.506854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3f17b0c2-c053-4292-b31a-2cbcdc6e0c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c4519283d248bab4d6f12eee2258ae'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:17.526440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3f17b0c2-c053-4292-b31a-2cbcdc6e0c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c4519283d248bab4d6f12eee2258ae'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:17.543114 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3f17b0c2-c053-4292-b31a-2cbcdc6e0c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c4519283d248bab4d6f12eee2258ae'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:17.543752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ded86b66-ab6f-4d8d-bbba-d8dd866c1d20 None None] MFA Rules not processed for user `cc5fe12a94e54511b51f329d44134777`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:17.544209 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3f17b0c2-c053-4292-b31a-2cbcdc6e0c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c4519283d248bab4d6f12eee2258ae'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:17.547169 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ded86b66-ab6f-4d8d-bbba-d8dd866c1d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:17.578936 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1352/2701] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:17 2022] DELETE /identity/v3/users/f6c4519283d248bab4d6f12eee2258ae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:17.580263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:17.595026 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a36280-31f6-40ce-9740-c7eb0200226f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:17.597252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a36280-31f6-40ce-9740-c7eb0200226f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:17.597537 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a36280-31f6-40ce-9740-c7eb0200226f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:17.630170 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-32a36280-31f6-40ce-9740-c7eb0200226f None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:17.631897 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-32a36280-31f6-40ce-9740-c7eb0200226f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:17.649890 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1350/2702] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:17 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:17.662813 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded86b66-ab6f-4d8d-bbba-d8dd866c1d20 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:17.665217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ded86b66-ab6f-4d8d-bbba-d8dd866c1d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:17.714883 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:17.718543 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1353/2703] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:17.734885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded86b66-ab6f-4d8d-bbba-d8dd866c1d20 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:17.737272 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a36280-31f6-40ce-9740-c7eb0200226f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:17.738716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-32a36280-31f6-40ce-9740-c7eb0200226f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:17.793656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ec452-953c-4d5b-b940-fe810d7f5e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:17.794459 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ec452-953c-4d5b-b940-fe810d7f5e8b service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:17.794842 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ec452-953c-4d5b-b940-fe810d7f5e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:17.795216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ec452-953c-4d5b-b940-fe810d7f5e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:17.806583 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a36280-31f6-40ce-9740-c7eb0200226f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:17.810675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902e8cf-09dc-42b1-89c5-3e5949206d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:17.811561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902e8cf-09dc-42b1-89c5-3e5949206d5c service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:17.811935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902e8cf-09dc-42b1-89c5-3e5949206d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:17.812303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902e8cf-09dc-42b1-89c5-3e5949206d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:17.824974 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902e8cf-09dc-42b1-89c5-3e5949206d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:17.826540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902e8cf-09dc-42b1-89c5-3e5949206d5c service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:17.837183 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1354/2704] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:17.865075 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ec452-953c-4d5b-b940-fe810d7f5e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:17.866563 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ec452-953c-4d5b-b940-fe810d7f5e8b service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:17.878955 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1351/2705] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:17 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:31:17.964288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902e8cf-09dc-42b1-89c5-3e5949206d5c service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:17.974981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902e8cf-09dc-42b1-89c5-3e5949206d5c service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:17.980443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a7676-86a1-44c8-8228-1dbdfecdf5e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:17.981321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a7676-86a1-44c8-8228-1dbdfecdf5e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:17.981720 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a7676-86a1-44c8-8228-1dbdfecdf5e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:17.982111 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a7676-86a1-44c8-8228-1dbdfecdf5e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:17.984147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-047a7676-86a1-44c8-8228-1dbdfecdf5e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:18.073080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a7676-86a1-44c8-8228-1dbdfecdf5e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:18.074585 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a7676-86a1-44c8-8228-1dbdfecdf5e4 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:18.084689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1355/2706] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:18.148283 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ec452-953c-4d5b-b940-fe810d7f5e8b service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:18.150523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1b1ec452-953c-4d5b-b940-fe810d7f5e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:18.179723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ec452-953c-4d5b-b940-fe810d7f5e8b service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:18.186091 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6517d8c-a5e9-40c4-b410-74bb91601aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:18.186754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517d8c-a5e9-40c4-b410-74bb91601aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:18.187636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517d8c-a5e9-40c4-b410-74bb91601aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:18.188002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517d8c-a5e9-40c4-b410-74bb91601aa8 admin admin] PATH_INFO: `/v3/projects/88826e3d7ee84ed6a92a80e27216da95` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:18.189387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6517d8c-a5e9-40c4-b410-74bb91601aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88826e3d7ee84ed6a92a80e27216da95)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:18.195060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6517d8c-a5e9-40c4-b410-74bb91601aa8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:18.248483 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b6517d8c-a5e9-40c4-b410-74bb91601aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88826e3d7ee84ed6a92a80e27216da95', 'request_id': 'req-b6517d8c-a5e9-40c4-b410-74bb91601aa8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:18.257282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b6517d8c-a5e9-40c4-b410-74bb91601aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88826e3d7ee84ed6a92a80e27216da95', 'request_id': 'req-b6517d8c-a5e9-40c4-b410-74bb91601aa8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:18.263907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b6517d8c-a5e9-40c4-b410-74bb91601aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88826e3d7ee84ed6a92a80e27216da95', 'request_id': 'req-b6517d8c-a5e9-40c4-b410-74bb91601aa8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:18.274839 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b6517d8c-a5e9-40c4-b410-74bb91601aa8 admin admin] The token cache is being invalidate because project 88826e3d7ee84ed6a92a80e27216da95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:18.275129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b6517d8c-a5e9-40c4-b410-74bb91601aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:18.275952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b6517d8c-a5e9-40c4-b410-74bb91601aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:18.277822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1352/2707] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:18 2022] DELETE /identity/v3/projects/88826e3d7ee84ed6a92a80e27216da95 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:18.283387 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a533bb-50e8-4147-861a-31a7d2f933ef None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:18.283928 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a533bb-50e8-4147-861a-31a7d2f933ef None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:18.284030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a533bb-50e8-4147-861a-31a7d2f933ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:18.303618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-67a533bb-50e8-4147-861a-31a7d2f933ef None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:18.304978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-67a533bb-50e8-4147-861a-31a7d2f933ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:18.341893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:18.371997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1356/2708] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:18.380179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e9973-50a7-4977-a061-b77c63a4a10e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:18.380464 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e9973-50a7-4977-a061-b77c63a4a10e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:18.380766 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e9973-50a7-4977-a061-b77c63a4a10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:18.401076 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-953e9973-50a7-4977-a061-b77c63a4a10e None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:18.402315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-953e9973-50a7-4977-a061-b77c63a4a10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:18.411735 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1353/2709] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:18.416121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a533bb-50e8-4147-861a-31a7d2f933ef None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:18.426861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a533bb-50e8-4147-861a-31a7d2f933ef None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:18.433009 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3da232-25d5-460a-95e6-9e95a71d2eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:18.433643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3da232-25d5-460a-95e6-9e95a71d2eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:18.433922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3da232-25d5-460a-95e6-9e95a71d2eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:18.434182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3da232-25d5-460a-95e6-9e95a71d2eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:18.434840 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3da232-25d5-460a-95e6-9e95a71d2eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:31:18.435145 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3da232-25d5-460a-95e6-9e95a71d2eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:18.436798 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3da232-25d5-460a-95e6-9e95a71d2eb2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:18.452541 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1357/2710] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 18:31:18.453994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e9973-50a7-4977-a061-b77c63a4a10e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:18.463553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e9973-50a7-4977-a061-b77c63a4a10e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:18.469282 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b842425-c997-48f1-9d12-2f8e5a681672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:18.469918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b842425-c997-48f1-9d12-2f8e5a681672 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:18.470194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b842425-c997-48f1-9d12-2f8e5a681672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:18.470463 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b842425-c997-48f1-9d12-2f8e5a681672 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:18.471119 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b842425-c997-48f1-9d12-2f8e5a681672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:18.473092 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b842425-c997-48f1-9d12-2f8e5a681672 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:18.498150 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:18.510506 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1354/2711] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:18 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:31:18.512425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3da232-25d5-460a-95e6-9e95a71d2eb2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:18.523353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3da232-25d5-460a-95e6-9e95a71d2eb2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:18.585711 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea687af9-2688-4e0b-b396-53b090c734db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:18.586437 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea687af9-2688-4e0b-b396-53b090c734db admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:18.586792 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea687af9-2688-4e0b-b396-53b090c734db admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:18.587077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea687af9-2688-4e0b-b396-53b090c734db admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:18.587746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea687af9-2688-4e0b-b396-53b090c734db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:18.589906 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea687af9-2688-4e0b-b396-53b090c734db admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:18.617653 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1358/2712] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:18 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:18.621635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b842425-c997-48f1-9d12-2f8e5a681672 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:18.636508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b842425-c997-48f1-9d12-2f8e5a681672 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:18.642261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7a86c-453d-4b93-8315-e6d3420d524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:18.643085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7a86c-453d-4b93-8315-e6d3420d524d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:18.643372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7a86c-453d-4b93-8315-e6d3420d524d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:18.643721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7a86c-453d-4b93-8315-e6d3420d524d admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:18.644484 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7a86c-453d-4b93-8315-e6d3420d524d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:18.646383 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7a86c-453d-4b93-8315-e6d3420d524d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:18.657866 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1355/2713] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:18.662033 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea687af9-2688-4e0b-b396-53b090c734db admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:18.675734 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea687af9-2688-4e0b-b396-53b090c734db admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:18.681951 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bba10b-ef6b-45e2-abcf-7fe3752b8ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:18.682595 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba10b-ef6b-45e2-abcf-7fe3752b8ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:18.682874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba10b-ef6b-45e2-abcf-7fe3752b8ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:18.683144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba10b-ef6b-45e2-abcf-7fe3752b8ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:18.683805 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bba10b-ef6b-45e2-abcf-7fe3752b8ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:18.685487 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bba10b-ef6b-45e2-abcf-7fe3752b8ed3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:18.700755 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1359/2714] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:18.702410 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7a86c-453d-4b93-8315-e6d3420d524d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:18.714104 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7a86c-453d-4b93-8315-e6d3420d524d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:18.719390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d37689-cde0-4324-9750-730ccefd369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:18.720738 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d37689-cde0-4324-9750-730ccefd369c admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:18.721029 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d37689-cde0-4324-9750-730ccefd369c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:18.721298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d37689-cde0-4324-9750-730ccefd369c admin admin] PATH_INFO: `/v3/projects/4f72bf7f758141ef91ba681333c65762/users/5202e352a4304c51bda51a1c906ce225/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:18.737808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d37689-cde0-4324-9750-730ccefd369c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f72bf7f758141ef91ba681333c65762, user_id=5202e352a4304c51bda51a1c906ce225, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:18.741172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d37689-cde0-4324-9750-730ccefd369c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:18.756239 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1356/2715] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:18 2022] PUT /identity/v3/projects/4f72bf7f758141ef91ba681333c65762/users/5202e352a4304c51bda51a1c906ce225/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:18.768009 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf655eb-6c44-49c8-8d0c-b9cce378aa5a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:18.768420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf655eb-6c44-49c8-8d0c-b9cce378aa5a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:18.768694 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf655eb-6c44-49c8-8d0c-b9cce378aa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:18.803173 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0bf655eb-6c44-49c8-8d0c-b9cce378aa5a None None] MFA Rules not processed for user `5202e352a4304c51bda51a1c906ce225`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:18.804429 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0bf655eb-6c44-49c8-8d0c-b9cce378aa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:18.871447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1360/2716] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:18.876251 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d37689-cde0-4324-9750-730ccefd369c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:18.938922 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d37689-cde0-4324-9750-730ccefd369c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:18.944207 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2278e57-46b7-4eab-8850-b09856839fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:18.944841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278e57-46b7-4eab-8850-b09856839fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:18.945121 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278e57-46b7-4eab-8850-b09856839fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:18.945390 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278e57-46b7-4eab-8850-b09856839fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:18.946033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2278e57-46b7-4eab-8850-b09856839fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:18.947935 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2278e57-46b7-4eab-8850-b09856839fcd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:18.979246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1357/2717] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:18 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:18.983587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf655eb-6c44-49c8-8d0c-b9cce378aa5a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:18.994284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf655eb-6c44-49c8-8d0c-b9cce378aa5a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:19.024261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:19.050810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af16d17-d85a-46ef-b071-8c17b018422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:19.051401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af16d17-d85a-46ef-b071-8c17b018422d admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:19.051677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af16d17-d85a-46ef-b071-8c17b018422d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:19.051935 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af16d17-d85a-46ef-b071-8c17b018422d admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:19.052556 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af16d17-d85a-46ef-b071-8c17b018422d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:19.054506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af16d17-d85a-46ef-b071-8c17b018422d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:19.077356 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1361/2718] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:18 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:19.081862 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2278e57-46b7-4eab-8850-b09856839fcd admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:19.092040 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2278e57-46b7-4eab-8850-b09856839fcd admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:19.096686 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add4621-0a93-4da9-8c94-8eb698737259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:19.097393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add4621-0a93-4da9-8c94-8eb698737259 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:19.097670 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add4621-0a93-4da9-8c94-8eb698737259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:19.097940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add4621-0a93-4da9-8c94-8eb698737259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:19.098581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add4621-0a93-4da9-8c94-8eb698737259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:19.100198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add4621-0a93-4da9-8c94-8eb698737259 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:19.110696 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1358/2719] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:19.114458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af16d17-d85a-46ef-b071-8c17b018422d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:19.124739 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af16d17-d85a-46ef-b071-8c17b018422d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:19.129656 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8a23c-188d-495a-9cc9-169bafdc73a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:19.130254 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8a23c-188d-495a-9cc9-169bafdc73a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:19.130523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8a23c-188d-495a-9cc9-169bafdc73a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:19.130797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8a23c-188d-495a-9cc9-169bafdc73a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:19.131474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8a23c-188d-495a-9cc9-169bafdc73a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:19.133208 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8a23c-188d-495a-9cc9-169bafdc73a0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:19.143948 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1362/2720] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:19.148403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add4621-0a93-4da9-8c94-8eb698737259 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:19.166036 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add4621-0a93-4da9-8c94-8eb698737259 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:19.173166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21467164-a9a7-42e1-a48a-66acbe9c36bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:19.173833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21467164-a9a7-42e1-a48a-66acbe9c36bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:19.174102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21467164-a9a7-42e1-a48a-66acbe9c36bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:19.174369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21467164-a9a7-42e1-a48a-66acbe9c36bf admin admin] PATH_INFO: `/v3/projects/425a26b70c7947858de5b60b077fd643/users/1365be694ef94882b6e96880bc225922/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:19.191430 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21467164-a9a7-42e1-a48a-66acbe9c36bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=425a26b70c7947858de5b60b077fd643, user_id=1365be694ef94882b6e96880bc225922, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:19.194174 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21467164-a9a7-42e1-a48a-66acbe9c36bf admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:19.211602 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1359/2721] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:19 2022] PUT /identity/v3/projects/425a26b70c7947858de5b60b077fd643/users/1365be694ef94882b6e96880bc225922/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:19.223004 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f4d83-ff23-4276-b1f0-bb69cb8e20ef None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:19.223308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f4d83-ff23-4276-b1f0-bb69cb8e20ef None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:19.223586 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f4d83-ff23-4276-b1f0-bb69cb8e20ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:19.258013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-389f4d83-ff23-4276-b1f0-bb69cb8e20ef None None] MFA Rules not processed for user `1365be694ef94882b6e96880bc225922`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:19.259270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-389f4d83-ff23-4276-b1f0-bb69cb8e20ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:19.352499 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1363/2722] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:19.357191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21467164-a9a7-42e1-a48a-66acbe9c36bf admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:19.451730 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21467164-a9a7-42e1-a48a-66acbe9c36bf admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:19.461508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71d118-adc1-4ea5-8575-101ea7ac851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:19.462387 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71d118-adc1-4ea5-8575-101ea7ac851b admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:19.462763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71d118-adc1-4ea5-8575-101ea7ac851b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:19.463130 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71d118-adc1-4ea5-8575-101ea7ac851b admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:19.463877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71d118-adc1-4ea5-8575-101ea7ac851b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:19.465930 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71d118-adc1-4ea5-8575-101ea7ac851b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:19.489527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:19.498452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1360/2723] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:19 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:31:19.506287 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f4d83-ff23-4276-b1f0-bb69cb8e20ef None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:19.524832 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f4d83-ff23-4276-b1f0-bb69cb8e20ef None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:19.590236 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dbb76-9616-4ebe-83eb-6047031af16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:19.590876 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dbb76-9616-4ebe-83eb-6047031af16b admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:19.591144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dbb76-9616-4ebe-83eb-6047031af16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:19.591411 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dbb76-9616-4ebe-83eb-6047031af16b admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:19.592065 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dbb76-9616-4ebe-83eb-6047031af16b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:19.594072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dbb76-9616-4ebe-83eb-6047031af16b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:19.618793 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1364/2724] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:19 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:19.620264 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71d118-adc1-4ea5-8575-101ea7ac851b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:19.630431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71d118-adc1-4ea5-8575-101ea7ac851b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:19.635353 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80396197-af74-45cd-8819-e335e33dff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:19.635942 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80396197-af74-45cd-8819-e335e33dff50 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:19.636217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80396197-af74-45cd-8819-e335e33dff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:19.636531 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80396197-af74-45cd-8819-e335e33dff50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:19.637207 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80396197-af74-45cd-8819-e335e33dff50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:19.638983 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80396197-af74-45cd-8819-e335e33dff50 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:19.649885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1361/2725] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:19.654188 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dbb76-9616-4ebe-83eb-6047031af16b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:19.666491 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dbb76-9616-4ebe-83eb-6047031af16b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:19.675187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb4fae-fd01-4f91-8975-28804552d83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:19.676152 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb4fae-fd01-4f91-8975-28804552d83d admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:19.676625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb4fae-fd01-4f91-8975-28804552d83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:19.676969 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb4fae-fd01-4f91-8975-28804552d83d admin admin] PATH_INFO: `/v3/projects/61ac6cc662c54dd8ba96df55d4a7f697/users/92bb40d212c74f65a7061366d5becc00/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:19.694966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb4fae-fd01-4f91-8975-28804552d83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ac6cc662c54dd8ba96df55d4a7f697, user_id=92bb40d212c74f65a7061366d5becc00, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:19.700415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb4fae-fd01-4f91-8975-28804552d83d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:19.720396 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1365/2726] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:19 2022] PUT /identity/v3/projects/61ac6cc662c54dd8ba96df55d4a7f697/users/92bb40d212c74f65a7061366d5becc00/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:19.724791 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80396197-af74-45cd-8819-e335e33dff50 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:19.740344 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80396197-af74-45cd-8819-e335e33dff50 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:19.806138 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7c8e5-5da1-4f21-a78a-b6d9eb7fca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:19.806382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7c8e5-5da1-4f21-a78a-b6d9eb7fca72 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:19.806995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7c8e5-5da1-4f21-a78a-b6d9eb7fca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:19.806995 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7c8e5-5da1-4f21-a78a-b6d9eb7fca72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:19.807692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7c8e5-5da1-4f21-a78a-b6d9eb7fca72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:19.810171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7c8e5-5da1-4f21-a78a-b6d9eb7fca72 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:19.825129 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1362/2727] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:19.829368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb4fae-fd01-4f91-8975-28804552d83d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:19.848490 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb4fae-fd01-4f91-8975-28804552d83d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:19.853728 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823a60-a84d-4671-95b1-8fc9be29f4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:19.854409 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823a60-a84d-4671-95b1-8fc9be29f4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:19.854690 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823a60-a84d-4671-95b1-8fc9be29f4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:19.854964 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823a60-a84d-4671-95b1-8fc9be29f4f4 admin admin] PATH_INFO: `/v3/projects/61ac6cc662c54dd8ba96df55d4a7f697/users/92bb40d212c74f65a7061366d5becc00/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:19.857029 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823a60-a84d-4671-95b1-8fc9be29f4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ac6cc662c54dd8ba96df55d4a7f697, user_id=92bb40d212c74f65a7061366d5becc00, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:19.859660 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823a60-a84d-4671-95b1-8fc9be29f4f4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:19.862198 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:19.893196 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1366/2728] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:19 2022] PUT /identity/v3/projects/61ac6cc662c54dd8ba96df55d4a7f697/users/92bb40d212c74f65a7061366d5becc00/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:19.896184 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8948c37-446c-47fb-a4dd-386e8fd81853 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:19.896473 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8948c37-446c-47fb-a4dd-386e8fd81853 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:19.896798 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8948c37-446c-47fb-a4dd-386e8fd81853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:19.927918 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e8948c37-446c-47fb-a4dd-386e8fd81853 None None] MFA Rules not processed for user `92bb40d212c74f65a7061366d5becc00`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:19.929946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e8948c37-446c-47fb-a4dd-386e8fd81853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:20.015261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1363/2729] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:20.029501 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823a60-a84d-4671-95b1-8fc9be29f4f4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:20.031389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-85823a60-a84d-4671-95b1-8fc9be29f4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:20.105590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823a60-a84d-4671-95b1-8fc9be29f4f4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:20.109617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbe77f-a21b-40b6-a3cb-505e083106db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:20.110343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbe77f-a21b-40b6-a3cb-505e083106db service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:20.110623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbe77f-a21b-40b6-a3cb-505e083106db service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:20.110893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbe77f-a21b-40b6-a3cb-505e083106db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:20.181281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbe77f-a21b-40b6-a3cb-505e083106db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:20.182622 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbe77f-a21b-40b6-a3cb-505e083106db service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:20.199267 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1367/2730] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:20.297524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8948c37-446c-47fb-a4dd-386e8fd81853 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:20.299642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e8948c37-446c-47fb-a4dd-386e8fd81853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:20.383443 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8948c37-446c-47fb-a4dd-386e8fd81853 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:20.389046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baf5a0-2e53-4f7d-895f-aa3ecd55f4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:20.389808 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baf5a0-2e53-4f7d-895f-aa3ecd55f4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:20.390304 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baf5a0-2e53-4f7d-895f-aa3ecd55f4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:20.390649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baf5a0-2e53-4f7d-895f-aa3ecd55f4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:20.393246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d5baf5a0-2e53-4f7d-895f-aa3ecd55f4f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:20.435775 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:20.521230 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baf5a0-2e53-4f7d-895f-aa3ecd55f4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:20.523025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baf5a0-2e53-4f7d-895f-aa3ecd55f4f3 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:20.536520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1364/2731] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:21.831171 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbe77f-a21b-40b6-a3cb-505e083106db service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:21.840382 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbe77f-a21b-40b6-a3cb-505e083106db service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:21.844462 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58941d-4647-4dd6-a16a-8d45f779bf89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:21.845114 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58941d-4647-4dd6-a16a-8d45f779bf89 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:21.845406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58941d-4647-4dd6-a16a-8d45f779bf89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:21.845672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58941d-4647-4dd6-a16a-8d45f779bf89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:21.909954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58941d-4647-4dd6-a16a-8d45f779bf89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:21.911440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58941d-4647-4dd6-a16a-8d45f779bf89 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:21.925121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1368/2732] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:22.714020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baf5a0-2e53-4f7d-895f-aa3ecd55f4f3 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:22.728853 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baf5a0-2e53-4f7d-895f-aa3ecd55f4f3 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:22.733057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec400d-3ec5-4498-938c-94cec41ea728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:22.733795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec400d-3ec5-4498-938c-94cec41ea728 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:22.734324 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec400d-3ec5-4498-938c-94cec41ea728 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:22.734841 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec400d-3ec5-4498-938c-94cec41ea728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:22.752066 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec400d-3ec5-4498-938c-94cec41ea728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:22.754077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec400d-3ec5-4498-938c-94cec41ea728 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:22.766131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1365/2733] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:26.803605 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58941d-4647-4dd6-a16a-8d45f779bf89 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:26.865007 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:26.884154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58941d-4647-4dd6-a16a-8d45f779bf89 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:26.889543 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:26.890263 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:26.890636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:26.890986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] PATH_INFO: `/v3/users/5202e352a4304c51bda51a1c906ce225` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:26.892248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5202e352a4304c51bda51a1c906ce225)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:26.894465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:26.953221 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5202e352a4304c51bda51a1c906ce225'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:26.953899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5202e352a4304c51bda51a1c906ce225'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:26.962398 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5202e352a4304c51bda51a1c906ce225'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:26.969875 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5202e352a4304c51bda51a1c906ce225'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:26.970531 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5202e352a4304c51bda51a1c906ce225'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:26.987743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1369/2734] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:26 2022] DELETE /identity/v3/users/5202e352a4304c51bda51a1c906ce225 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:26.992289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4bddf-c45b-44ae-b689-88b4d4d16595 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:26.992852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4bddf-c45b-44ae-b689-88b4d4d16595 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:26.992971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4bddf-c45b-44ae-b689-88b4d4d16595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:27.012472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-29b4bddf-c45b-44ae-b689-88b4d4d16595 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:27.013739 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-29b4bddf-c45b-44ae-b689-88b4d4d16595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:27.075517 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1366/2735] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:27.087570 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:27.089363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:27.155764 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04311876-f641-472a-9fe5-3760a756767d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:27.159835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676aee-031c-4964-8365-ff681f4f5dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:27.160450 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676aee-031c-4964-8365-ff681f4f5dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:27.160840 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676aee-031c-4964-8365-ff681f4f5dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:27.161117 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676aee-031c-4964-8365-ff681f4f5dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:27.170210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676aee-031c-4964-8365-ff681f4f5dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:27.171712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676aee-031c-4964-8365-ff681f4f5dc1 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:27.181719 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1370/2736] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:27.463649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4bddf-c45b-44ae-b689-88b4d4d16595 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:27.465237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-29b4bddf-c45b-44ae-b689-88b4d4d16595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:27.479033 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4bddf-c45b-44ae-b689-88b4d4d16595 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:27.484085 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:27.484829 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:27.485201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:27.485785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] PATH_INFO: `/v3/projects/4f72bf7f758141ef91ba681333c65762` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:27.487151 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f72bf7f758141ef91ba681333c65762)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:27.489592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:27.544882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f72bf7f758141ef91ba681333c65762', 'request_id': 'req-6cc07541-6672-432c-ae00-a2a8863cd204'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:27.552465 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f72bf7f758141ef91ba681333c65762', 'request_id': 'req-6cc07541-6672-432c-ae00-a2a8863cd204'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:27.558855 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f72bf7f758141ef91ba681333c65762', 'request_id': 'req-6cc07541-6672-432c-ae00-a2a8863cd204'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:27.569330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] The token cache is being invalidate because project 4f72bf7f758141ef91ba681333c65762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:27.569597 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:27.570231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:27.571793 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1367/2737] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:27 2022] DELETE /identity/v3/projects/4f72bf7f758141ef91ba681333c65762 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:27.575865 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676aee-031c-4964-8365-ff681f4f5dc1 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:27.585669 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676aee-031c-4964-8365-ff681f4f5dc1 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:27.649797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:27.650436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:27.650712 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:27.650982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] PATH_INFO: `/v3/users/1365be694ef94882b6e96880bc225922` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:27.652099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1365be694ef94882b6e96880bc225922)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:27.654121 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:27.665553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:27.704086 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1365be694ef94882b6e96880bc225922'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:27.704765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1365be694ef94882b6e96880bc225922'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:27.713322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1365be694ef94882b6e96880bc225922'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:27.720353 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1365be694ef94882b6e96880bc225922'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:27.721104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1365be694ef94882b6e96880bc225922'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:27.738175 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1371/2738] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:27 2022] DELETE /identity/v3/users/1365be694ef94882b6e96880bc225922 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:28.027098 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:28.029057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:28.044999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc07541-6672-432c-ae00-a2a8863cd204 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:28.089335 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:28.125685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:28.126398 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:28.126752 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:28.127170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] PATH_INFO: `/v3/projects/425a26b70c7947858de5b60b077fd643` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:28.128421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=425a26b70c7947858de5b60b077fd643)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:28.130562 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:28.181827 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425a26b70c7947858de5b60b077fd643', 'request_id': 'req-5d13597a-3210-4aae-a6d8-7666c84b3233'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.191876 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425a26b70c7947858de5b60b077fd643', 'request_id': 'req-5d13597a-3210-4aae-a6d8-7666c84b3233'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.199728 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425a26b70c7947858de5b60b077fd643', 'request_id': 'req-5d13597a-3210-4aae-a6d8-7666c84b3233'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.212809 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] The token cache is being invalidate because project 425a26b70c7947858de5b60b077fd643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:28.213106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.213769 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.215671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1368/2739] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:28 2022] DELETE /identity/v3/projects/425a26b70c7947858de5b60b077fd643 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:28.221159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:28.222687 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:28.236271 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf2222-4bc7-4951-89ce-c3ca5d52727e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:28.309913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65f483-31ac-4cb4-86d0-587419802509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:28.310603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65f483-31ac-4cb4-86d0-587419802509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:28.310954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65f483-31ac-4cb4-86d0-587419802509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:28.311299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65f483-31ac-4cb4-86d0-587419802509 admin admin] PATH_INFO: `/v3/users/92bb40d212c74f65a7061366d5becc00` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:28.312861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65f483-31ac-4cb4-86d0-587419802509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92bb40d212c74f65a7061366d5becc00)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:28.315010 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65f483-31ac-4cb4-86d0-587419802509 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:28.375771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5c65f483-31ac-4cb4-86d0-587419802509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92bb40d212c74f65a7061366d5becc00'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.376512 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5c65f483-31ac-4cb4-86d0-587419802509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92bb40d212c74f65a7061366d5becc00'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.384953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5c65f483-31ac-4cb4-86d0-587419802509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92bb40d212c74f65a7061366d5becc00'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.393370 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5c65f483-31ac-4cb4-86d0-587419802509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92bb40d212c74f65a7061366d5becc00'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.394215 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5c65f483-31ac-4cb4-86d0-587419802509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92bb40d212c74f65a7061366d5becc00'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.413411 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1372/2740] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:28 2022] DELETE /identity/v3/users/92bb40d212c74f65a7061366d5becc00 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:28.714953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:28.716569 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:28.730450 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13597a-3210-4aae-a6d8-7666c84b3233 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:28.789234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f263b-5d34-43de-8ba6-9b70468e7a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:28.789890 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f263b-5d34-43de-8ba6-9b70468e7a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:28.790173 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f263b-5d34-43de-8ba6-9b70468e7a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:28.790447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f263b-5d34-43de-8ba6-9b70468e7a64 admin admin] PATH_INFO: `/v3/projects/61ac6cc662c54dd8ba96df55d4a7f697` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:28.791695 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f263b-5d34-43de-8ba6-9b70468e7a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ac6cc662c54dd8ba96df55d4a7f697)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:28.793917 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f263b-5d34-43de-8ba6-9b70468e7a64 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:28.850004 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5a9f263b-5d34-43de-8ba6-9b70468e7a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ac6cc662c54dd8ba96df55d4a7f697', 'request_id': 'req-5a9f263b-5d34-43de-8ba6-9b70468e7a64'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.859331 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5a9f263b-5d34-43de-8ba6-9b70468e7a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ac6cc662c54dd8ba96df55d4a7f697', 'request_id': 'req-5a9f263b-5d34-43de-8ba6-9b70468e7a64'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.866243 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5a9f263b-5d34-43de-8ba6-9b70468e7a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ac6cc662c54dd8ba96df55d4a7f697', 'request_id': 'req-5a9f263b-5d34-43de-8ba6-9b70468e7a64'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.868223 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:28.880343 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5a9f263b-5d34-43de-8ba6-9b70468e7a64 admin admin] The token cache is being invalidate because project 61ac6cc662c54dd8ba96df55d4a7f697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:28.880749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5a9f263b-5d34-43de-8ba6-9b70468e7a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.881709 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5a9f263b-5d34-43de-8ba6-9b70468e7a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:28.884359 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1369/2741] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:28 2022] DELETE /identity/v3/projects/61ac6cc662c54dd8ba96df55d4a7f697 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:28.891435 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f42fc-f8a1-4c20-8156-637b284088c6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:28.891838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f42fc-f8a1-4c20-8156-637b284088c6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:28.892131 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f42fc-f8a1-4c20-8156-637b284088c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:28.906461 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:28.912982 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-bd8f42fc-f8a1-4c20-8156-637b284088c6 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:28.915067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bd8f42fc-f8a1-4c20-8156-637b284088c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:28.978418 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1373/2742] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:29.043332 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760554e-95a2-4a22-96f6-6ab84a6ec103 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:29.043974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760554e-95a2-4a22-96f6-6ab84a6ec103 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:29.043974 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760554e-95a2-4a22-96f6-6ab84a6ec103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:29.069541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1760554e-95a2-4a22-96f6-6ab84a6ec103 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:29.071352 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1760554e-95a2-4a22-96f6-6ab84a6ec103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:29.084170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1370/2743] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:29.088562 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f42fc-f8a1-4c20-8156-637b284088c6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:29.098816 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f42fc-f8a1-4c20-8156-637b284088c6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:29.104910 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2188d3-bf5d-4627-a991-44ae651d1e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:29.105453 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2188d3-bf5d-4627-a991-44ae651d1e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:29.105735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2188d3-bf5d-4627-a991-44ae651d1e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:29.106013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2188d3-bf5d-4627-a991-44ae651d1e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:29.106686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2188d3-bf5d-4627-a991-44ae651d1e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:31:29.106988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2188d3-bf5d-4627-a991-44ae651d1e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:29.108621 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2188d3-bf5d-4627-a991-44ae651d1e97 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:29.120767 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1374/2744] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:31:29.125416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760554e-95a2-4a22-96f6-6ab84a6ec103 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:29.134990 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760554e-95a2-4a22-96f6-6ab84a6ec103 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:29.140678 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212ecfc-7209-4732-a233-6d9383005eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:29.141314 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212ecfc-7209-4732-a233-6d9383005eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:29.141628 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212ecfc-7209-4732-a233-6d9383005eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:29.141906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212ecfc-7209-4732-a233-6d9383005eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:29.142541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212ecfc-7209-4732-a233-6d9383005eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:29.144572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212ecfc-7209-4732-a233-6d9383005eb0 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:29.178499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1371/2745] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:29 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:29.182275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2188d3-bf5d-4627-a991-44ae651d1e97 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:29.192771 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2188d3-bf5d-4627-a991-44ae651d1e97 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:29.253227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a05e2-0994-4969-b11a-218a74406621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:29.254638 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a05e2-0994-4969-b11a-218a74406621 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:29.254916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a05e2-0994-4969-b11a-218a74406621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:29.255184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a05e2-0994-4969-b11a-218a74406621 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:29.255845 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a05e2-0994-4969-b11a-218a74406621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:29.257838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a05e2-0994-4969-b11a-218a74406621 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:29.288028 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1375/2746] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:29 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:29.290196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212ecfc-7209-4732-a233-6d9383005eb0 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:29.303248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212ecfc-7209-4732-a233-6d9383005eb0 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:29.308634 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659872b-055a-4cc0-ba1a-205c2d41c5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:29.309388 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659872b-055a-4cc0-ba1a-205c2d41c5fa admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:29.309672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659872b-055a-4cc0-ba1a-205c2d41c5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:29.309952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659872b-055a-4cc0-ba1a-205c2d41c5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:29.310611 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659872b-055a-4cc0-ba1a-205c2d41c5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:29.312530 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659872b-055a-4cc0-ba1a-205c2d41c5fa admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:29.336807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1372/2747] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:29.340647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a05e2-0994-4969-b11a-218a74406621 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:29.352508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a05e2-0994-4969-b11a-218a74406621 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:29.357930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355523f-f7b6-4ce4-b1b8-0ea1a3535a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:29.358627 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355523f-f7b6-4ce4-b1b8-0ea1a3535a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:29.359011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355523f-f7b6-4ce4-b1b8-0ea1a3535a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:29.359290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355523f-f7b6-4ce4-b1b8-0ea1a3535a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:29.359983 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355523f-f7b6-4ce4-b1b8-0ea1a3535a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:29.361897 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355523f-f7b6-4ce4-b1b8-0ea1a3535a30 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:29.375036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1376/2748] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:29.379671 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659872b-055a-4cc0-ba1a-205c2d41c5fa admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:29.390879 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659872b-055a-4cc0-ba1a-205c2d41c5fa admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:29.396610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d3426-2730-4bea-aa68-908691a9c4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:29.397329 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d3426-2730-4bea-aa68-908691a9c4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:29.397613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d3426-2730-4bea-aa68-908691a9c4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:29.397889 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d3426-2730-4bea-aa68-908691a9c4d6 admin admin] PATH_INFO: `/v3/projects/f95a72d996824d2f958dac5e599e92c7/users/9c1cf31f1d984e6dab334296cceef22b/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:29.415729 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d3426-2730-4bea-aa68-908691a9c4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95a72d996824d2f958dac5e599e92c7, user_id=9c1cf31f1d984e6dab334296cceef22b, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:29.418772 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d3426-2730-4bea-aa68-908691a9c4d6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:29.436523 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1373/2749] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:29 2022] PUT /identity/v3/projects/f95a72d996824d2f958dac5e599e92c7/users/9c1cf31f1d984e6dab334296cceef22b/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:29.447030 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032d91b-dc79-47a9-8986-b28ad2ce13ee None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:29.447322 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032d91b-dc79-47a9-8986-b28ad2ce13ee None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:29.448645 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032d91b-dc79-47a9-8986-b28ad2ce13ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:29.484957 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1032d91b-dc79-47a9-8986-b28ad2ce13ee None None] MFA Rules not processed for user `9c1cf31f1d984e6dab334296cceef22b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:29.485333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1032d91b-dc79-47a9-8986-b28ad2ce13ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:29.555308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1377/2750] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:29.566763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d3426-2730-4bea-aa68-908691a9c4d6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:29.568665 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-698d3426-2730-4bea-aa68-908691a9c4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:29.632795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d3426-2730-4bea-aa68-908691a9c4d6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:29.636327 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee7c79-84ff-4f35-9457-14a58d8066ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:29.636976 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee7c79-84ff-4f35-9457-14a58d8066ac service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:29.637266 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee7c79-84ff-4f35-9457-14a58d8066ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:29.637545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee7c79-84ff-4f35-9457-14a58d8066ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:29.646475 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee7c79-84ff-4f35-9457-14a58d8066ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:29.648097 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee7c79-84ff-4f35-9457-14a58d8066ac service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:29.657467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1374/2751] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:35.857609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032d91b-dc79-47a9-8986-b28ad2ce13ee None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:35.859068 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1032d91b-dc79-47a9-8986-b28ad2ce13ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:35.862357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:36.003675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032d91b-dc79-47a9-8986-b28ad2ce13ee None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:36.009187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:36.009826 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:36.010107 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:36.010381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] PATH_INFO: `/v3/users/e2ac919113b04e51aafb1f99adbd9dfc` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:36.011609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ac919113b04e51aafb1f99adbd9dfc)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:36.013636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:36.068380 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ac919113b04e51aafb1f99adbd9dfc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.069046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ac919113b04e51aafb1f99adbd9dfc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.078226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ac919113b04e51aafb1f99adbd9dfc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.085780 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ac919113b04e51aafb1f99adbd9dfc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.086546 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ac919113b04e51aafb1f99adbd9dfc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.104464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1378/2752] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:35 2022] DELETE /identity/v3/users/e2ac919113b04e51aafb1f99adbd9dfc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:36.109365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb2ff5-5f0a-4fe2-a117-2dcc178ac7a1 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:36.109886 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb2ff5-5f0a-4fe2-a117-2dcc178ac7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:36.109886 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb2ff5-5f0a-4fe2-a117-2dcc178ac7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:36.138609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-08fb2ff5-5f0a-4fe2-a117-2dcc178ac7a1 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:36.139847 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-08fb2ff5-5f0a-4fe2-a117-2dcc178ac7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:36.203887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1375/2753] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:36.214125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:36.215634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:36.241950 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:36.300762 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eface6b-0646-48ba-ad5b-175443d5af5a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:36.305300 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f0768-546c-46b7-9f96-a64287d1134b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:36.305937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f0768-546c-46b7-9f96-a64287d1134b service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:36.306210 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f0768-546c-46b7-9f96-a64287d1134b service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:36.306476 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f0768-546c-46b7-9f96-a64287d1134b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:36.316074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f0768-546c-46b7-9f96-a64287d1134b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:36.317625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f0768-546c-46b7-9f96-a64287d1134b service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:36.327113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1379/2754] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:36.613966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb2ff5-5f0a-4fe2-a117-2dcc178ac7a1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:36.615576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-08fb2ff5-5f0a-4fe2-a117-2dcc178ac7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:36.657961 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb2ff5-5f0a-4fe2-a117-2dcc178ac7a1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:36.665778 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:36.666428 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:36.666704 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:36.666975 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] PATH_INFO: `/v3/projects/9c68ee103aec4bdf9f1fac1e5ac685c2` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:36.668113 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c68ee103aec4bdf9f1fac1e5ac685c2)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:36.670075 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:36.692255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:36.721452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c68ee103aec4bdf9f1fac1e5ac685c2', 'request_id': 'req-dccc0049-a56f-48c4-aaf8-29defaae6026'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.729202 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c68ee103aec4bdf9f1fac1e5ac685c2', 'request_id': 'req-dccc0049-a56f-48c4-aaf8-29defaae6026'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.735516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c68ee103aec4bdf9f1fac1e5ac685c2', 'request_id': 'req-dccc0049-a56f-48c4-aaf8-29defaae6026'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.745868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] The token cache is being invalidate because project 9c68ee103aec4bdf9f1fac1e5ac685c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:36.746159 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.746794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.748286 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1376/2755] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:36 2022] DELETE /identity/v3/projects/9c68ee103aec4bdf9f1fac1e5ac685c2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:36.752860 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f0768-546c-46b7-9f96-a64287d1134b service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:36.762861 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f0768-546c-46b7-9f96-a64287d1134b service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:36.789801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:36.791347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:36.821089 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:36.821746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:36.822071 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:36.822388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] PATH_INFO: `/v3/users/cc5fe12a94e54511b51f329d44134777` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:36.823557 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5fe12a94e54511b51f329d44134777)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:36.825542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:36.848142 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc0049-a56f-48c4-aaf8-29defaae6026 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:36.852210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12e41d-fcf4-4a80-ac06-2596a5ae98c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:36.852957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12e41d-fcf4-4a80-ac06-2596a5ae98c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:36.853312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12e41d-fcf4-4a80-ac06-2596a5ae98c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:36.853656 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12e41d-fcf4-4a80-ac06-2596a5ae98c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:36.855650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3f12e41d-fcf4-4a80-ac06-2596a5ae98c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:36.872182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5fe12a94e54511b51f329d44134777'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.872902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5fe12a94e54511b51f329d44134777'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.881222 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5fe12a94e54511b51f329d44134777'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.888084 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5fe12a94e54511b51f329d44134777'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.888809 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5fe12a94e54511b51f329d44134777'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:36.907135 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1380/2756] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:36 2022] DELETE /identity/v3/users/cc5fe12a94e54511b51f329d44134777 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:36.920135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12e41d-fcf4-4a80-ac06-2596a5ae98c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:36.921650 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12e41d-fcf4-4a80-ac06-2596a5ae98c3 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:36.931885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1377/2757] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:37.222207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:37.224343 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:37.262358 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:37.299939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a67839-e0ac-4fe6-8be8-c72501ad5d32 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:37.305025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77a42d-7c3f-4f62-81bb-6727056f3178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:37.305696 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77a42d-7c3f-4f62-81bb-6727056f3178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:37.306108 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77a42d-7c3f-4f62-81bb-6727056f3178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:37.306394 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77a42d-7c3f-4f62-81bb-6727056f3178 admin admin] PATH_INFO: `/v3/projects/51f066110fab43f8a0c48a23d31bd48f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:37.307652 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77a42d-7c3f-4f62-81bb-6727056f3178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f066110fab43f8a0c48a23d31bd48f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:37.309774 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77a42d-7c3f-4f62-81bb-6727056f3178 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:37.360281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7d77a42d-7c3f-4f62-81bb-6727056f3178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f066110fab43f8a0c48a23d31bd48f', 'request_id': 'req-7d77a42d-7c3f-4f62-81bb-6727056f3178'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:37.366745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7d77a42d-7c3f-4f62-81bb-6727056f3178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f066110fab43f8a0c48a23d31bd48f', 'request_id': 'req-7d77a42d-7c3f-4f62-81bb-6727056f3178'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:37.373551 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7d77a42d-7c3f-4f62-81bb-6727056f3178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f066110fab43f8a0c48a23d31bd48f', 'request_id': 'req-7d77a42d-7c3f-4f62-81bb-6727056f3178'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:37.388154 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7d77a42d-7c3f-4f62-81bb-6727056f3178 admin admin] The token cache is being invalidate because project 51f066110fab43f8a0c48a23d31bd48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:37.388743 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7d77a42d-7c3f-4f62-81bb-6727056f3178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:37.389420 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7d77a42d-7c3f-4f62-81bb-6727056f3178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:37.390940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1381/2758] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:37 2022] DELETE /identity/v3/projects/51f066110fab43f8a0c48a23d31bd48f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:37.395967 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cf6e1-b39f-4b73-bc52-3c876156ce9a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:37.396877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cf6e1-b39f-4b73-bc52-3c876156ce9a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:37.397140 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cf6e1-b39f-4b73-bc52-3c876156ce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:37.454846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e29cf6e1-b39f-4b73-bc52-3c876156ce9a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:37.456046 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e29cf6e1-b39f-4b73-bc52-3c876156ce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:37.485425 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:37.522749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1378/2759] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:37.531843 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422cf64-b4a3-43ce-818a-30c24efbf4f4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:37.532124 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422cf64-b4a3-43ce-818a-30c24efbf4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:37.532390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422cf64-b4a3-43ce-818a-30c24efbf4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:37.557189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f422cf64-b4a3-43ce-818a-30c24efbf4f4 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:37.559244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f422cf64-b4a3-43ce-818a-30c24efbf4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:37.571444 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1382/2760] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:37.572690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cf6e1-b39f-4b73-bc52-3c876156ce9a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:37.583284 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cf6e1-b39f-4b73-bc52-3c876156ce9a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:37.588067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b0ba7-e60d-441b-907c-d122ea5e60e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:37.588695 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b0ba7-e60d-441b-907c-d122ea5e60e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:37.588999 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b0ba7-e60d-441b-907c-d122ea5e60e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:37.589271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b0ba7-e60d-441b-907c-d122ea5e60e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:37.589929 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b0ba7-e60d-441b-907c-d122ea5e60e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:31:37.590233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b0ba7-e60d-441b-907c-d122ea5e60e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:37.591871 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b0ba7-e60d-441b-907c-d122ea5e60e1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:37.604215 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1379/2761] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:31:37.609339 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422cf64-b4a3-43ce-818a-30c24efbf4f4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:37.618854 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422cf64-b4a3-43ce-818a-30c24efbf4f4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:37.623553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec37cd-8612-4f59-9fb8-b0d56940354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:37.624190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec37cd-8612-4f59-9fb8-b0d56940354d admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:37.624469 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec37cd-8612-4f59-9fb8-b0d56940354d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:37.624759 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec37cd-8612-4f59-9fb8-b0d56940354d admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:37.625408 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec37cd-8612-4f59-9fb8-b0d56940354d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:37.627323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec37cd-8612-4f59-9fb8-b0d56940354d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:37.662579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1383/2762] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:37 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:31:37.663877 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b0ba7-e60d-441b-907c-d122ea5e60e1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:37.674062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b0ba7-e60d-441b-907c-d122ea5e60e1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:37.734956 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b75ac-b83e-4d24-a7f7-987734f76adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:37.735556 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b75ac-b83e-4d24-a7f7-987734f76adb admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:37.735861 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b75ac-b83e-4d24-a7f7-987734f76adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:37.736132 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b75ac-b83e-4d24-a7f7-987734f76adb admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:37.736816 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b75ac-b83e-4d24-a7f7-987734f76adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:37.738788 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b75ac-b83e-4d24-a7f7-987734f76adb admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:37.764591 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1380/2763] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:37 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:31:37.766141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec37cd-8612-4f59-9fb8-b0d56940354d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:37.777046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec37cd-8612-4f59-9fb8-b0d56940354d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:37.782011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf7aac-b36d-41c7-bccf-89a63a5b15ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:37.782632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf7aac-b36d-41c7-bccf-89a63a5b15ad admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:37.782893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf7aac-b36d-41c7-bccf-89a63a5b15ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:37.783181 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf7aac-b36d-41c7-bccf-89a63a5b15ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:37.784182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf7aac-b36d-41c7-bccf-89a63a5b15ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:37.786015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf7aac-b36d-41c7-bccf-89a63a5b15ad admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:37.796441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1384/2764] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:37.800863 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b75ac-b83e-4d24-a7f7-987734f76adb admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:37.811763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b75ac-b83e-4d24-a7f7-987734f76adb admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:37.817114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5f238-0d10-4c8a-b6fc-b20c06f59caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:37.818147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f238-0d10-4c8a-b6fc-b20c06f59caf admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:37.818147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f238-0d10-4c8a-b6fc-b20c06f59caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:37.818572 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f238-0d10-4c8a-b6fc-b20c06f59caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:37.819075 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5f238-0d10-4c8a-b6fc-b20c06f59caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:37.820692 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5f238-0d10-4c8a-b6fc-b20c06f59caf admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:37.831966 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1381/2765] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:37.836693 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf7aac-b36d-41c7-bccf-89a63a5b15ad admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:37.847182 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf7aac-b36d-41c7-bccf-89a63a5b15ad admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:37.851976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1722103-8eb7-4c61-bac4-d12b4313582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:37.852649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1722103-8eb7-4c61-bac4-d12b4313582e admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:37.852952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1722103-8eb7-4c61-bac4-d12b4313582e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:37.853225 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1722103-8eb7-4c61-bac4-d12b4313582e admin admin] PATH_INFO: `/v3/projects/b8cf8e783a4945feab7a8954e059c433/users/595061ceb9a4418d8e7f9be47bb7771a/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:37.868850 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1722103-8eb7-4c61-bac4-d12b4313582e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8cf8e783a4945feab7a8954e059c433, user_id=595061ceb9a4418d8e7f9be47bb7771a, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:37.871597 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1722103-8eb7-4c61-bac4-d12b4313582e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:37.885460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1385/2766] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:37 2022] PUT /identity/v3/projects/b8cf8e783a4945feab7a8954e059c433/users/595061ceb9a4418d8e7f9be47bb7771a/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:37.896237 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702c6b-79d9-4839-ad01-b6ad89241a2d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:37.896525 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702c6b-79d9-4839-ad01-b6ad89241a2d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:37.896831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702c6b-79d9-4839-ad01-b6ad89241a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:37.925508 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-78702c6b-79d9-4839-ad01-b6ad89241a2d None None] MFA Rules not processed for user `595061ceb9a4418d8e7f9be47bb7771a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:37.926763 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-78702c6b-79d9-4839-ad01-b6ad89241a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:37.991617 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1382/2767] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:37.996001 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1722103-8eb7-4c61-bac4-d12b4313582e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:38.049682 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:38.060986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1722103-8eb7-4c61-bac4-d12b4313582e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:38.068828 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11188de-62c7-4112-9db9-934800f4d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:38.069511 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11188de-62c7-4112-9db9-934800f4d9cb admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:38.069752 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11188de-62c7-4112-9db9-934800f4d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:38.070049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11188de-62c7-4112-9db9-934800f4d9cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:38.070879 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11188de-62c7-4112-9db9-934800f4d9cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:38.073156 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11188de-62c7-4112-9db9-934800f4d9cb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:38.112142 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1386/2768] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:37 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:38.113472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78702c6b-79d9-4839-ad01-b6ad89241a2d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:38.124859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78702c6b-79d9-4839-ad01-b6ad89241a2d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:38.152431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:38.186192 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39182c7-450e-41a6-a2a5-7dafaec9661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:38.186884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39182c7-450e-41a6-a2a5-7dafaec9661e admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:38.187160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39182c7-450e-41a6-a2a5-7dafaec9661e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:38.187431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39182c7-450e-41a6-a2a5-7dafaec9661e admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:38.188057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39182c7-450e-41a6-a2a5-7dafaec9661e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:38.190032 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39182c7-450e-41a6-a2a5-7dafaec9661e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:38.213618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1383/2769] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:38 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:38.217896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11188de-62c7-4112-9db9-934800f4d9cb admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:38.228958 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11188de-62c7-4112-9db9-934800f4d9cb admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:38.235311 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2c5d1-9ca0-44b1-ad8e-c657cbd50d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:38.235955 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2c5d1-9ca0-44b1-ad8e-c657cbd50d60 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:38.236236 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2c5d1-9ca0-44b1-ad8e-c657cbd50d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:38.236510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2c5d1-9ca0-44b1-ad8e-c657cbd50d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:38.237339 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2c5d1-9ca0-44b1-ad8e-c657cbd50d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:38.239011 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2c5d1-9ca0-44b1-ad8e-c657cbd50d60 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:38.253055 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1387/2770] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:38.257557 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39182c7-450e-41a6-a2a5-7dafaec9661e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:38.268598 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39182c7-450e-41a6-a2a5-7dafaec9661e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:38.274646 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81811b6-ddef-4f57-ac03-9f28224920ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:38.275585 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81811b6-ddef-4f57-ac03-9f28224920ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:38.275749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81811b6-ddef-4f57-ac03-9f28224920ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:38.276002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81811b6-ddef-4f57-ac03-9f28224920ac admin admin] PATH_INFO: `/v3/projects/c40ea57d0da54b4288a859d17afeaf2a/users/1e0fb257a5d24d5ab76256b23bc057a5/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:38.293298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81811b6-ddef-4f57-ac03-9f28224920ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40ea57d0da54b4288a859d17afeaf2a, user_id=1e0fb257a5d24d5ab76256b23bc057a5, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:38.295959 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81811b6-ddef-4f57-ac03-9f28224920ac admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:38.310414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1384/2771] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:38 2022] PUT /identity/v3/projects/c40ea57d0da54b4288a859d17afeaf2a/users/1e0fb257a5d24d5ab76256b23bc057a5/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:38.314806 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2c5d1-9ca0-44b1-ad8e-c657cbd50d60 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:38.325540 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2c5d1-9ca0-44b1-ad8e-c657cbd50d60 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:38.384438 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1d7de-bf19-4740-a828-f4c7c8460c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:38.385032 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1d7de-bf19-4740-a828-f4c7c8460c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:38.385313 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1d7de-bf19-4740-a828-f4c7c8460c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:38.385587 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1d7de-bf19-4740-a828-f4c7c8460c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:38.386248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1d7de-bf19-4740-a828-f4c7c8460c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:38.387929 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1d7de-bf19-4740-a828-f4c7c8460c3c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:38.398735 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1388/2772] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:38.404120 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81811b6-ddef-4f57-ac03-9f28224920ac admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:38.416205 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81811b6-ddef-4f57-ac03-9f28224920ac admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:38.422014 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5021-ad2f-45c7-8374-d28ddf60c202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:38.422717 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5021-ad2f-45c7-8374-d28ddf60c202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:38.422998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5021-ad2f-45c7-8374-d28ddf60c202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:38.423273 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5021-ad2f-45c7-8374-d28ddf60c202 admin admin] PATH_INFO: `/v3/projects/c40ea57d0da54b4288a859d17afeaf2a/users/1e0fb257a5d24d5ab76256b23bc057a5/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:38.425452 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb5021-ad2f-45c7-8374-d28ddf60c202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40ea57d0da54b4288a859d17afeaf2a, user_id=1e0fb257a5d24d5ab76256b23bc057a5, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:38.428216 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb5021-ad2f-45c7-8374-d28ddf60c202 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:38.439685 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1385/2773] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:38 2022] PUT /identity/v3/projects/c40ea57d0da54b4288a859d17afeaf2a/users/1e0fb257a5d24d5ab76256b23bc057a5/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:38.450323 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c65a-62e3-4c9c-9496-558468080878 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:38.450689 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c65a-62e3-4c9c-9496-558468080878 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:38.450964 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c65a-62e3-4c9c-9496-558468080878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:38.479057 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5e62c65a-62e3-4c9c-9496-558468080878 None None] MFA Rules not processed for user `1e0fb257a5d24d5ab76256b23bc057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:38.480319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5e62c65a-62e3-4c9c-9496-558468080878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:38.570087 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1389/2774] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:38.582389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5021-ad2f-45c7-8374-d28ddf60c202 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:38.584486 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e8fb5021-ad2f-45c7-8374-d28ddf60c202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:38.664481 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5021-ad2f-45c7-8374-d28ddf60c202 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:38.669366 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc4a3a-e6e3-42cc-9b7c-5691b9b07117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:38.670567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc4a3a-e6e3-42cc-9b7c-5691b9b07117 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:38.670925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc4a3a-e6e3-42cc-9b7c-5691b9b07117 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:38.671285 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc4a3a-e6e3-42cc-9b7c-5691b9b07117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:38.733722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc4a3a-e6e3-42cc-9b7c-5691b9b07117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:38.735300 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc4a3a-e6e3-42cc-9b7c-5691b9b07117 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:38.745529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1386/2775] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:46.540699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c65a-62e3-4c9c-9496-558468080878 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:46.551410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c65a-62e3-4c9c-9496-558468080878 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:46.556179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97aab3-4abc-469a-9c4d-008d87762632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:46.556838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97aab3-4abc-469a-9c4d-008d87762632 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:46.557118 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97aab3-4abc-469a-9c4d-008d87762632 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:46.557389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97aab3-4abc-469a-9c4d-008d87762632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:46.567081 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97aab3-4abc-469a-9c4d-008d87762632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:46.568554 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97aab3-4abc-469a-9c4d-008d87762632 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:46.578441 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1390/2776] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:31:48.740810 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:52.249163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc4a3a-e6e3-42cc-9b7c-5691b9b07117 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:52.250759 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6ddc4a3a-e6e3-42cc-9b7c-5691b9b07117 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:52.321342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc4a3a-e6e3-42cc-9b7c-5691b9b07117 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:52.325932 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:52.326580 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:52.328780 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:52.329118 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] PATH_INFO: `/v3/users/9c1cf31f1d984e6dab334296cceef22b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:52.330337 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1cf31f1d984e6dab334296cceef22b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:52.332424 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:52.383875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1cf31f1d984e6dab334296cceef22b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:52.397577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1cf31f1d984e6dab334296cceef22b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:52.398124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1cf31f1d984e6dab334296cceef22b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:52.405642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1cf31f1d984e6dab334296cceef22b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:52.415738 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1cf31f1d984e6dab334296cceef22b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:52.423004 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1387/2777] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:31:52 2022] DELETE /identity/v3/users/9c1cf31f1d984e6dab334296cceef22b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:52.427981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb2ab-c9d4-41ed-a117-82004764bf36 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:52.429157 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb2ab-c9d4-41ed-a117-82004764bf36 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:52.429577 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb2ab-c9d4-41ed-a117-82004764bf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:52.451625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e0cdb2ab-c9d4-41ed-a117-82004764bf36 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:52.453594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e0cdb2ab-c9d4-41ed-a117-82004764bf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:52.497295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:52.529783 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1391/2778] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:31:52.540074 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:52.541679 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:52.627893 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a757d-430c-4894-9c12-cd15ad051d3f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:52.632613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05efc9-8425-4e72-ae8b-182fc1326ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:52.633294 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05efc9-8425-4e72-ae8b-182fc1326ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:52.633575 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05efc9-8425-4e72-ae8b-182fc1326ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:52.633852 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05efc9-8425-4e72-ae8b-182fc1326ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:52.644368 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05efc9-8425-4e72-ae8b-182fc1326ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:52.645866 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05efc9-8425-4e72-ae8b-182fc1326ff7 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:52.655693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1388/2779] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:31:52.942575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdb2ab-c9d4-41ed-a117-82004764bf36 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:52.944080 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e0cdb2ab-c9d4-41ed-a117-82004764bf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:52.957573 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdb2ab-c9d4-41ed-a117-82004764bf36 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:52.962324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98558140-0aa9-4aec-a053-23c46e97e870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:52.962992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98558140-0aa9-4aec-a053-23c46e97e870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:52.963273 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98558140-0aa9-4aec-a053-23c46e97e870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:52.963635 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98558140-0aa9-4aec-a053-23c46e97e870 admin admin] PATH_INFO: `/v3/projects/f95a72d996824d2f958dac5e599e92c7` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:52.964799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98558140-0aa9-4aec-a053-23c46e97e870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95a72d996824d2f958dac5e599e92c7)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:52.966920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98558140-0aa9-4aec-a053-23c46e97e870 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:53.016227 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-98558140-0aa9-4aec-a053-23c46e97e870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95a72d996824d2f958dac5e599e92c7', 'request_id': 'req-98558140-0aa9-4aec-a053-23c46e97e870'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:53.022280 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-98558140-0aa9-4aec-a053-23c46e97e870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95a72d996824d2f958dac5e599e92c7', 'request_id': 'req-98558140-0aa9-4aec-a053-23c46e97e870'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:53.029048 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-98558140-0aa9-4aec-a053-23c46e97e870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95a72d996824d2f958dac5e599e92c7', 'request_id': 'req-98558140-0aa9-4aec-a053-23c46e97e870'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:53.043715 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-98558140-0aa9-4aec-a053-23c46e97e870 admin admin] The token cache is being invalidate because project f95a72d996824d2f958dac5e599e92c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:31:53.044012 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-98558140-0aa9-4aec-a053-23c46e97e870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:53.044657 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-98558140-0aa9-4aec-a053-23c46e97e870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:31:53.046164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1392/2780] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:31:52 2022] DELETE /identity/v3/projects/f95a72d996824d2f958dac5e599e92c7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:53.051516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d19739-3005-4233-96be-e6d2e8693458 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:53.051806 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d19739-3005-4233-96be-e6d2e8693458 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:53.052181 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d19739-3005-4233-96be-e6d2e8693458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:53.061228 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:53.077303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-61d19739-3005-4233-96be-e6d2e8693458 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:53.078524 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-61d19739-3005-4233-96be-e6d2e8693458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:53.143031 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1389/2781] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:53.152224 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a19697-cd44-45b4-94cb-bc96e03e9844 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:53.152514 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a19697-cd44-45b4-94cb-bc96e03e9844 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:53.152824 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a19697-cd44-45b4-94cb-bc96e03e9844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:53.180733 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d9a19697-cd44-45b4-94cb-bc96e03e9844 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:53.182049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d9a19697-cd44-45b4-94cb-bc96e03e9844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:53.191849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1393/2782] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:53.196320 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d19739-3005-4233-96be-e6d2e8693458 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:53.206636 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d19739-3005-4233-96be-e6d2e8693458 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:53.213780 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab8a01-aaa7-4a83-bbf1-4df84d1d01ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:53.214394 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab8a01-aaa7-4a83-bbf1-4df84d1d01ba admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:53.214677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab8a01-aaa7-4a83-bbf1-4df84d1d01ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:53.214951 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab8a01-aaa7-4a83-bbf1-4df84d1d01ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:53.215604 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab8a01-aaa7-4a83-bbf1-4df84d1d01ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:31:53.215905 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab8a01-aaa7-4a83-bbf1-4df84d1d01ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:53.217553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab8a01-aaa7-4a83-bbf1-4df84d1d01ba admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:53.229906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1390/2783] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:31:53.234463 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a19697-cd44-45b4-94cb-bc96e03e9844 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:53.244243 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a19697-cd44-45b4-94cb-bc96e03e9844 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:53.250413 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d415e3-514d-4fe7-9308-77da9acb9b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:53.251019 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d415e3-514d-4fe7-9308-77da9acb9b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:53.251298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d415e3-514d-4fe7-9308-77da9acb9b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:53.251553 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d415e3-514d-4fe7-9308-77da9acb9b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:53.252187 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d415e3-514d-4fe7-9308-77da9acb9b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:53.254153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d415e3-514d-4fe7-9308-77da9acb9b87 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:53.284913 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1394/2784] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:53 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:53.289253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab8a01-aaa7-4a83-bbf1-4df84d1d01ba admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:53.299480 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab8a01-aaa7-4a83-bbf1-4df84d1d01ba admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:53.357819 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2664d-e4b2-4196-b28c-b6c5e3053e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:53.358431 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2664d-e4b2-4196-b28c-b6c5e3053e40 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:53.358742 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2664d-e4b2-4196-b28c-b6c5e3053e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:53.359020 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2664d-e4b2-4196-b28c-b6c5e3053e40 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:53.359672 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2664d-e4b2-4196-b28c-b6c5e3053e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:53.361642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2664d-e4b2-4196-b28c-b6c5e3053e40 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:53.385214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1391/2785] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:53 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:53.389510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d415e3-514d-4fe7-9308-77da9acb9b87 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:53.399938 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d415e3-514d-4fe7-9308-77da9acb9b87 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:53.405176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3a7a8-3bec-4347-9e49-81e17a9d8376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:53.405940 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3a7a8-3bec-4347-9e49-81e17a9d8376 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:53.406234 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3a7a8-3bec-4347-9e49-81e17a9d8376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:53.406506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3a7a8-3bec-4347-9e49-81e17a9d8376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:53.407147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3a7a8-3bec-4347-9e49-81e17a9d8376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:53.408773 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3a7a8-3bec-4347-9e49-81e17a9d8376 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:53.419723 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1395/2786] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:53.425777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2664d-e4b2-4196-b28c-b6c5e3053e40 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:53.437941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2664d-e4b2-4196-b28c-b6c5e3053e40 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:53.443521 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd119c07-02b3-4982-8f7d-d562a9dc8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:53.444120 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd119c07-02b3-4982-8f7d-d562a9dc8e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:53.444393 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd119c07-02b3-4982-8f7d-d562a9dc8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:53.444662 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd119c07-02b3-4982-8f7d-d562a9dc8e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:53.445343 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd119c07-02b3-4982-8f7d-d562a9dc8e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:53.446935 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd119c07-02b3-4982-8f7d-d562a9dc8e07 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:53.457868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1392/2787] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:53.462150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3a7a8-3bec-4347-9e49-81e17a9d8376 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:53.473070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3a7a8-3bec-4347-9e49-81e17a9d8376 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:53.478857 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc4d48-eeff-4e95-af1a-1affa8300486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:53.479520 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc4d48-eeff-4e95-af1a-1affa8300486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:53.479799 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc4d48-eeff-4e95-af1a-1affa8300486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:53.480067 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc4d48-eeff-4e95-af1a-1affa8300486 admin admin] PATH_INFO: `/v3/projects/c26abe1c65a24c8796880a82af3627e0/users/6fc89be7205648b889aeaa6b072d641b/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:53.497966 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc4d48-eeff-4e95-af1a-1affa8300486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26abe1c65a24c8796880a82af3627e0, user_id=6fc89be7205648b889aeaa6b072d641b, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:53.501569 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc4d48-eeff-4e95-af1a-1affa8300486 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:53.524737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1396/2788] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:53 2022] PUT /identity/v3/projects/c26abe1c65a24c8796880a82af3627e0/users/6fc89be7205648b889aeaa6b072d641b/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:31:53.524851 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2943024-4494-4659-accd-a2ce114b11a0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:53.525045 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2943024-4494-4659-accd-a2ce114b11a0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:53.525317 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2943024-4494-4659-accd-a2ce114b11a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:53.545627 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b2943024-4494-4659-accd-a2ce114b11a0 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:53.546831 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b2943024-4494-4659-accd-a2ce114b11a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:53.607977 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1393/2789] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:53.617770 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc4d48-eeff-4e95-af1a-1affa8300486 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:53.619760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-22bc4d48-eeff-4e95-af1a-1affa8300486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:53.677241 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc4d48-eeff-4e95-af1a-1affa8300486 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:53.681415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ffc47-2ee3-4fd4-83b0-b61b1de4964e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:53.682029 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ffc47-2ee3-4fd4-83b0-b61b1de4964e service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:53.682298 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ffc47-2ee3-4fd4-83b0-b61b1de4964e service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:53.682569 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ffc47-2ee3-4fd4-83b0-b61b1de4964e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:53.692214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ffc47-2ee3-4fd4-83b0-b61b1de4964e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:53.693692 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ffc47-2ee3-4fd4-83b0-b61b1de4964e service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:53.697647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:53.704782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1397/2790] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:31:57.980881 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea19fe-bdc5-4854-9d3a-a0bc32fc3e15 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:57.981518 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea19fe-bdc5-4854-9d3a-a0bc32fc3e15 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:57.981518 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea19fe-bdc5-4854-9d3a-a0bc32fc3e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:58.003465 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:58.016555 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-64ea19fe-bdc5-4854-9d3a-a0bc32fc3e15 None None] MFA Rules not processed for user `6fc89be7205648b889aeaa6b072d641b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:31:58.018049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-64ea19fe-bdc5-4854-9d3a-a0bc32fc3e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:31:58.133034 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1394/2791] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:31:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:31:58.137763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ffc47-2ee3-4fd4-83b0-b61b1de4964e service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:58.148976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ffc47-2ee3-4fd4-83b0-b61b1de4964e service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:58.154558 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e823b-5ed7-4897-bcde-806193c444a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:58.155492 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e823b-5ed7-4897-bcde-806193c444a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:58.155765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e823b-5ed7-4897-bcde-806193c444a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:58.156278 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e823b-5ed7-4897-bcde-806193c444a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:58.157113 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e823b-5ed7-4897-bcde-806193c444a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:58.159686 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e823b-5ed7-4897-bcde-806193c444a1 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:58.194440 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1398/2792] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:31:58 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:58.198779 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea19fe-bdc5-4854-9d3a-a0bc32fc3e15 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:58.211355 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea19fe-bdc5-4854-9d3a-a0bc32fc3e15 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:58.279262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e4170-957d-4729-9f4c-c29bc29f9cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:58.279931 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e4170-957d-4729-9f4c-c29bc29f9cac admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:58.280202 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e4170-957d-4729-9f4c-c29bc29f9cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:58.280818 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e4170-957d-4729-9f4c-c29bc29f9cac admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:58.281520 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e4170-957d-4729-9f4c-c29bc29f9cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:58.284982 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e4170-957d-4729-9f4c-c29bc29f9cac admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:58.307177 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1395/2793] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:31:58 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:31:58.311600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e823b-5ed7-4897-bcde-806193c444a1 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:58.325547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e823b-5ed7-4897-bcde-806193c444a1 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:58.330943 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea0053-2ca1-4b84-b2c3-56fb89f58e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:58.331705 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea0053-2ca1-4b84-b2c3-56fb89f58e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:58.331991 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea0053-2ca1-4b84-b2c3-56fb89f58e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:58.332261 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea0053-2ca1-4b84-b2c3-56fb89f58e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:58.332939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea0053-2ca1-4b84-b2c3-56fb89f58e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:58.334578 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea0053-2ca1-4b84-b2c3-56fb89f58e48 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:58.346075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1399/2794] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:31:58.350418 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e4170-957d-4729-9f4c-c29bc29f9cac admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:58.361948 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e4170-957d-4729-9f4c-c29bc29f9cac admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:58.366866 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e3474-0078-4484-ba01-9abcec843150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:58.367575 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3474-0078-4484-ba01-9abcec843150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:58.367858 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3474-0078-4484-ba01-9abcec843150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:58.368145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3474-0078-4484-ba01-9abcec843150 admin admin] PATH_INFO: `/v3/projects/7dd52dbea2764162868b0c78ebe2cd80/users/001520b6b3c140cfb3d7849a6bfb553f/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:58.385145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e3474-0078-4484-ba01-9abcec843150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd52dbea2764162868b0c78ebe2cd80, user_id=001520b6b3c140cfb3d7849a6bfb553f, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:58.387958 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e3474-0078-4484-ba01-9abcec843150 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:58.406844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1396/2795] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:58 2022] PUT /identity/v3/projects/7dd52dbea2764162868b0c78ebe2cd80/users/001520b6b3c140cfb3d7849a6bfb553f/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:31:58.410355 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea0053-2ca1-4b84-b2c3-56fb89f58e48 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:58.420937 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea0053-2ca1-4b84-b2c3-56fb89f58e48 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:58.491853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3ffa1-a610-44b7-bba3-ebaa8c94238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:58.492591 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3ffa1-a610-44b7-bba3-ebaa8c94238d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:58.492930 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3ffa1-a610-44b7-bba3-ebaa8c94238d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:58.493321 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3ffa1-a610-44b7-bba3-ebaa8c94238d admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:58.494256 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3ffa1-a610-44b7-bba3-ebaa8c94238d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:58.495888 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3ffa1-a610-44b7-bba3-ebaa8c94238d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:58.509334 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1400/2796] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:31:58.511175 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e3474-0078-4484-ba01-9abcec843150 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:31:58.526745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e3474-0078-4484-ba01-9abcec843150 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:31:58.533747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2836d-9d0e-4119-8cb0-4e2f1216974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:31:58.534199 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2836d-9d0e-4119-8cb0-4e2f1216974f admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:31:58.534794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2836d-9d0e-4119-8cb0-4e2f1216974f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:31:58.535060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2836d-9d0e-4119-8cb0-4e2f1216974f admin admin] PATH_INFO: `/v3/projects/7dd52dbea2764162868b0c78ebe2cd80/users/001520b6b3c140cfb3d7849a6bfb553f/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:31:58.537368 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2836d-9d0e-4119-8cb0-4e2f1216974f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd52dbea2764162868b0c78ebe2cd80, user_id=001520b6b3c140cfb3d7849a6bfb553f, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:31:58.542183 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2836d-9d0e-4119-8cb0-4e2f1216974f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:31:58.551609 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1397/2797] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:31:58 2022] PUT /identity/v3/projects/7dd52dbea2764162868b0c78ebe2cd80/users/001520b6b3c140cfb3d7849a6bfb553f/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:03.313874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3abe56-6927-44e1-a1bd-c23448441c2a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:03.314478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3abe56-6927-44e1-a1bd-c23448441c2a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:03.314478 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3abe56-6927-44e1-a1bd-c23448441c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:03.349602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9c3abe56-6927-44e1-a1bd-c23448441c2a None None] MFA Rules not processed for user `001520b6b3c140cfb3d7849a6bfb553f`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:03.350905 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9c3abe56-6927-44e1-a1bd-c23448441c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:03.429532 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1401/2798] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:03.442022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2836d-9d0e-4119-8cb0-4e2f1216974f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:03.443896 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-38e2836d-9d0e-4119-8cb0-4e2f1216974f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:03.502777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2836d-9d0e-4119-8cb0-4e2f1216974f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:03.506710 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3248a-ccac-487e-86ac-498930baa696 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ee7b50c34742ce896a734f3ef34a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:03.507468 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3248a-ccac-487e-86ac-498930baa696 service glance] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:03.507849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3248a-ccac-487e-86ac-498930baa696 service glance] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:03.508372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3248a-ccac-487e-86ac-498930baa696 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:03.513107 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:03.575734 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3248a-ccac-487e-86ac-498930baa696 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:03.577008 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3248a-ccac-487e-86ac-498930baa696 service glance] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:03.586145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1398/2799] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:32:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:32:03.715694 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9a1e-8084-4b7e-b741-553963327799 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:03.716049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9a1e-8084-4b7e-b741-553963327799 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:03.716290 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9a1e-8084-4b7e-b741-553963327799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:03.747632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-610b9a1e-8084-4b7e-b741-553963327799 None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:03.748978 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-610b9a1e-8084-4b7e-b741-553963327799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:03.784258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:03.818114 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1402/2800] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:32:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:03.875423 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3248a-ccac-487e-86ac-498930baa696 service glance] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:03.876984 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-19a3248a-ccac-487e-86ac-498930baa696 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:03.955051 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3248a-ccac-487e-86ac-498930baa696 service glance] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:03.961412 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dc032-7be1-4e5e-9fab-20ee981034eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:03.962035 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dc032-7be1-4e5e-9fab-20ee981034eb service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:03.962312 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dc032-7be1-4e5e-9fab-20ee981034eb service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:03.962589 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dc032-7be1-4e5e-9fab-20ee981034eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:03.973546 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dc032-7be1-4e5e-9fab-20ee981034eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:03.975382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dc032-7be1-4e5e-9fab-20ee981034eb service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:03.984497 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1399/2801] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:32:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:32:12.179100 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9a1e-8084-4b7e-b741-553963327799 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:12.180644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-610b9a1e-8084-4b7e-b741-553963327799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:12.261563 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9a1e-8084-4b7e-b741-553963327799 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:12.266765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:12.267405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:12.267678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:12.267945 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] PATH_INFO: `/v3/users/595061ceb9a4418d8e7f9be47bb7771a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:12.269199 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=595061ceb9a4418d8e7f9be47bb7771a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:12.271146 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:12.323842 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595061ceb9a4418d8e7f9be47bb7771a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:12.325018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595061ceb9a4418d8e7f9be47bb7771a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:12.335386 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595061ceb9a4418d8e7f9be47bb7771a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:12.343244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595061ceb9a4418d8e7f9be47bb7771a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:12.344217 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595061ceb9a4418d8e7f9be47bb7771a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:12.363594 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1403/2802] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:32:12 2022] DELETE /identity/v3/users/595061ceb9a4418d8e7f9be47bb7771a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:12.368389 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baa158-0714-43bf-b28c-b7b0340b4001 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:12.368914 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baa158-0714-43bf-b28c-b7b0340b4001 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:12.369094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baa158-0714-43bf-b28c-b7b0340b4001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:12.389141 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d4baa158-0714-43bf-b28c-b7b0340b4001 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:12.390481 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d4baa158-0714-43bf-b28c-b7b0340b4001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:12.468749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1400/2803] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:32:12.479705 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:12.481212 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:12.545805 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f3e52-876c-4085-97af-7d464c36dbc4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:12.549706 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe72e2a-5122-4d1c-985d-36427dda1cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:12.550326 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe72e2a-5122-4d1c-985d-36427dda1cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:12.550606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe72e2a-5122-4d1c-985d-36427dda1cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:12.550876 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe72e2a-5122-4d1c-985d-36427dda1cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:12.561389 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe72e2a-5122-4d1c-985d-36427dda1cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:12.562863 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe72e2a-5122-4d1c-985d-36427dda1cb2 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:12.567169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:12.575721 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1404/2804] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:32:12.669755 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03394043-d2aa-4a19-9061-ecae33dc9cf3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:12.670094 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03394043-d2aa-4a19-9061-ecae33dc9cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:12.670372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03394043-d2aa-4a19-9061-ecae33dc9cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:12.691606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-03394043-d2aa-4a19-9061-ecae33dc9cf3 None None] MFA Rules not processed for user `6fc89be7205648b889aeaa6b072d641b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:12.692892 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-03394043-d2aa-4a19-9061-ecae33dc9cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:12.724828 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:12.756838 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1401/2805] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:12.880530 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe72e2a-5122-4d1c-985d-36427dda1cb2 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:12.883220 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bfe72e2a-5122-4d1c-985d-36427dda1cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:12.906502 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe72e2a-5122-4d1c-985d-36427dda1cb2 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:12.912415 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:12.913184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:12.913554 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:12.913941 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] PATH_INFO: `/v3/projects/b8cf8e783a4945feab7a8954e059c433` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:12.915204 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8cf8e783a4945feab7a8954e059c433)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:12.917267 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:12.970952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8cf8e783a4945feab7a8954e059c433', 'request_id': 'req-879af190-f2ef-4779-969a-1ccf917ce984'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:12.977292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8cf8e783a4945feab7a8954e059c433', 'request_id': 'req-879af190-f2ef-4779-969a-1ccf917ce984'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:12.984508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8cf8e783a4945feab7a8954e059c433', 'request_id': 'req-879af190-f2ef-4779-969a-1ccf917ce984'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.000519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] The token cache is being invalidate because project b8cf8e783a4945feab7a8954e059c433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:32:13.000856 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.001519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.003074 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1405/2806] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:32:12 2022] DELETE /identity/v3/projects/b8cf8e783a4945feab7a8954e059c433 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:13.007770 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03394043-d2aa-4a19-9061-ecae33dc9cf3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:13.019690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03394043-d2aa-4a19-9061-ecae33dc9cf3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:13.089289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d217c1-cad0-49fb-9811-e6a0bc3f8f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:13.090361 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d217c1-cad0-49fb-9811-e6a0bc3f8f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:13.090637 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d217c1-cad0-49fb-9811-e6a0bc3f8f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:13.090945 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d217c1-cad0-49fb-9811-e6a0bc3f8f25 admin admin] PATH_INFO: `/v3/users/1e0fb257a5d24d5ab76256b23bc057a5` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:13.092145 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d217c1-cad0-49fb-9811-e6a0bc3f8f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0fb257a5d24d5ab76256b23bc057a5)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:13.094114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d217c1-cad0-49fb-9811-e6a0bc3f8f25 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:13.174102 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-58d217c1-cad0-49fb-9811-e6a0bc3f8f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0fb257a5d24d5ab76256b23bc057a5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.191071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-58d217c1-cad0-49fb-9811-e6a0bc3f8f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0fb257a5d24d5ab76256b23bc057a5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.191971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-58d217c1-cad0-49fb-9811-e6a0bc3f8f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0fb257a5d24d5ab76256b23bc057a5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.200236 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-58d217c1-cad0-49fb-9811-e6a0bc3f8f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0fb257a5d24d5ab76256b23bc057a5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.211857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-58d217c1-cad0-49fb-9811-e6a0bc3f8f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0fb257a5d24d5ab76256b23bc057a5'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.231693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1402/2807] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:32:13 2022] DELETE /identity/v3/users/1e0fb257a5d24d5ab76256b23bc057a5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:13.569737 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:13.572327 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:13.589388 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879af190-f2ef-4779-969a-1ccf917ce984 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:13.655125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1913bf-107c-4c76-83de-1658a5243209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:13.655917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1913bf-107c-4c76-83de-1658a5243209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:13.656196 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1913bf-107c-4c76-83de-1658a5243209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:13.656471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1913bf-107c-4c76-83de-1658a5243209 admin admin] PATH_INFO: `/v3/projects/c40ea57d0da54b4288a859d17afeaf2a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:13.657736 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1913bf-107c-4c76-83de-1658a5243209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40ea57d0da54b4288a859d17afeaf2a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:13.659668 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1913bf-107c-4c76-83de-1658a5243209 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:13.711811 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3b1913bf-107c-4c76-83de-1658a5243209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40ea57d0da54b4288a859d17afeaf2a', 'request_id': 'req-3b1913bf-107c-4c76-83de-1658a5243209'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.717988 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3b1913bf-107c-4c76-83de-1658a5243209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40ea57d0da54b4288a859d17afeaf2a', 'request_id': 'req-3b1913bf-107c-4c76-83de-1658a5243209'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.725524 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3b1913bf-107c-4c76-83de-1658a5243209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40ea57d0da54b4288a859d17afeaf2a', 'request_id': 'req-3b1913bf-107c-4c76-83de-1658a5243209'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.739662 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3b1913bf-107c-4c76-83de-1658a5243209 admin admin] The token cache is being invalidate because project c40ea57d0da54b4288a859d17afeaf2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:32:13.740110 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3b1913bf-107c-4c76-83de-1658a5243209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.740952 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3b1913bf-107c-4c76-83de-1658a5243209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:13.742465 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1406/2808] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:32:13 2022] DELETE /identity/v3/projects/c40ea57d0da54b4288a859d17afeaf2a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:32:13.747472 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0057f-0c8f-425a-898b-745fff1927a3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:13.748002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0057f-0c8f-425a-898b-745fff1927a3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:13.748002 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0057f-0c8f-425a-898b-745fff1927a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:13.768359 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-56d0057f-0c8f-425a-898b-745fff1927a3 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:13.770515 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-56d0057f-0c8f-425a-898b-745fff1927a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:13.824084 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:13.835561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1403/2809] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:13.843734 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c07930-d1e3-45dd-b12b-e4b408ad609a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:13.844165 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c07930-d1e3-45dd-b12b-e4b408ad609a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:13.845151 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c07930-d1e3-45dd-b12b-e4b408ad609a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:13.871633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-54c07930-d1e3-45dd-b12b-e4b408ad609a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:13.873091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-54c07930-d1e3-45dd-b12b-e4b408ad609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:13.881701 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1407/2810] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:13.886351 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0057f-0c8f-425a-898b-745fff1927a3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:13.897432 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0057f-0c8f-425a-898b-745fff1927a3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:13.902307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ee56b-3833-4c3a-90c8-5ba0cb08347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:13.902925 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ee56b-3833-4c3a-90c8-5ba0cb08347e admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:13.903209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ee56b-3833-4c3a-90c8-5ba0cb08347e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:13.903483 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ee56b-3833-4c3a-90c8-5ba0cb08347e admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:13.904334 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ee56b-3833-4c3a-90c8-5ba0cb08347e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:32:13.904648 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ee56b-3833-4c3a-90c8-5ba0cb08347e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:13.906805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ee56b-3833-4c3a-90c8-5ba0cb08347e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:13.921878 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1404/2811] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:32:13.926486 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c07930-d1e3-45dd-b12b-e4b408ad609a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:13.931358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ee56b-3833-4c3a-90c8-5ba0cb08347e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:13.933042 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:13.933309 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-657ee56b-3833-4c3a-90c8-5ba0cb08347e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:13.937724 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c07930-d1e3-45dd-b12b-e4b408ad609a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:13.944176 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37d06b-6e26-418d-911a-6040c69a4dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:13.944841 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37d06b-6e26-418d-911a-6040c69a4dab admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:13.945366 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37d06b-6e26-418d-911a-6040c69a4dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:13.945976 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37d06b-6e26-418d-911a-6040c69a4dab admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:13.946970 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37d06b-6e26-418d-911a-6040c69a4dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:13.949136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37d06b-6e26-418d-911a-6040c69a4dab admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:13.984115 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1408/2812] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:32:13 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:32:13.985013 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37d06b-6e26-418d-911a-6040c69a4dab admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:14.041511 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ee56b-3833-4c3a-90c8-5ba0cb08347e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:14.052404 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37d06b-6e26-418d-911a-6040c69a4dab admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:14.057984 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95bdde-6142-4549-81a7-a6219e233a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:14.058609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95bdde-6142-4549-81a7-a6219e233a6d admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:14.058885 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95bdde-6142-4549-81a7-a6219e233a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:14.059152 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95bdde-6142-4549-81a7-a6219e233a6d admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:14.059777 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95bdde-6142-4549-81a7-a6219e233a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:14.062917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95bdde-6142-4549-81a7-a6219e233a6d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:14.087814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1409/2813] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:32:13 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:32:14.092046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95bdde-6142-4549-81a7-a6219e233a6d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:14.102575 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95bdde-6142-4549-81a7-a6219e233a6d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:14.107541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad42c4-7592-4666-ab31-8cdf1f9043df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9eef8921de43f18245f47559f3fa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:14.108195 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad42c4-7592-4666-ab31-8cdf1f9043df service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:14.108477 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad42c4-7592-4666-ab31-8cdf1f9043df service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:14.108623 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb87b99-01e1-4060-9573-3a26252eda68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:14.108784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad42c4-7592-4666-ab31-8cdf1f9043df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:14.109264 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb87b99-01e1-4060-9573-3a26252eda68 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:14.109555 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb87b99-01e1-4060-9573-3a26252eda68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:14.109812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb87b99-01e1-4060-9573-3a26252eda68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:14.110756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-38ad42c4-7592-4666-ab31-8cdf1f9043df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:14.110956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb87b99-01e1-4060-9573-3a26252eda68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:14.113702 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb87b99-01e1-4060-9573-3a26252eda68 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:14.122998 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad42c4-7592-4666-ab31-8cdf1f9043df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:14.124603 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad42c4-7592-4666-ab31-8cdf1f9043df service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:14.125104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1410/2814] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:32:14.129018 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb87b99-01e1-4060-9573-3a26252eda68 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:14.136310 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1405/2815] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:32:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:32:14.141308 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb87b99-01e1-4060-9573-3a26252eda68 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:14.146734 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc265ed4-6030-4f7c-a669-8f175472f58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:14.147370 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc265ed4-6030-4f7c-a669-8f175472f58b admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:14.147604 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc265ed4-6030-4f7c-a669-8f175472f58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:14.147874 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc265ed4-6030-4f7c-a669-8f175472f58b admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:14.148533 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc265ed4-6030-4f7c-a669-8f175472f58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:14.150179 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc265ed4-6030-4f7c-a669-8f175472f58b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:14.163917 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1411/2816] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:32:14.170103 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad42c4-7592-4666-ab31-8cdf1f9043df service placement] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:14.181325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad42c4-7592-4666-ab31-8cdf1f9043df service placement] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:14.186298 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2779c-7dbb-49cf-8c11-1aa62be11232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:14.187021 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2779c-7dbb-49cf-8c11-1aa62be11232 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:14.187375 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2779c-7dbb-49cf-8c11-1aa62be11232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:14.187723 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2779c-7dbb-49cf-8c11-1aa62be11232 admin admin] PATH_INFO: `/v3/projects/be909a54497a4581b2adf25aca1a7899/users/316b16d455cd441d83330327631b2d59/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:14.204581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2779c-7dbb-49cf-8c11-1aa62be11232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be909a54497a4581b2adf25aca1a7899, user_id=316b16d455cd441d83330327631b2d59, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:14.207429 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2779c-7dbb-49cf-8c11-1aa62be11232 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:14.223973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1406/2817] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:32:14 2022] PUT /identity/v3/projects/be909a54497a4581b2adf25aca1a7899/users/316b16d455cd441d83330327631b2d59/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:14.236012 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76aec9-0f51-400b-802e-2c19bdb8060e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:14.236459 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76aec9-0f51-400b-802e-2c19bdb8060e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:14.236760 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76aec9-0f51-400b-802e-2c19bdb8060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:14.268020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2e76aec9-0f51-400b-802e-2c19bdb8060e None None] MFA Rules not processed for user `316b16d455cd441d83330327631b2d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:14.269431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2e76aec9-0f51-400b-802e-2c19bdb8060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:14.338638 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1412/2818] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:32:14.350358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2779c-7dbb-49cf-8c11-1aa62be11232 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:14.352338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f1c2779c-7dbb-49cf-8c11-1aa62be11232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:14.394670 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:14.438784 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2779c-7dbb-49cf-8c11-1aa62be11232 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:14.443110 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b53cb-cf4e-42b0-be40-6727b952802d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:14.443887 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b53cb-cf4e-42b0-be40-6727b952802d service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:14.444289 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b53cb-cf4e-42b0-be40-6727b952802d service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:14.444592 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b53cb-cf4e-42b0-be40-6727b952802d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:14.454069 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b53cb-cf4e-42b0-be40-6727b952802d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:14.455733 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b53cb-cf4e-42b0-be40-6727b952802d service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:14.465732 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1407/2819] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:32:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:32:15.184014 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf9ad3-4fbb-419c-b409-e765e4a007a2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:15.184506 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf9ad3-4fbb-419c-b409-e765e4a007a2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:15.184606 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf9ad3-4fbb-419c-b409-e765e4a007a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:15.206198 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3edf9ad3-4fbb-419c-b409-e765e4a007a2 None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:15.207631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3edf9ad3-4fbb-419c-b409-e765e4a007a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:15.243867 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:15.269931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1413/2820] 10.222.0.45 () {58 vars in 1009 bytes} [Fri Aug 26 18:32:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:15.283354 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b53cb-cf4e-42b0-be40-6727b952802d service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:15.284857 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-252b53cb-cf4e-42b0-be40-6727b952802d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:15.359246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b53cb-cf4e-42b0-be40-6727b952802d service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:15.365764 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabb50e-3efc-4dc2-9269-eaced13530d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:15.366624 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabb50e-3efc-4dc2-9269-eaced13530d8 service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:15.366891 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabb50e-3efc-4dc2-9269-eaced13530d8 service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:15.367166 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabb50e-3efc-4dc2-9269-eaced13530d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:15.377538 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabb50e-3efc-4dc2-9269-eaced13530d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:15.379327 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabb50e-3efc-4dc2-9269-eaced13530d8 service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:15.388071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1408/2821] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:32:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:32:23.227992 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf9ad3-4fbb-419c-b409-e765e4a007a2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:23.295376 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf9ad3-4fbb-419c-b409-e765e4a007a2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:23.299877 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:23.300509 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:23.300829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:23.301099 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] PATH_INFO: `/v3/users/316b16d455cd441d83330327631b2d59` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:23.302243 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=316b16d455cd441d83330327631b2d59)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:23.304207 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:23.354000 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316b16d455cd441d83330327631b2d59'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:23.354787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316b16d455cd441d83330327631b2d59'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:23.365073 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316b16d455cd441d83330327631b2d59'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:23.372664 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316b16d455cd441d83330327631b2d59'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:23.373335 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316b16d455cd441d83330327631b2d59'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:23.391474 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1414/2822] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:32:23 2022] DELETE /identity/v3/users/316b16d455cd441d83330327631b2d59 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:23.396347 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2c265-881e-4b11-b1e8-0684b11a96bb None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:23.396897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2c265-881e-4b11-b1e8-0684b11a96bb None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:23.397007 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2c265-881e-4b11-b1e8-0684b11a96bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:23.421989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d8b2c265-881e-4b11-b1e8-0684b11a96bb None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:23.423253 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d8b2c265-881e-4b11-b1e8-0684b11a96bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:23.485940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1409/2823] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:23.496299 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:23.497889 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:23.560070 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89754ca1-b7ac-4861-adb8-73110fd10843 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:23.564277 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47c33c-9d66-48fc-849d-fc60cc786c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:23.564918 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47c33c-9d66-48fc-849d-fc60cc786c5a service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:23.565197 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47c33c-9d66-48fc-849d-fc60cc786c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:23.565467 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47c33c-9d66-48fc-849d-fc60cc786c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:23.575647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47c33c-9d66-48fc-849d-fc60cc786c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:23.577149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47c33c-9d66-48fc-849d-fc60cc786c5a service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:23.587405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1415/2824] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:32:23.873882 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2c265-881e-4b11-b1e8-0684b11a96bb None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:23.875421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d8b2c265-881e-4b11-b1e8-0684b11a96bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:23.887376 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2c265-881e-4b11-b1e8-0684b11a96bb None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:23.892325 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f156acb-96ff-458d-ac94-256fc9528d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:23.893013 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f156acb-96ff-458d-ac94-256fc9528d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:23.893297 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f156acb-96ff-458d-ac94-256fc9528d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:23.893940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f156acb-96ff-458d-ac94-256fc9528d9b admin admin] PATH_INFO: `/v3/projects/be909a54497a4581b2adf25aca1a7899` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:23.895170 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f156acb-96ff-458d-ac94-256fc9528d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be909a54497a4581b2adf25aca1a7899)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:23.897260 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f156acb-96ff-458d-ac94-256fc9528d9b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:23.946618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:23.955303 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8f156acb-96ff-458d-ac94-256fc9528d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be909a54497a4581b2adf25aca1a7899', 'request_id': 'req-8f156acb-96ff-458d-ac94-256fc9528d9b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:23.965147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8f156acb-96ff-458d-ac94-256fc9528d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be909a54497a4581b2adf25aca1a7899', 'request_id': 'req-8f156acb-96ff-458d-ac94-256fc9528d9b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:23.972248 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8f156acb-96ff-458d-ac94-256fc9528d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be909a54497a4581b2adf25aca1a7899', 'request_id': 'req-8f156acb-96ff-458d-ac94-256fc9528d9b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:23.985191 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8f156acb-96ff-458d-ac94-256fc9528d9b admin admin] The token cache is being invalidate because project be909a54497a4581b2adf25aca1a7899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:32:23.985449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8f156acb-96ff-458d-ac94-256fc9528d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:23.986090 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8f156acb-96ff-458d-ac94-256fc9528d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:23.987699 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1410/2825] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:32:23 2022] DELETE /identity/v3/projects/be909a54497a4581b2adf25aca1a7899 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:23.992862 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7708e0-89e9-43c8-85d6-14f3d20fc7d8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:23.993153 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7708e0-89e9-43c8-85d6-14f3d20fc7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:23.993428 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7708e0-89e9-43c8-85d6-14f3d20fc7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:24.007178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:24.013431 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-dd7708e0-89e9-43c8-85d6-14f3d20fc7d8 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:24.015484 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-dd7708e0-89e9-43c8-85d6-14f3d20fc7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:24.080893 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1416/2826] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:24.156527 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ab03-dd56-4fcb-9d82-daab24c4bf9d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:24.156846 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ab03-dd56-4fcb-9d82-daab24c4bf9d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:24.157242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ab03-dd56-4fcb-9d82-daab24c4bf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:24.178250 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b9c7ab03-dd56-4fcb-9d82-daab24c4bf9d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:24.179507 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b9c7ab03-dd56-4fcb-9d82-daab24c4bf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:24.188844 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1411/2827] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:24.194953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7708e0-89e9-43c8-85d6-14f3d20fc7d8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:24.205424 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7708e0-89e9-43c8-85d6-14f3d20fc7d8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:24.210681 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6062e-76cc-498f-a153-4588be17c3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:24.211368 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6062e-76cc-498f-a153-4588be17c3bc admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:24.211830 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6062e-76cc-498f-a153-4588be17c3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:24.212144 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6062e-76cc-498f-a153-4588be17c3bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:24.213090 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6062e-76cc-498f-a153-4588be17c3bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:32:24.213282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6062e-76cc-498f-a153-4588be17c3bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:24.215768 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6062e-76cc-498f-a153-4588be17c3bc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:24.232756 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1417/2828] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:32:24.237606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7ab03-dd56-4fcb-9d82-daab24c4bf9d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:24.247532 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7ab03-dd56-4fcb-9d82-daab24c4bf9d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:24.253536 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e234733-6a12-4276-be68-673ddc4901d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:24.254158 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e234733-6a12-4276-be68-673ddc4901d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:24.254465 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e234733-6a12-4276-be68-673ddc4901d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:24.254749 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e234733-6a12-4276-be68-673ddc4901d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:24.255403 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e234733-6a12-4276-be68-673ddc4901d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:24.257503 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e234733-6a12-4276-be68-673ddc4901d6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:24.288210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1412/2829] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:32:24 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:32:24.292643 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6062e-76cc-498f-a153-4588be17c3bc admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:24.306697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6062e-76cc-498f-a153-4588be17c3bc admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:24.369184 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63ec0e-ff10-4df9-89a7-85924fe68d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:24.369846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63ec0e-ff10-4df9-89a7-85924fe68d7b admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:24.370129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63ec0e-ff10-4df9-89a7-85924fe68d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:24.370406 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63ec0e-ff10-4df9-89a7-85924fe68d7b admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:24.371054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63ec0e-ff10-4df9-89a7-85924fe68d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:24.373189 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63ec0e-ff10-4df9-89a7-85924fe68d7b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:24.399519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1418/2830] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:32:24 2022] POST /identity/v3/users => generated 281 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:32:24.400953 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e234733-6a12-4276-be68-673ddc4901d6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:24.413247 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e234733-6a12-4276-be68-673ddc4901d6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:24.418972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fb96a-765e-4918-8ba3-058b0e252c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:24.419690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fb96a-765e-4918-8ba3-058b0e252c14 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:24.419973 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fb96a-765e-4918-8ba3-058b0e252c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:24.420242 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fb96a-765e-4918-8ba3-058b0e252c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:24.420971 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fb96a-765e-4918-8ba3-058b0e252c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:24.422608 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fb96a-765e-4918-8ba3-058b0e252c14 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:24.434461 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1413/2831] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:32:24.439240 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63ec0e-ff10-4df9-89a7-85924fe68d7b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:24.451535 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63ec0e-ff10-4df9-89a7-85924fe68d7b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:24.462829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6e4a4-1006-40a7-b585-682161d8deb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:24.462829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6e4a4-1006-40a7-b585-682161d8deb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:24.462829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6e4a4-1006-40a7-b585-682161d8deb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:24.462829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6e4a4-1006-40a7-b585-682161d8deb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:24.463529 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6e4a4-1006-40a7-b585-682161d8deb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:24.463529 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6e4a4-1006-40a7-b585-682161d8deb8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:24.474812 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1419/2832] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:32:24.479327 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fb96a-765e-4918-8ba3-058b0e252c14 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:24.491634 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fb96a-765e-4918-8ba3-058b0e252c14 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:24.496746 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddea04-2d8a-4e29-aec2-66dd8a8ca7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:24.497442 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddea04-2d8a-4e29-aec2-66dd8a8ca7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:24.497719 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddea04-2d8a-4e29-aec2-66dd8a8ca7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:24.497996 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddea04-2d8a-4e29-aec2-66dd8a8ca7a2 admin admin] PATH_INFO: `/v3/projects/c799156b7337471d9190ba28ec52941b/users/4d4060894d634576860b710fd4d4a3d4/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:24.523618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddea04-2d8a-4e29-aec2-66dd8a8ca7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c799156b7337471d9190ba28ec52941b, user_id=4d4060894d634576860b710fd4d4a3d4, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:24.526378 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddea04-2d8a-4e29-aec2-66dd8a8ca7a2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:24.543148 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1414/2833] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:32:24 2022] PUT /identity/v3/projects/c799156b7337471d9190ba28ec52941b/users/4d4060894d634576860b710fd4d4a3d4/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:24.553172 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b8181-93dc-48aa-aa96-8dc2902732d9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:24.553460 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b8181-93dc-48aa-aa96-8dc2902732d9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:24.553732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b8181-93dc-48aa-aa96-8dc2902732d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:24.584639 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-375b8181-93dc-48aa-aa96-8dc2902732d9 None None] MFA Rules not processed for user `4d4060894d634576860b710fd4d4a3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:24.585931 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-375b8181-93dc-48aa-aa96-8dc2902732d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:24.676709 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1420/2834] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:24.716137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddea04-2d8a-4e29-aec2-66dd8a8ca7a2 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:24.718023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-69ddea04-2d8a-4e29-aec2-66dd8a8ca7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:24.776202 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddea04-2d8a-4e29-aec2-66dd8a8ca7a2 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:24.780505 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec97157-5f97-43b8-8ea5-72d230529706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:24.781262 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97157-5f97-43b8-8ea5-72d230529706 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:24.781606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97157-5f97-43b8-8ea5-72d230529706 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:24.781972 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec97157-5f97-43b8-8ea5-72d230529706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:24.791295 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec97157-5f97-43b8-8ea5-72d230529706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:24.792850 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec97157-5f97-43b8-8ea5-72d230529706 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:24.802414 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1415/2835] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:32:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:32:24.818132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b8181-93dc-48aa-aa96-8dc2902732d9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:24.822466 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:24.899385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b8181-93dc-48aa-aa96-8dc2902732d9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:24.904178 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:24.904848 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:24.905125 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:24.905392 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] PATH_INFO: `/v3/users/4d4060894d634576860b710fd4d4a3d4` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:24.906547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4060894d634576860b710fd4d4a3d4)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:24.908574 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:24.962226 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4060894d634576860b710fd4d4a3d4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:24.962961 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4060894d634576860b710fd4d4a3d4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:24.972297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4060894d634576860b710fd4d4a3d4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:24.982141 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4060894d634576860b710fd4d4a3d4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:24.982946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4060894d634576860b710fd4d4a3d4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:25.002624 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1421/2836] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:32:24 2022] DELETE /identity/v3/users/4d4060894d634576860b710fd4d4a3d4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:25.008196 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01b3d3-3b47-46fc-9a0b-951b208c4333 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:25.008610 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01b3d3-3b47-46fc-9a0b-951b208c4333 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:25.008939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01b3d3-3b47-46fc-9a0b-951b208c4333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:25.030721 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2d01b3d3-3b47-46fc-9a0b-951b208c4333 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:25.031949 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2d01b3d3-3b47-46fc-9a0b-951b208c4333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:25.099233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1416/2837] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:25.110810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:25.112471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:25.171746 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0db33-1785-41b7-b2fe-10eb722adefa admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:25.176690 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318268ec-744c-4f6b-9bc6-4ba2549264d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:25.177519 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318268ec-744c-4f6b-9bc6-4ba2549264d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:25.177805 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318268ec-744c-4f6b-9bc6-4ba2549264d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:25.178101 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318268ec-744c-4f6b-9bc6-4ba2549264d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:25.188281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318268ec-744c-4f6b-9bc6-4ba2549264d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:25.189810 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318268ec-744c-4f6b-9bc6-4ba2549264d7 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:25.199621 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1422/2838] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:32:25.468043 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01b3d3-3b47-46fc-9a0b-951b208c4333 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:25.469684 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2d01b3d3-3b47-46fc-9a0b-951b208c4333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:25.484065 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01b3d3-3b47-46fc-9a0b-951b208c4333 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:25.489397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423834bc-1028-4f6e-a385-9ab78f67ed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:25.490124 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423834bc-1028-4f6e-a385-9ab78f67ed6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:25.490898 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423834bc-1028-4f6e-a385-9ab78f67ed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:25.491660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423834bc-1028-4f6e-a385-9ab78f67ed6a admin admin] PATH_INFO: `/v3/projects/c799156b7337471d9190ba28ec52941b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:25.492939 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423834bc-1028-4f6e-a385-9ab78f67ed6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c799156b7337471d9190ba28ec52941b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:25.494957 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423834bc-1028-4f6e-a385-9ab78f67ed6a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:25.502666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:25.548349 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-423834bc-1028-4f6e-a385-9ab78f67ed6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c799156b7337471d9190ba28ec52941b', 'request_id': 'req-423834bc-1028-4f6e-a385-9ab78f67ed6a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:25.556302 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-423834bc-1028-4f6e-a385-9ab78f67ed6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c799156b7337471d9190ba28ec52941b', 'request_id': 'req-423834bc-1028-4f6e-a385-9ab78f67ed6a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:25.563042 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-423834bc-1028-4f6e-a385-9ab78f67ed6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c799156b7337471d9190ba28ec52941b', 'request_id': 'req-423834bc-1028-4f6e-a385-9ab78f67ed6a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:25.573510 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-423834bc-1028-4f6e-a385-9ab78f67ed6a admin admin] The token cache is being invalidate because project c799156b7337471d9190ba28ec52941b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:32:25.573785 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-423834bc-1028-4f6e-a385-9ab78f67ed6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:25.574437 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-423834bc-1028-4f6e-a385-9ab78f67ed6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:25.575940 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1417/2839] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:32:25 2022] DELETE /identity/v3/projects/c799156b7337471d9190ba28ec52941b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:25.581547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6f1c6-60fb-43c7-a028-d35ad3ab2a0d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:25.582063 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6f1c6-60fb-43c7-a028-d35ad3ab2a0d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:25.582252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6f1c6-60fb-43c7-a028-d35ad3ab2a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:25.601698 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-65b6f1c6-60fb-43c7-a028-d35ad3ab2a0d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:25.602923 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-65b6f1c6-60fb-43c7-a028-d35ad3ab2a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:25.625027 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:25.669981 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1423/2840] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:25.678885 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f84afb-a9e7-4e50-9989-4f8a747b1e3b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:25.679171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f84afb-a9e7-4e50-9989-4f8a747b1e3b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:25.679474 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f84afb-a9e7-4e50-9989-4f8a747b1e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:25.699410 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-50f84afb-a9e7-4e50-9989-4f8a747b1e3b None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:25.700754 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-50f84afb-a9e7-4e50-9989-4f8a747b1e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:25.709450 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1418/2841] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:25.713953 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6f1c6-60fb-43c7-a028-d35ad3ab2a0d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:25.724166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6f1c6-60fb-43c7-a028-d35ad3ab2a0d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:25.729270 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d949c19-ba10-4e83-a96f-fff387f12d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:25.729878 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d949c19-ba10-4e83-a96f-fff387f12d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:25.730166 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d949c19-ba10-4e83-a96f-fff387f12d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:25.730458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d949c19-ba10-4e83-a96f-fff387f12d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:25.731139 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d949c19-ba10-4e83-a96f-fff387f12d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:32:25.731444 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d949c19-ba10-4e83-a96f-fff387f12d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:25.733105 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d949c19-ba10-4e83-a96f-fff387f12d5e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:25.745023 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1424/2842] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:32:25.749573 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f84afb-a9e7-4e50-9989-4f8a747b1e3b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:25.759188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f84afb-a9e7-4e50-9989-4f8a747b1e3b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:25.765299 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f037de-4d16-4e71-9599-e74fe5dc7eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:25.765907 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f037de-4d16-4e71-9599-e74fe5dc7eac admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:25.766188 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f037de-4d16-4e71-9599-e74fe5dc7eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:25.766458 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f037de-4d16-4e71-9599-e74fe5dc7eac admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:25.767096 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f037de-4d16-4e71-9599-e74fe5dc7eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:25.769062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f037de-4d16-4e71-9599-e74fe5dc7eac admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:25.799156 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1419/2843] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:32:25 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:32:25.803523 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d949c19-ba10-4e83-a96f-fff387f12d5e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:25.814837 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d949c19-ba10-4e83-a96f-fff387f12d5e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:25.873385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e44fa-880d-47c4-86e3-c668ad3b622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:25.874016 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e44fa-880d-47c4-86e3-c668ad3b622c admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:25.874293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e44fa-880d-47c4-86e3-c668ad3b622c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:25.874571 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e44fa-880d-47c4-86e3-c668ad3b622c admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:25.875220 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e44fa-880d-47c4-86e3-c668ad3b622c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:25.877193 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e44fa-880d-47c4-86e3-c668ad3b622c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:25.900510 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1425/2844] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:32:25 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:32:25.904965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f037de-4d16-4e71-9599-e74fe5dc7eac admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:25.916201 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f037de-4d16-4e71-9599-e74fe5dc7eac admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:25.921729 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2416a-1ebc-43a5-aeea-030076a49246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:25.922339 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2416a-1ebc-43a5-aeea-030076a49246 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:25.922620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2416a-1ebc-43a5-aeea-030076a49246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:25.922911 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2416a-1ebc-43a5-aeea-030076a49246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:25.923561 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2416a-1ebc-43a5-aeea-030076a49246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:25.925233 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2416a-1ebc-43a5-aeea-030076a49246 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:25.935994 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1420/2845] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:32:25.940390 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e44fa-880d-47c4-86e3-c668ad3b622c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:25.951309 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e44fa-880d-47c4-86e3-c668ad3b622c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:25.957136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c1781-68f2-4dd8-8574-f2bea803e5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:25.957745 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1781-68f2-4dd8-8574-f2bea803e5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:25.958025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1781-68f2-4dd8-8574-f2bea803e5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:25.958294 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1781-68f2-4dd8-8574-f2bea803e5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:25.958946 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c1781-68f2-4dd8-8574-f2bea803e5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:25.960617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c1781-68f2-4dd8-8574-f2bea803e5ec admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:25.972814 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1426/2846] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:32:25.977350 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2416a-1ebc-43a5-aeea-030076a49246 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:25.988077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2416a-1ebc-43a5-aeea-030076a49246 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:25.993190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc53928-0a75-4b6e-b6a6-faa0ef6d7be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:25.993856 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc53928-0a75-4b6e-b6a6-faa0ef6d7be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:25.994171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc53928-0a75-4b6e-b6a6-faa0ef6d7be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:25.994467 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc53928-0a75-4b6e-b6a6-faa0ef6d7be4 admin admin] PATH_INFO: `/v3/projects/b123f0f9118a4e1a9473c3ee9ed4b339/users/0cc7cd9a258649b8bb3e111958e8a225/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:26.011206 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc53928-0a75-4b6e-b6a6-faa0ef6d7be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b123f0f9118a4e1a9473c3ee9ed4b339, user_id=0cc7cd9a258649b8bb3e111958e8a225, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:26.014411 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc53928-0a75-4b6e-b6a6-faa0ef6d7be4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:26.030823 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1421/2847] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:32:25 2022] PUT /identity/v3/projects/b123f0f9118a4e1a9473c3ee9ed4b339/users/0cc7cd9a258649b8bb3e111958e8a225/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:26.042051 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cdf4f-d576-47bd-aaac-a8e4b21ea5c0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:26.042338 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cdf4f-d576-47bd-aaac-a8e4b21ea5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:26.042607 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cdf4f-d576-47bd-aaac-a8e4b21ea5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:26.073602 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-508cdf4f-d576-47bd-aaac-a8e4b21ea5c0 None None] MFA Rules not processed for user `0cc7cd9a258649b8bb3e111958e8a225`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:26.074858 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-508cdf4f-d576-47bd-aaac-a8e4b21ea5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:26.149252 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1427/2848] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:26.154025 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc53928-0a75-4b6e-b6a6-faa0ef6d7be4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:26.220886 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc53928-0a75-4b6e-b6a6-faa0ef6d7be4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:26.228037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140c9e6-b38e-4275-bfd8-fc16df432dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:26.228037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140c9e6-b38e-4275-bfd8-fc16df432dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:26.228037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140c9e6-b38e-4275-bfd8-fc16df432dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:26.228037 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140c9e6-b38e-4275-bfd8-fc16df432dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:26.228559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140c9e6-b38e-4275-bfd8-fc16df432dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:26.229796 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140c9e6-b38e-4275-bfd8-fc16df432dc0 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:26.264416 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1422/2849] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:32:26 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:32:26.265694 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cdf4f-d576-47bd-aaac-a8e4b21ea5c0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:26.277024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cdf4f-d576-47bd-aaac-a8e4b21ea5c0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:26.294410 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:26.336048 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcae0a-2964-4415-8d81-65eeaa6e911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:26.336572 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcae0a-2964-4415-8d81-65eeaa6e911f admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:26.336884 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcae0a-2964-4415-8d81-65eeaa6e911f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:26.337292 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcae0a-2964-4415-8d81-65eeaa6e911f admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:26.338072 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcae0a-2964-4415-8d81-65eeaa6e911f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:26.340194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcae0a-2964-4415-8d81-65eeaa6e911f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:26.363617 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1428/2850] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:32:26 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 18:32:26.368229 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140c9e6-b38e-4275-bfd8-fc16df432dc0 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:26.379777 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140c9e6-b38e-4275-bfd8-fc16df432dc0 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:26.384667 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533315f3-9790-4978-a402-51e1c0323816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:26.385355 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533315f3-9790-4978-a402-51e1c0323816 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:26.385632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533315f3-9790-4978-a402-51e1c0323816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:26.385905 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533315f3-9790-4978-a402-51e1c0323816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:26.386549 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533315f3-9790-4978-a402-51e1c0323816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:26.388169 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533315f3-9790-4978-a402-51e1c0323816 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:26.399543 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1423/2851] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 18:32:26.403967 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcae0a-2964-4415-8d81-65eeaa6e911f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:26.415009 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcae0a-2964-4415-8d81-65eeaa6e911f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:26.420220 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd340e8-f5f7-40d2-adaa-81e005756e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:26.420922 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd340e8-f5f7-40d2-adaa-81e005756e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:26.421304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd340e8-f5f7-40d2-adaa-81e005756e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:26.421610 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd340e8-f5f7-40d2-adaa-81e005756e81 admin admin] PATH_INFO: `/v3/projects/418ef54a8ffb48b881d440a60d65011e/users/c7d243e4d1054d40bbcfb18b9b38a500/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:26.437942 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd340e8-f5f7-40d2-adaa-81e005756e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418ef54a8ffb48b881d440a60d65011e, user_id=c7d243e4d1054d40bbcfb18b9b38a500, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:26.440886 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd340e8-f5f7-40d2-adaa-81e005756e81 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:26.456835 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1429/2852] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:32:26 2022] PUT /identity/v3/projects/418ef54a8ffb48b881d440a60d65011e/users/c7d243e4d1054d40bbcfb18b9b38a500/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:26.461131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533315f3-9790-4978-a402-51e1c0323816 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:26.468224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:26.473868 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533315f3-9790-4978-a402-51e1c0323816 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:26.539600 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413da0-c4a4-4b72-b3c9-46b76b76368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:26.540231 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413da0-c4a4-4b72-b3c9-46b76b76368b admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:26.540516 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413da0-c4a4-4b72-b3c9-46b76b76368b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:26.540822 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413da0-c4a4-4b72-b3c9-46b76b76368b admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:26.541631 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413da0-c4a4-4b72-b3c9-46b76b76368b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:26.543271 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413da0-c4a4-4b72-b3c9-46b76b76368b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:26.553623 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1424/2853] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:32:26.558049 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd340e8-f5f7-40d2-adaa-81e005756e81 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:26.568603 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd340e8-f5f7-40d2-adaa-81e005756e81 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:26.574046 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112cd0a-b9ea-4d82-a04f-f27579665019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:26.574766 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112cd0a-b9ea-4d82-a04f-f27579665019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:26.575056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112cd0a-b9ea-4d82-a04f-f27579665019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:26.575401 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112cd0a-b9ea-4d82-a04f-f27579665019 admin admin] PATH_INFO: `/v3/projects/418ef54a8ffb48b881d440a60d65011e/users/c7d243e4d1054d40bbcfb18b9b38a500/roles/db572ad3d504403cbb227c2155c93eda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:26.577361 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112cd0a-b9ea-4d82-a04f-f27579665019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418ef54a8ffb48b881d440a60d65011e, user_id=c7d243e4d1054d40bbcfb18b9b38a500, role_id=db572ad3d504403cbb227c2155c93eda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:26.580034 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112cd0a-b9ea-4d82-a04f-f27579665019 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:26.591236 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1430/2854] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:32:26 2022] PUT /identity/v3/projects/418ef54a8ffb48b881d440a60d65011e/users/c7d243e4d1054d40bbcfb18b9b38a500/roles/db572ad3d504403cbb227c2155c93eda => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:26.602214 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a9f8a-2bfd-409f-8b0e-7d7a779349a4 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:26.602499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a9f8a-2bfd-409f-8b0e-7d7a779349a4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:26.602794 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a9f8a-2bfd-409f-8b0e-7d7a779349a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:26.633642 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b02a9f8a-2bfd-409f-8b0e-7d7a779349a4 None None] MFA Rules not processed for user `c7d243e4d1054d40bbcfb18b9b38a500`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:26.634884 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b02a9f8a-2bfd-409f-8b0e-7d7a779349a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:26.707382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1425/2855] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:26.718471 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112cd0a-b9ea-4d82-a04f-f27579665019 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:26.720363 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f112cd0a-b9ea-4d82-a04f-f27579665019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:26.782838 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112cd0a-b9ea-4d82-a04f-f27579665019 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:26.787031 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725647d8-d2b7-4491-975d-57f0a9591ef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:26.787651 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725647d8-d2b7-4491-975d-57f0a9591ef7 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:26.787926 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725647d8-d2b7-4491-975d-57f0a9591ef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:26.788191 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725647d8-d2b7-4491-975d-57f0a9591ef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:26.849621 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725647d8-d2b7-4491-975d-57f0a9591ef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:26.851022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725647d8-d2b7-4491-975d-57f0a9591ef7 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:26.860648 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1431/2856] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:32:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:32:29.445983 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a9f8a-2bfd-409f-8b0e-7d7a779349a4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:29.516374 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a9f8a-2bfd-409f-8b0e-7d7a779349a4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:29.524167 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:29.524645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:29.525082 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:29.525491 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] PATH_INFO: `/v3/users/0cc7cd9a258649b8bb3e111958e8a225` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:29.526747 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc7cd9a258649b8bb3e111958e8a225)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:29.528701 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:29.562241 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:29.585163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc7cd9a258649b8bb3e111958e8a225'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:29.597886 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc7cd9a258649b8bb3e111958e8a225'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:29.598618 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc7cd9a258649b8bb3e111958e8a225'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:29.607897 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc7cd9a258649b8bb3e111958e8a225'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:29.617062 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc7cd9a258649b8bb3e111958e8a225'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:29.625599 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1426/2857] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:32:29 2022] DELETE /identity/v3/users/0cc7cd9a258649b8bb3e111958e8a225 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:29.630281 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b05a5-60e4-4c5a-b66d-a9c30d476c4d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:29.630726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b05a5-60e4-4c5a-b66d-a9c30d476c4d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:29.630726 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b05a5-60e4-4c5a-b66d-a9c30d476c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:29.655248 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b08b05a5-60e4-4c5a-b66d-a9c30d476c4d None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:29.656596 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b08b05a5-60e4-4c5a-b66d-a9c30d476c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:29.679164 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:29.744214 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1432/2858] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:29.755221 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:29.757224 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:29.822774 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b4268-0dcf-4b85-8941-f91291d8f6b7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:29.826635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a72352-d3a9-4d1a-a6c5-5138673f76d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:29.827246 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a72352-d3a9-4d1a-a6c5-5138673f76d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:29.827529 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a72352-d3a9-4d1a-a6c5-5138673f76d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:29.827801 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a72352-d3a9-4d1a-a6c5-5138673f76d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:29.838382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a72352-d3a9-4d1a-a6c5-5138673f76d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:29.840163 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a72352-d3a9-4d1a-a6c5-5138673f76d4 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:29.851211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1427/2859] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:32:30.178190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b05a5-60e4-4c5a-b66d-a9c30d476c4d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:30.179894 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b08b05a5-60e4-4c5a-b66d-a9c30d476c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:30.193303 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b05a5-60e4-4c5a-b66d-a9c30d476c4d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:30.199782 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:30.200688 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:30.201297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:30.201677 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] PATH_INFO: `/v3/projects/b123f0f9118a4e1a9473c3ee9ed4b339` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:30.203360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b123f0f9118a4e1a9473c3ee9ed4b339)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:30.205633 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:30.272827 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b123f0f9118a4e1a9473c3ee9ed4b339', 'request_id': 'req-adfe6a74-5c8c-453b-864f-d6fbfad24587'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.278905 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b123f0f9118a4e1a9473c3ee9ed4b339', 'request_id': 'req-adfe6a74-5c8c-453b-864f-d6fbfad24587'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.286400 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b123f0f9118a4e1a9473c3ee9ed4b339', 'request_id': 'req-adfe6a74-5c8c-453b-864f-d6fbfad24587'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.300985 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] The token cache is being invalidate because project b123f0f9118a4e1a9473c3ee9ed4b339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:32:30.301275 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.302104 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.304319 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1433/2860] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:32:30 2022] DELETE /identity/v3/projects/b123f0f9118a4e1a9473c3ee9ed4b339 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:30.308211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a72352-d3a9-4d1a-a6c5-5138673f76d4 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:30.319252 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a72352-d3a9-4d1a-a6c5-5138673f76d4 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:30.390854 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d046c82-d399-41a2-a7a4-4b74dde0f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:30.391616 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d046c82-d399-41a2-a7a4-4b74dde0f16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:30.391969 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d046c82-d399-41a2-a7a4-4b74dde0f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:30.392319 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d046c82-d399-41a2-a7a4-4b74dde0f16c admin admin] PATH_INFO: `/v3/users/c7d243e4d1054d40bbcfb18b9b38a500` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:30.393619 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d046c82-d399-41a2-a7a4-4b74dde0f16c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d243e4d1054d40bbcfb18b9b38a500)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:30.395612 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d046c82-d399-41a2-a7a4-4b74dde0f16c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:30.448934 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4d046c82-d399-41a2-a7a4-4b74dde0f16c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d243e4d1054d40bbcfb18b9b38a500'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.450807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:30.463049 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4d046c82-d399-41a2-a7a4-4b74dde0f16c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d243e4d1054d40bbcfb18b9b38a500'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.463865 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4d046c82-d399-41a2-a7a4-4b74dde0f16c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d243e4d1054d40bbcfb18b9b38a500'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.470859 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4d046c82-d399-41a2-a7a4-4b74dde0f16c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d243e4d1054d40bbcfb18b9b38a500'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.479430 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4d046c82-d399-41a2-a7a4-4b74dde0f16c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d243e4d1054d40bbcfb18b9b38a500'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.486080 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1428/2861] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:32:30 2022] DELETE /identity/v3/users/c7d243e4d1054d40bbcfb18b9b38a500 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:30.780632 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:30.782846 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:30.802731 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe6a74-5c8c-453b-864f-d6fbfad24587 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:30.867990 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65ddfd-7f3a-4033-af14-641f9905df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:30.868636 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65ddfd-7f3a-4033-af14-641f9905df15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:30.868939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65ddfd-7f3a-4033-af14-641f9905df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:30.869213 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65ddfd-7f3a-4033-af14-641f9905df15 admin admin] PATH_INFO: `/v3/projects/418ef54a8ffb48b881d440a60d65011e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:30.870609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65ddfd-7f3a-4033-af14-641f9905df15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=418ef54a8ffb48b881d440a60d65011e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:30.873436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65ddfd-7f3a-4033-af14-641f9905df15 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:30.932600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ae65ddfd-7f3a-4033-af14-641f9905df15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418ef54a8ffb48b881d440a60d65011e', 'request_id': 'req-ae65ddfd-7f3a-4033-af14-641f9905df15'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.935079 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:30.940881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ae65ddfd-7f3a-4033-af14-641f9905df15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418ef54a8ffb48b881d440a60d65011e', 'request_id': 'req-ae65ddfd-7f3a-4033-af14-641f9905df15'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.952054 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ae65ddfd-7f3a-4033-af14-641f9905df15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418ef54a8ffb48b881d440a60d65011e', 'request_id': 'req-ae65ddfd-7f3a-4033-af14-641f9905df15'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.970136 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ae65ddfd-7f3a-4033-af14-641f9905df15 admin admin] The token cache is being invalidate because project 418ef54a8ffb48b881d440a60d65011e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:32:30.970599 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ae65ddfd-7f3a-4033-af14-641f9905df15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.971374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ae65ddfd-7f3a-4033-af14-641f9905df15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:30.973600 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1434/2862] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:32:30 2022] DELETE /identity/v3/projects/418ef54a8ffb48b881d440a60d65011e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:32:30.978736 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601d2a-d608-4ea1-b386-25a4ae12143a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:30.979071 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601d2a-d608-4ea1-b386-25a4ae12143a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:30.979583 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601d2a-d608-4ea1-b386-25a4ae12143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:31.000649 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-41601d2a-d608-4ea1-b386-25a4ae12143a None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:31.001984 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-41601d2a-d608-4ea1-b386-25a4ae12143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:31.067587 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1429/2863] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 18:32:31.076868 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fade6d-5699-425a-8435-6444e9d3ace0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:31.077129 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fade6d-5699-425a-8435-6444e9d3ace0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:31.077454 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fade6d-5699-425a-8435-6444e9d3ace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:31.097965 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-86fade6d-5699-425a-8435-6444e9d3ace0 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:31.099203 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-86fade6d-5699-425a-8435-6444e9d3ace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:31.107620 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1435/2864] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:31.112160 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41601d2a-d608-4ea1-b386-25a4ae12143a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:31.122606 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41601d2a-d608-4ea1-b386-25a4ae12143a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:31.127404 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9492cf-8622-46ad-a36f-addff8b03957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:31.128000 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9492cf-8622-46ad-a36f-addff8b03957 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:31.128276 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9492cf-8622-46ad-a36f-addff8b03957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:31.128541 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9492cf-8622-46ad-a36f-addff8b03957 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:31.129245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9492cf-8622-46ad-a36f-addff8b03957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 18:32:31.129545 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9492cf-8622-46ad-a36f-addff8b03957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:31.131149 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9492cf-8622-46ad-a36f-addff8b03957 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:31.143576 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1430/2865] 10.222.0.45 () {58 vars in 1153 bytes} [Fri Aug 26 18:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 18:32:31.148077 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fade6d-5699-425a-8435-6444e9d3ace0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:31.157787 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fade6d-5699-425a-8435-6444e9d3ace0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:31.163128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ee189-afd9-4ae2-a69e-22ccb186e8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:31.163741 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee189-afd9-4ae2-a69e-22ccb186e8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:31.164022 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee189-afd9-4ae2-a69e-22ccb186e8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:31.164293 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee189-afd9-4ae2-a69e-22ccb186e8e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:31.164986 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ee189-afd9-4ae2-a69e-22ccb186e8e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:31.167024 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ee189-afd9-4ae2-a69e-22ccb186e8e0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:31.200230 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1436/2866] 10.222.0.45 () {60 vars in 1153 bytes} [Fri Aug 26 18:32:31 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:32:31.205725 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9492cf-8622-46ad-a36f-addff8b03957 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:31.216553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9492cf-8622-46ad-a36f-addff8b03957 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:31.276914 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc790378-a469-4dde-b8fe-3bc87c848689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:31.278123 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc790378-a469-4dde-b8fe-3bc87c848689 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:31.278265 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc790378-a469-4dde-b8fe-3bc87c848689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:31.278646 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc790378-a469-4dde-b8fe-3bc87c848689 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:31.279458 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc790378-a469-4dde-b8fe-3bc87c848689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:31.282397 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc790378-a469-4dde-b8fe-3bc87c848689 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:31.318698 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1431/2867] 10.222.0.45 () {60 vars in 1144 bytes} [Fri Aug 26 18:32:31 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 18:32:31.323634 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ee189-afd9-4ae2-a69e-22ccb186e8e0 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:31.337348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ee189-afd9-4ae2-a69e-22ccb186e8e0 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:31.342797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18214d22-d562-452f-b889-7ec7ce0d14ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:31.343391 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214d22-d562-452f-b889-7ec7ce0d14ef admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:31.343670 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214d22-d562-452f-b889-7ec7ce0d14ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:31.343942 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214d22-d562-452f-b889-7ec7ce0d14ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:31.344596 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18214d22-d562-452f-b889-7ec7ce0d14ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:31.346324 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18214d22-d562-452f-b889-7ec7ce0d14ef admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:31.357873 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1437/2868] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:32:31.362177 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc790378-a469-4dde-b8fe-3bc87c848689 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:31.374190 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc790378-a469-4dde-b8fe-3bc87c848689 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:31.384023 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd5a64-098a-4d60-99d3-2bd2195a9905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:31.384664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd5a64-098a-4d60-99d3-2bd2195a9905 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:31.384981 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd5a64-098a-4d60-99d3-2bd2195a9905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:31.385255 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd5a64-098a-4d60-99d3-2bd2195a9905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:31.386252 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd5a64-098a-4d60-99d3-2bd2195a9905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:31.388316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd5a64-098a-4d60-99d3-2bd2195a9905 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:31.403030 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1432/2869] 10.222.0.45 () {58 vars in 1122 bytes} [Fri Aug 26 18:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 18:32:31.407672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18214d22-d562-452f-b889-7ec7ce0d14ef admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:31.419109 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18214d22-d562-452f-b889-7ec7ce0d14ef admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:31.424325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403402f5-cff7-42f5-8615-ac5b37885d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:31.425025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403402f5-cff7-42f5-8615-ac5b37885d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:31.425307 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403402f5-cff7-42f5-8615-ac5b37885d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:31.425579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403402f5-cff7-42f5-8615-ac5b37885d6e admin admin] PATH_INFO: `/v3/projects/a7048891721b4f3b964b70de662978ff/users/ca532379f85e444489da8fd4a38dcf3f/roles/b7d5979aed50487cbf98896a6fa6f162` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:31.446301 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403402f5-cff7-42f5-8615-ac5b37885d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7048891721b4f3b964b70de662978ff, user_id=ca532379f85e444489da8fd4a38dcf3f, role_id=b7d5979aed50487cbf98896a6fa6f162)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:31.449508 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403402f5-cff7-42f5-8615-ac5b37885d6e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:31.464666 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1438/2870] 10.222.0.45 () {60 vars in 1483 bytes} [Fri Aug 26 18:32:31 2022] PUT /identity/v3/projects/a7048891721b4f3b964b70de662978ff/users/ca532379f85e444489da8fd4a38dcf3f/roles/b7d5979aed50487cbf98896a6fa6f162 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:31.476050 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936299f-d269-452c-bc00-e66eccb58661 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:31.476660 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936299f-d269-452c-bc00-e66eccb58661 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:31.476805 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936299f-d269-452c-bc00-e66eccb58661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:31.515725 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8936299f-d269-452c-bc00-e66eccb58661 None None] MFA Rules not processed for user `ca532379f85e444489da8fd4a38dcf3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:31.517360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8936299f-d269-452c-bc00-e66eccb58661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:31.539372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:31.591550 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1433/2871] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:31.603672 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403402f5-cff7-42f5-8615-ac5b37885d6e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:31.605554 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-403402f5-cff7-42f5-8615-ac5b37885d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:31.668475 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403402f5-cff7-42f5-8615-ac5b37885d6e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:31.672425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b61ab7-1fbd-47fa-b771-7e9ca6ca0225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcfeeb3365ba420c9ff03e5aadee7f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:31.673186 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b61ab7-1fbd-47fa-b771-7e9ca6ca0225 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:31.673447 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b61ab7-1fbd-47fa-b771-7e9ca6ca0225 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:31.673716 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b61ab7-1fbd-47fa-b771-7e9ca6ca0225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:31.683282 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b61ab7-1fbd-47fa-b771-7e9ca6ca0225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:31.684807 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b61ab7-1fbd-47fa-b771-7e9ca6ca0225 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:31.695920 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1439/2872] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:32:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:32:31.721961 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936299f-d269-452c-bc00-e66eccb58661 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:31.796316 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936299f-d269-452c-bc00-e66eccb58661 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:31.800987 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:31.801630 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:31.801906 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:31.802340 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] PATH_INFO: `/v3/users/ca532379f85e444489da8fd4a38dcf3f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:31.803758 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca532379f85e444489da8fd4a38dcf3f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:31.805867 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:31.860342 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca532379f85e444489da8fd4a38dcf3f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:31.875307 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca532379f85e444489da8fd4a38dcf3f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:31.876044 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca532379f85e444489da8fd4a38dcf3f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:31.883640 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca532379f85e444489da8fd4a38dcf3f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:31.893147 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca532379f85e444489da8fd4a38dcf3f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:31.900054 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1434/2873] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:32:31 2022] DELETE /identity/v3/users/ca532379f85e444489da8fd4a38dcf3f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:32:31.904748 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f88223-4efc-4f84-9877-16ab8ffc9d73 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:31.905325 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f88223-4efc-4f84-9877-16ab8ffc9d73 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:31.905458 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f88223-4efc-4f84-9877-16ab8ffc9d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:31.929239 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-26f88223-4efc-4f84-9877-16ab8ffc9d73 None None] MFA Rules not processed for user `5d269ce658414d469f0da1f990d74895`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:32:31.930608 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-26f88223-4efc-4f84-9877-16ab8ffc9d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:31.999732 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1440/2874] 10.222.0.45 () {58 vars in 958 bytes} [Fri Aug 26 18:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:32:32.010554 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:32.012360 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:32.065011 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:32.083737 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434891a0-055e-40cc-8483-39a09bdf6c9b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:32.088057 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63613bd3-a523-46c8-b979-6e9a93b40483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:32.088690 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63613bd3-a523-46c8-b979-6e9a93b40483 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:32.089010 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63613bd3-a523-46c8-b979-6e9a93b40483 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:32.089283 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63613bd3-a523-46c8-b979-6e9a93b40483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:32.100220 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63613bd3-a523-46c8-b979-6e9a93b40483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:32.101726 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63613bd3-a523-46c8-b979-6e9a93b40483 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:32.113836 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1435/2875] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:32:32.482561 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f88223-4efc-4f84-9877-16ab8ffc9d73 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:32.484009 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-26f88223-4efc-4f84-9877-16ab8ffc9d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:32.498340 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f88223-4efc-4f84-9877-16ab8ffc9d73 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:32.504056 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:32.505029 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:32.505216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:32.505399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] PATH_INFO: `/v3/projects/a7048891721b4f3b964b70de662978ff` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:32.506609 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7048891721b4f3b964b70de662978ff)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:32.519675 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:32.557375 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:32.600094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7048891721b4f3b964b70de662978ff', 'request_id': 'req-d7dae628-76c9-4f41-90a0-37f994caae1c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:32.606443 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7048891721b4f3b964b70de662978ff', 'request_id': 'req-d7dae628-76c9-4f41-90a0-37f994caae1c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:32.615169 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7048891721b4f3b964b70de662978ff', 'request_id': 'req-d7dae628-76c9-4f41-90a0-37f994caae1c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:32.631425 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] The token cache is being invalidate because project a7048891721b4f3b964b70de662978ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:32:32.631765 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:32.632422 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:32:32.634132 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1441/2876] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:32:32 2022] DELETE /identity/v3/projects/a7048891721b4f3b964b70de662978ff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:32:42.011209 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63613bd3-a523-46c8-b979-6e9a93b40483 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:32:42.013693 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-63613bd3-a523-46c8-b979-6e9a93b40483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:42.032540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63613bd3-a523-46c8-b979-6e9a93b40483 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:32:42.096001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e7445-7f79-4b7d-9e0b-89a5c13dd75f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:32:42.096673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e7445-7f79-4b7d-9e0b-89a5c13dd75f service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:32:42.096989 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e7445-7f79-4b7d-9e0b-89a5c13dd75f service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:32:42.097261 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e7445-7f79-4b7d-9e0b-89a5c13dd75f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:32:42.099267 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4a0e7445-7f79-4b7d-9e0b-89a5c13dd75f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:32:42.168734 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e7445-7f79-4b7d-9e0b-89a5c13dd75f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:32:42.170244 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e7445-7f79-4b7d-9e0b-89a5c13dd75f service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:32:42.180372 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1436/2877] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:32:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:32:42.627956 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:52.175904 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=57 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:34.995339 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:33:34.998829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:33:35.012997 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dae628-76c9-4f41-90a0-37f994caae1c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:33:35.016790 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eaceae-f0e0-4c6f-9f22-550be640e18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:33:35.017421 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eaceae-f0e0-4c6f-9f22-550be640e18a service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:33:35.017697 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eaceae-f0e0-4c6f-9f22-550be640e18a service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:33:35.017964 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eaceae-f0e0-4c6f-9f22-550be640e18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:33:35.020829 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e1eaceae-f0e0-4c6f-9f22-550be640e18a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:33:35.135328 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e7445-7f79-4b7d-9e0b-89a5c13dd75f service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:33:35.137479 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4a0e7445-7f79-4b7d-9e0b-89a5c13dd75f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:33:35.151620 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e7445-7f79-4b7d-9e0b-89a5c13dd75f service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:33:35.157471 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c97646-01ae-435c-bd7c-bc41300e9343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:33:35.158843 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c97646-01ae-435c-bd7c-bc41300e9343 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:33:35.159211 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c97646-01ae-435c-bd7c-bc41300e9343 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:33:35.159553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c97646-01ae-435c-bd7c-bc41300e9343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:33:35.161965 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-43c97646-01ae-435c-bd7c-bc41300e9343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:33:35.166381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eaceae-f0e0-4c6f-9f22-550be640e18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:33:35.168581 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eaceae-f0e0-4c6f-9f22-550be640e18a service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:33:35.190137 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c97646-01ae-435c-bd7c-bc41300e9343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:33:35.192012 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c97646-01ae-435c-bd7c-bc41300e9343 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:33:35.196092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1442/2878] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:33:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:33:35.206358 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1437/2879] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:33:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:33:45.193039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=43 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:45.200632 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=6 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:47.640834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eaceae-f0e0-4c6f-9f22-550be640e18a service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:33:47.669414 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eaceae-f0e0-4c6f-9f22-550be640e18a service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:33:47.673727 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ef83-4ec7-4978-b700-83531f76514e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:33:47.674295 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ef83-4ec7-4978-b700-83531f76514e service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:33:47.674579 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ef83-4ec7-4978-b700-83531f76514e service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:33:47.674849 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ef83-4ec7-4978-b700-83531f76514e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:33:47.676795 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2d23ef83-4ec7-4978-b700-83531f76514e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:33:47.749094 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23ef83-4ec7-4978-b700-83531f76514e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:33:47.750565 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23ef83-4ec7-4978-b700-83531f76514e service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:33:47.761464 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1443/2880] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:33:50.468217 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c97646-01ae-435c-bd7c-bc41300e9343 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:33:50.478006 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c97646-01ae-435c-bd7c-bc41300e9343 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:33:50.482236 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c070-4671-41bd-b24f-8dd645157c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78487667b3334cf09fed51b697cbf759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:33:50.482854 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c070-4671-41bd-b24f-8dd645157c0a service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:33:50.483155 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c070-4671-41bd-b24f-8dd645157c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:33:50.483421 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c070-4671-41bd-b24f-8dd645157c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:33:50.485499 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1985c070-4671-41bd-b24f-8dd645157c0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:33:50.495840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985c070-4671-41bd-b24f-8dd645157c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:33:50.497369 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985c070-4671-41bd-b24f-8dd645157c0a service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:33:50.512840 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1438/2881] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:33:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:33:55.217916 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ef83-4ec7-4978-b700-83531f76514e service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:33:55.219590 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2d23ef83-4ec7-4978-b700-83531f76514e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:33:55.240776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ef83-4ec7-4978-b700-83531f76514e service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:33:55.240776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:33:55.240776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:33:55.240776 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:33:55.241216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] PATH_INFO: `/v3/users/deb80cf02c84476182960a91d69b6da1` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:33:55.241216 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb80cf02c84476182960a91d69b6da1)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:33:55.243150 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:33:55.302297 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb80cf02c84476182960a91d69b6da1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.303092 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb80cf02c84476182960a91d69b6da1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.313244 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb80cf02c84476182960a91d69b6da1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.322320 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb80cf02c84476182960a91d69b6da1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.323128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb80cf02c84476182960a91d69b6da1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.342954 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1444/2882] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:33:55 2022] DELETE /identity/v3/users/deb80cf02c84476182960a91d69b6da1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:33:55.562365 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c070-4671-41bd-b24f-8dd645157c0a service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:33:55.576802 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c070-4671-41bd-b24f-8dd645157c0a service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:33:55.641623 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:33:55.642258 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:33:55.642556 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:33:55.642833 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] PATH_INFO: `/v3/projects/44c9832086724954853fc474a2a92747` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:33:55.644060 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c9832086724954853fc474a2a92747)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:33:55.646449 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:33:55.699041 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c9832086724954853fc474a2a92747', 'request_id': 'req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.709673 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c9832086724954853fc474a2a92747', 'request_id': 'req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.716753 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c9832086724954853fc474a2a92747', 'request_id': 'req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.728430 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] The token cache is being invalidate because project 44c9832086724954853fc474a2a92747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:33:55.728837 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.729617 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.731310 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1439/2883] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:33:55 2022] DELETE /identity/v3/projects/44c9832086724954853fc474a2a92747 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 18:33:55.735640 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:33:55.737221 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:33:55.751797 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055881-93f7-42c9-9ea5-ed748a3d43cf admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:33:55.812192 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:33:55.812853 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:33:55.813128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:33:55.813399 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] PATH_INFO: `/v3/users/fad46c549d3246108c63a9f9fcfce754` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:33:55.814547 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad46c549d3246108c63a9f9fcfce754)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:33:55.816546 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:33:55.822149 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:55.869896 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad46c549d3246108c63a9f9fcfce754'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.870647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad46c549d3246108c63a9f9fcfce754'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.878573 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad46c549d3246108c63a9f9fcfce754'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.886559 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad46c549d3246108c63a9f9fcfce754'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.887357 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad46c549d3246108c63a9f9fcfce754'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:55.907647 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1445/2884] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:33:55 2022] DELETE /identity/v3/users/fad46c549d3246108c63a9f9fcfce754 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:33:56.114024 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:33:56.115582 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:33:56.129346 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15c96c-a97b-4e8e-bcee-f57dbf13e7a7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:33:56.196268 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72949445-2527-40d4-90b3-d107cde0a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:33:56.196983 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72949445-2527-40d4-90b3-d107cde0a9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:33:56.197283 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72949445-2527-40d4-90b3-d107cde0a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:33:56.197551 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72949445-2527-40d4-90b3-d107cde0a9f0 admin admin] PATH_INFO: `/v3/projects/f82958cab68c4da0b6dd1898892d0025` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:33:56.198950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72949445-2527-40d4-90b3-d107cde0a9f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f82958cab68c4da0b6dd1898892d0025)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:33:56.201210 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72949445-2527-40d4-90b3-d107cde0a9f0 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:33:56.231370 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:56.263963 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-72949445-2527-40d4-90b3-d107cde0a9f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f82958cab68c4da0b6dd1898892d0025', 'request_id': 'req-72949445-2527-40d4-90b3-d107cde0a9f0'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:56.273952 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-72949445-2527-40d4-90b3-d107cde0a9f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f82958cab68c4da0b6dd1898892d0025', 'request_id': 'req-72949445-2527-40d4-90b3-d107cde0a9f0'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:56.288707 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-72949445-2527-40d4-90b3-d107cde0a9f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f82958cab68c4da0b6dd1898892d0025', 'request_id': 'req-72949445-2527-40d4-90b3-d107cde0a9f0'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:56.300198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-72949445-2527-40d4-90b3-d107cde0a9f0 admin admin] The token cache is being invalidate because project f82958cab68c4da0b6dd1898892d0025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:33:56.300540 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-72949445-2527-40d4-90b3-d107cde0a9f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:56.301290 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-72949445-2527-40d4-90b3-d107cde0a9f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:33:56.308081 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1440/2885] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:33:56 2022] DELETE /identity/v3/projects/f82958cab68c4da0b6dd1898892d0025 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:34:01.046060 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:34:01.047574 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:34:01.170784 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c1c48-533b-4030-b9ac-5d4dfd757d48 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:34:01.272907 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23849bd-c23c-49cf-b236-f24d3781fdf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:34:01.273542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23849bd-c23c-49cf-b236-f24d3781fdf2 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:34:01.273962 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23849bd-c23c-49cf-b236-f24d3781fdf2 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:34:01.274232 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23849bd-c23c-49cf-b236-f24d3781fdf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:34:01.276091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a23849bd-c23c-49cf-b236-f24d3781fdf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:34:01.288763 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23849bd-c23c-49cf-b236-f24d3781fdf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:34:01.291360 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23849bd-c23c-49cf-b236-f24d3781fdf2 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:34:01.316120 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1446/2886] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:34:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:34:06.296795 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:34:09.200402 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0cbe-c752-45d3-8b04-43d415dc289f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:34:09.201171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0cbe-c752-45d3-8b04-43d415dc289f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:34:09.201171 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0cbe-c752-45d3-8b04-43d415dc289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:34:09.268469 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-eb9f0cbe-c752-45d3-8b04-43d415dc289f None None] MFA Rules not processed for user `7626e0cf57a74281b3cf5f3b31b5b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 18:34:09.269787 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-eb9f0cbe-c752-45d3-8b04-43d415dc289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:34:09.340417 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1441/2887] 10.222.0.45 () {58 vars in 967 bytes} [Fri Aug 26 18:34:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 18:34:09.382364 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23849bd-c23c-49cf-b236-f24d3781fdf2 service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:34:09.383973 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a23849bd-c23c-49cf-b236-f24d3781fdf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:34:09.397075 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:34:09.482047 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23849bd-c23c-49cf-b236-f24d3781fdf2 service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:34:09.489644 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64deb1-4adf-4816-a8aa-d822afc39984 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c92b2c982a4780884365a7a7ec6514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:34:09.490258 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64deb1-4adf-4816-a8aa-d822afc39984 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:34:09.490504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64deb1-4adf-4816-a8aa-d822afc39984 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:34:09.490800 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64deb1-4adf-4816-a8aa-d822afc39984 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:34:09.499914 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64deb1-4adf-4816-a8aa-d822afc39984 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:34:09.501588 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64deb1-4adf-4816-a8aa-d822afc39984 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:34:09.510542 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1447/2888] 10.222.0.45 () {60 vars in 1384 bytes} [Fri Aug 26 18:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 18:34:16.586946 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f0cbe-c752-45d3-8b04-43d415dc289f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:34:16.589301 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-eb9f0cbe-c752-45d3-8b04-43d415dc289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:34:16.681067 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f0cbe-c752-45d3-8b04-43d415dc289f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:34:16.686447 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:34:16.687101 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:34:16.687382 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:34:16.687659 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] PATH_INFO: `/v3/users/6fc89be7205648b889aeaa6b072d641b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:34:16.689106 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc89be7205648b889aeaa6b072d641b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:34:16.693042 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:34:16.759745 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc89be7205648b889aeaa6b072d641b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:16.773807 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc89be7205648b889aeaa6b072d641b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:16.774676 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc89be7205648b889aeaa6b072d641b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:16.782326 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc89be7205648b889aeaa6b072d641b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:16.784189 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:34:16.791179 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc89be7205648b889aeaa6b072d641b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:16.797880 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1442/2889] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:34:16 2022] DELETE /identity/v3/users/6fc89be7205648b889aeaa6b072d641b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:34:16.997749 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64deb1-4adf-4816-a8aa-d822afc39984 service swift] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:34:17.010126 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64deb1-4adf-4816-a8aa-d822afc39984 service swift] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:34:17.077190 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:34:17.078044 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:34:17.078423 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:34:17.078808 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] PATH_INFO: `/v3/projects/c26abe1c65a24c8796880a82af3627e0` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:34:17.080381 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26abe1c65a24c8796880a82af3627e0)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:34:17.083045 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:34:17.138419 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26abe1c65a24c8796880a82af3627e0', 'request_id': 'req-7a0072ae-65b8-4252-bf53-a15c89e60e84'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.144790 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26abe1c65a24c8796880a82af3627e0', 'request_id': 'req-7a0072ae-65b8-4252-bf53-a15c89e60e84'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.151614 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26abe1c65a24c8796880a82af3627e0', 'request_id': 'req-7a0072ae-65b8-4252-bf53-a15c89e60e84'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.167304 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] The token cache is being invalidate because project c26abe1c65a24c8796880a82af3627e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:34:17.167618 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.168348 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.170015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1448/2890] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:34:16 2022] DELETE /identity/v3/projects/c26abe1c65a24c8796880a82af3627e0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:34:17.174492 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:34:17.176245 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:34:17.192635 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500073ec-d817-4a7c-ac93-2e7eda5336a7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:34:17.256482 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:34:17.257330 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:34:17.258941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:34:17.258941 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] PATH_INFO: `/v3/users/001520b6b3c140cfb3d7849a6bfb553f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:34:17.259511 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=001520b6b3c140cfb3d7849a6bfb553f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:34:17.261567 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:34:17.318315 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001520b6b3c140cfb3d7849a6bfb553f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.331666 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001520b6b3c140cfb3d7849a6bfb553f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.332485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001520b6b3c140cfb3d7849a6bfb553f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.341182 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001520b6b3c140cfb3d7849a6bfb553f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.351698 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001520b6b3c140cfb3d7849a6bfb553f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.359485 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1443/2891] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:34:17 2022] DELETE /identity/v3/users/001520b6b3c140cfb3d7849a6bfb553f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:34:17.550351 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:34:17.551834 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:34:17.571631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0072ae-65b8-4252-bf53-a15c89e60e84 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:34:17.578661 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:34:17.641159 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:34:17.641823 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:34:17.642098 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:34:17.642369 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] PATH_INFO: `/v3/projects/7dd52dbea2764162868b0c78ebe2cd80` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:34:17.644036 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd52dbea2764162868b0c78ebe2cd80)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:34:17.646511 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:34:17.703194 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd52dbea2764162868b0c78ebe2cd80', 'request_id': 'req-bac9f01d-2c4c-432d-ba08-0f3bba939a80'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.709566 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd52dbea2764162868b0c78ebe2cd80', 'request_id': 'req-bac9f01d-2c4c-432d-ba08-0f3bba939a80'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.718288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd52dbea2764162868b0c78ebe2cd80', 'request_id': 'req-bac9f01d-2c4c-432d-ba08-0f3bba939a80'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.742025 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] The token cache is being invalidate because project 7dd52dbea2764162868b0c78ebe2cd80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:34:17.742385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.743284 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:34:17.745039 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1449/2892] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:34:17 2022] DELETE /identity/v3/projects/7dd52dbea2764162868b0c78ebe2cd80 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:34:27.355077 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=55 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:34:27.736678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:35:14.523577 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:35:14.525338 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:35:14.623559 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d6593-1da2-41f6-8cbe-946a5a168d35 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:35:14.733093 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749bec5-4075-4aeb-9e8e-caa6dd75ce3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3791df34c6e442aaabd90d7f5c2f3a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:35:14.733950 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749bec5-4075-4aeb-9e8e-caa6dd75ce3c service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:35:14.734198 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749bec5-4075-4aeb-9e8e-caa6dd75ce3c service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:35:14.734612 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749bec5-4075-4aeb-9e8e-caa6dd75ce3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:35:14.737128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a749bec5-4075-4aeb-9e8e-caa6dd75ce3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:35:14.757645 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749bec5-4075-4aeb-9e8e-caa6dd75ce3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:35:14.760254 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749bec5-4075-4aeb-9e8e-caa6dd75ce3c service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:35:14.778135 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1444/2893] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:35:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 18:35:24.770664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=62 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:35:25.307899 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:35:25.309436 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:35:25.373234 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749bec5-4075-4aeb-9e8e-caa6dd75ce3c service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:35:25.377300 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a749bec5-4075-4aeb-9e8e-caa6dd75ce3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:35:25.413792 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9f01d-2c4c-432d-ba08-0f3bba939a80 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:35:25.420333 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac1308-44f3-4a09-8fbd-b172ee78edcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9eef8921de43f18245f47559f3fa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:35:25.421147 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac1308-44f3-4a09-8fbd-b172ee78edcb service placement] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:35:25.421497 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac1308-44f3-4a09-8fbd-b172ee78edcb service placement] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:35:25.421831 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac1308-44f3-4a09-8fbd-b172ee78edcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:35:25.424500 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-53ac1308-44f3-4a09-8fbd-b172ee78edcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:35:25.439249 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac1308-44f3-4a09-8fbd-b172ee78edcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:35:25.442405 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac1308-44f3-4a09-8fbd-b172ee78edcb service placement] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:35:25.461139 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1450/2894] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:35:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:35:25.466114 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749bec5-4075-4aeb-9e8e-caa6dd75ce3c service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:35:25.473172 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:35:25.473848 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:35:25.474131 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:35:25.474405 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] PATH_INFO: `/v3/users/fd0921be36eb4388a8e3098f5fba3ee7` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:35:25.477001 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0921be36eb4388a8e3098f5fba3ee7)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:35:25.479177 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:35:25.542439 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0921be36eb4388a8e3098f5fba3ee7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:25.556756 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0921be36eb4388a8e3098f5fba3ee7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:25.557551 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0921be36eb4388a8e3098f5fba3ee7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:25.565384 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0921be36eb4388a8e3098f5fba3ee7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:25.578300 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0921be36eb4388a8e3098f5fba3ee7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:25.586722 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1445/2895] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:35:25 2022] DELETE /identity/v3/users/fd0921be36eb4388a8e3098f5fba3ee7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:35:25.782091 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac1308-44f3-4a09-8fbd-b172ee78edcb service placement] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:35:25.797020 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac1308-44f3-4a09-8fbd-b172ee78edcb service placement] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:35:25.872699 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:35:25.873306 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:35:25.873738 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:35:25.874015 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] PATH_INFO: `/v3/projects/2023d6404889439f8034ea56372395c1` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:35:25.875251 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2023d6404889439f8034ea56372395c1)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:35:25.877504 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:35:25.931939 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2023d6404889439f8034ea56372395c1', 'request_id': 'req-72010980-300b-4311-8976-79ce870ef044'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:25.938097 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2023d6404889439f8034ea56372395c1', 'request_id': 'req-72010980-300b-4311-8976-79ce870ef044'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:25.944890 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2023d6404889439f8034ea56372395c1', 'request_id': 'req-72010980-300b-4311-8976-79ce870ef044'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:25.960163 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] The token cache is being invalidate because project 2023d6404889439f8034ea56372395c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:35:25.960452 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:25.961089 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:25.962631 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1451/2896] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:35:25 2022] DELETE /identity/v3/projects/2023d6404889439f8034ea56372395c1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:35:25.966870 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:35:25.968875 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:35:25.982556 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff0b65-67ff-4108-b4f8-10484853f04f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:35:26.053003 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:35:26.053664 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:35:26.053993 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:35:26.054213 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] PATH_INFO: `/v3/users/1f2950443b7d4cfaa7db5d3930578932` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:35:26.055490 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f2950443b7d4cfaa7db5d3930578932)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:35:26.057555 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:35:26.082048 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:35:26.109653 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f2950443b7d4cfaa7db5d3930578932'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:26.121613 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f2950443b7d4cfaa7db5d3930578932'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:26.122308 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f2950443b7d4cfaa7db5d3930578932'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:26.129849 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f2950443b7d4cfaa7db5d3930578932'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:26.138455 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f2950443b7d4cfaa7db5d3930578932'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:26.144797 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1446/2897] 10.222.0.45 () {58 vars in 1224 bytes} [Fri Aug 26 18:35:25 2022] DELETE /identity/v3/users/1f2950443b7d4cfaa7db5d3930578932 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:35:26.348650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:35:26.350648 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:35:26.365650 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72010980-300b-4311-8976-79ce870ef044 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:35:26.386948 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:35:26.437042 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d269ce658414d469f0da1f990d74895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a44db81f3af4ce4ac409fec8e68c2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:35:26.437881 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:35:26.438288 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:35:26.438678 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2 admin admin] PATH_INFO: `/v3/projects/538b0b2526cb470c902eec19c82f5308` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:35:26.440122 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538b0b2526cb470c902eec19c82f5308)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:35:26.442902 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:35:26.504137 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538b0b2526cb470c902eec19c82f5308', 'request_id': 'req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:26.512124 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538b0b2526cb470c902eec19c82f5308', 'request_id': 'req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:26.519374 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538b0b2526cb470c902eec19c82f5308', 'request_id': 'req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:26.534625 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2 admin admin] The token cache is being invalidate because project 538b0b2526cb470c902eec19c82f5308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 18:35:26.534915 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:26.535649 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fc526a2f-c543-4a07-8073-4c8b81e6a2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 18:35:26.537385 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1452/2898] 10.222.0.45 () {58 vars in 1233 bytes} [Fri Aug 26 18:35:26 2022] DELETE /identity/v3/projects/538b0b2526cb470c902eec19c82f5308 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 18:35:36.141553 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:35:36.531128 dv-cinder-851996-8-iscsi devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:37:47.602550 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 18:37:47.604194 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:37:47.678301 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45639e8e-2921-4c2f-b863-00cd017b1f31 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 18:37:47.742504 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d29dcf-c6c8-42c0-91a8-069c7b02863e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9eef8921de43f18245f47559f3fa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2803c5ec5ecf4223836ddf75397cc095', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 18:37:47.743128 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d29dcf-c6c8-42c0-91a8-069c7b02863e service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 18:37:47.743406 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d29dcf-c6c8-42c0-91a8-069c7b02863e service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 18:37:47.743677 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d29dcf-c6c8-42c0-91a8-069c7b02863e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 18:37:47.746022 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-29d29dcf-c6c8-42c0-91a8-069c7b02863e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 18:37:47.762935 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d29dcf-c6c8-42c0-91a8-069c7b02863e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 18:37:47.764581 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d29dcf-c6c8-42c0-91a8-069c7b02863e service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 18:37:47.775718 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1447/2899] 10.222.0.45 () {60 vars in 1365 bytes} [Fri Aug 26 18:37:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 18:37:57.771281 dv-cinder-851996-8-iscsi devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=58 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}